Mixing source and bytecode: a case for compilation by normalization

ABSTRACT

Language extensions increase programmer productivity by providing concise, often domain-specific syntax, and support for static verification of correctness, security, and style constraints. Language extensions can often be realized through translation to the base language, supported by preprocessors and extensible compilers. However, various kinds of extensions require further adaptation of a base compiler's internal stages and components, for example to support separate compilation or to make use of low-level primitives of the platform (e.g., jump instructions or unbalanced synchronization). To allow for a more loosely coupled approach, we propose an open compiler model based on normalization steps from a high-level language to a subset of it, the core language. We developed such a compiler for a mixed Java and (core) bytecode language, and evaluate its effectiveness for composition mechanisms such as traits, as well as statement-level and expression-level language extensions.

REFERENCES

• 1: Alfred V. Aho , Monica S. Lam , Ravi Sethi , Jeffrey D. Ullman, Compilers: Principles, Techniques, and Tools (2nd Edition), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2006
• 2: Pavel Avgustinov , Aske Simon Christensen , Laurie Hendren , Sascha Kuzins , Jennifer Lhoták , Ondřej Lhoták , Oege de Moor , Damien Sereni , Ganesh Sittampalam , Julian Tibble, abc: an extensible AspectJ compiler, Proceedings of the 4th international conference on Aspect-oriented software development, p.87-98, March 14-18, 2005, Chicago, Illinois [doi>10.1145/1052898.1052906]
• 3: Jonthan Bachrach , Keith Playford, The Java syntactic extender (JSE), Proceedings of the 16th ACM SIGPLAN conference on Object oriented programming, systems, languages, and applications, p.31-42, October 14-18, 2001, Tampa Bay, FL, USA
• 4: Mark G. J. van den Brand , Jeroen Scheerder , Jurgen J. Vinju , Eelco Visser, Disambiguation Filters for Scannerless Generalized LR Parsers, Proceedings of the 11th International Conference on Compiler Construction, p.143-158, April 08-12, 2002
• 5: Martin Bravenboer , Eelco Dolstra , Eelco Visser, Preventing injection attacks with syntax embeddings, Proceedings of the 6th international conference on Generative programming and component engineering, October 01-03, 2007, Salzburg, Austria [doi>10.1145/1289971.1289975]
• 6: Martin Bravenboer , Karl Trygve Kalleberg , Rob Vermaas , Eelco Visser, Stratego/XT 0.17. A language and toolset for program transformation, Science of Computer Programming, v.72 n.1-2, p.52-70, June, 2008 [doi>10.1016/j.scico.2007.11.003]
• 7: Martin Bravenboer , Eelco Visser, Concrete syntax for objects: domain-specific language embedding and assimilation without restrictions, Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications, October 24-28, 2004, Vancouver, BC, Canada
• 8: C. Clifton. MultiJava: Design, implementation, and evaluation of a Java-compatible language supporting modular open classes and symmetric multiple dispatch. Technical Report 01-10, Department of Computer Science, Iowa State University, Nov. 2001.
• 9: Curtis Clifton , Todd Millstein , Gary T. Leavens , Craig Chambers, MultiJava: Design rationale, compiler implementation, and applications, ACM Transactions on Programming Languages and Systems (TOPLAS), v.28 n.3, p.517-575, May 2006 [doi>10.1145/1133651.1133655]
• 10: John S. Danaher , I.-Ting Angelina Lee , Charles E. Leiserson, Programming with exceptions in JCilk, Science of Computer Programming, v.63 n.2, p.147-171, 1 December 2006 [doi>10.1016/j.scico.2006.05.008]
• 11: A. B. Dov. infomancers-collections. http://code.google.com/p/infomancers-collections/
• 12: Stéphane Ducasse , Oscar Nierstrasz , Nathanael Schärli , Roel Wuyts , Andrew P. Black, Traits: A mechanism for fine-grained reuse, ACM Transactions on Programming Languages and Systems (TOPLAS), v.28 n.2, p.331-388, March 2006 [doi>10.1145/1119479.1119483]
• 13: Torbjörn Ekman , Görel Hedin, The jastadd extensible java compiler, Proceedings of the 22nd annual ACM SIGPLAN conference on Object oriented programming systems and applications, October 21-25, 2007, Montreal, Quebec, Canada
• 14: James Gosling , Bill Joy , Guy L. Steele, The Java Language Specification, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1996
• 15: J. C. Hardwick and J. Sipelstein. Java as an intermediate language. Technical Report CMU-CS-96-161, School of Computer Science, Carnegie Mellon University, August 1996.
• 16: Zef Hemel , Lennart C. Kats , Eelco Visser, Code Generation by Model Transformation, Proceedings of the 1st international conference on Theory and Practice of Model Transformations, July 01-02, 2008, Zurich, Switzerland [doi>10.1007/978-3-540-69927-9_13]
• 17: Martin Hirzel , Robert Grimm, Jeannie: granting java native interface developers their wishes, Proceedings of the 22nd annual ACM SIGPLAN conference on Object oriented programming systems and applications, October 21-25, 2007, Montreal, Quebec, Canada
• 18: J. B. Kam and J. D. Ullman. Monotone data flow analysis frameworks. Acta Inf., 7:305--317, 1977.
• 19: L. C. L. Kats. java-csharp: C#-inspired language extensions for Java. http://strategoxt.org/Stratego/JavaCSharp/.
• 20: G. Kiczales, J. Lamping, A. Menhdhekar, C. Maeda, C. Lopes, J.-M. Loingtier, and J. Irwin. Aspect-oriented programming. In M. Aks¸it and S. Matsuoka, editors, Proceedings of the European Conference on Object-Oriented Programming (ECOOP'07), volume 1241 of Lecture Notes in Computer Science, pages 220--242. Springer, 1997.
• 21: Sheng Liang, Java Native Interface: Programmer's Guide and Reference, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 22: Tim Lindholm , Frank Yellin, Java Virtual Machine Specification, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 23: F. Logozzo and M. Fähndrich. On the relative completeness of bytecode analysis versus source code analysis. In L. Hendren, editor, Compiler Construction (CC'08), volume 4959 of Lecture Notes in Computer Science, pages 192--212. Springer, 2008.
• 24: Jim Melton , Andrew Eisenberg, Understanding SQL and Java together: a guide to SQLJ, JDBC, and related technologies, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2000
• 25: Jon Meyer , Troy Downing, Java virtual machine, O'Reilly & Associates, Inc., Sebastopol, CA, 1997
• 26: Jerome Miecznikowski , Laurie Hendren, Decompiling Java using staged encapsulation, Proceedings of the Eighth Working Conference on Reverse Engineering (WCRE'01), p.368, October 02-05, 2001
• 27: Stephan Murer , Stephen Omohundro , David Stoutamire , Clemens Szyperski, Iteration abstraction in Sather, ACM Transactions on Programming Languages and Systems (TOPLAS), v.18 n.1, p.1-15, Jan. 1996 [doi>10.1145/225540.225541]
• 28: N. Nystrom, M. Clarkson, and A. Myers. Polyglot: An Extensible Compiler Framework for Java. Compiler Construction (CC'03), 2622:138--152, Apr. 2003.
• 29: M. Odersky and al. An overview of the Scala programming language. Technical Report IC/2004/64, EPFL Lausanne, Switzerland, 2004.
• 30: S. Pedroni and N. Rappin. Jython Essentials. O'Reilly Media, Inc., 2002.
• 31: Simon L. Peyton Jones , André L. M. Santos, A transformation-based optimiser for Haskell, Science of Computer Programming, v.32 n.1-3, p.3-47, Sept. 1998 [doi>10.1016/S0167-6423(97)00029-4]
• 32: Keith Seymour , Jack Dongarra, Automatic translation of Fortran to JVM bytecode, Proceedings of the 2001 joint ACM-ISCOPE conference on Java Grande, p.126-133, June 2001, Palo Alto, California, United States [doi>10.1145/376656.376833]
• 33: Yannis Smaragdakis , Don Batory, Mixin layers: an object-oriented implementation technique for refinements and collaboration-based designs, ACM Transactions on Software Engineering and Methodology (TOSEM), v.11 n.2, p.215-255, April 2002 [doi>10.1145/505145.505148]
• 34: Guy L. Steele, Jr., Growing a Language, Higher-Order and Symbolic Computation, v.12 n.3, p.221-236, October 1999 [doi>10.1023/A:1010085415024]
• 35: Sun Microsystems. The annotation processing tool (apt). http://java.sun.com/j2se/1.5.0/docs/guide/apt.
• 36: Michiaki Tatsubori , Shigeru Chiba , Kozo Itano , Marc-Olivier Killijian, OpenJava: A Class-Based Macro System for Java, Proceedings of the 1st OOPSLA Workshop on Reflection and Software Engineering: Reflection and Software Engineering, Papers from OORaSE 1999, p.117-133, November 01, 1999
• 37: The XDoclet team. XDoclet: attribute-oriented programming. http://xdoclet.sourceforge.net/
• 38: A. Tolmach. An external representation for the GHC core language. http://haskell.org/ghc/docs/papers/core.ps.gz, September 2001.
• 39: Raja Vallée-Rai , Phong Co , Etienne Gagnon , Laurie Hendren , Patrick Lam , Vijay Sundaresan, Soot - a Java bytecode optimization framework, Proceedings of the 1999 conference of the Centre for Advanced Studies on Collaborative research, p.13, November 08-11, 1999, Mississauga, Ontario, Canada
• 40: A. van Deursen , P. Klint , F. Tip, Origin tracking, Journal of Symbolic Computation, v.15 n.5-6, p.523-545, May/June 1993 [doi>10.1016/S0747-7171(06)80004-0]
• 41: Eric Van Wyk , Oege de Moor , Kevin Backhouse , Paul Kwiatkowski, Forwarding in Attribute Grammars for Modular Language Design, Proceedings of the 11th International Conference on Compiler Construction, p.128-142, April 08-12, 2002
• 42: E. Van Wyk, L. Krishnan, A. Schwerdfeger, and D. Bodin. Attribute grammar-based language extensions for Java. In E. Ernst, editor, European Conference on Object Oriented Programming (ECOOP'07), volume 4609 of Lecture Notes on Computer Science, pages 575--599. Springer Verslag, July 2007.
• 43: Eelco Visser, Meta-programming with Concrete Object Syntax, Proceedings of the 1st ACM SIGPLAN/SIGSOFT conference on Generative Programming and Component Engineering, p.299-315, October 06-08, 2002
• 44: J. Warmer and A. Kleppe. Building a flexible software factory using partial domain specific models. In J. Gray, J.-P. Tolvanen, and J. Sprinkle, editors, Proceedings of the 6th OOPSLA Workshop on Domain-Specific Modeling (DSM 2006), volume TR-37 of Computer Science and Information System Reports, pages 15-22, Finland, October 2006. University of Jyväskylä.

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.4 Processors

Additional Classification:
  D. Software
  D.1 PROGRAMMING TECHNIQUES
      D.1.5 Object-oriented Programming
  D.2 SOFTWARE ENGINEERING
      D.2.3 Coding Tools and Techniques
  D.3 PROGRAMMING LANGUAGES
      D.3.3 Language Constructs and Features

General Terms:
Design, Languages

Keywords:
SDF, bytecode, compilers, domain-specific languages, dryad compiler, embedded languages, iterators, java, language extensions, meta programming, source tracing, stratego, traits