Trace-based just-in-time type specialization for dynamic languages

ABSTRACT

Dynamic languages such as JavaScript are more difficult to compile than statically typed ones. Since no concrete type information is available, traditional compilers need to emit generic code that can handle all possible type combinations at runtime. We present an alternative compilation technique for dynamically-typed languages that identifies frequently executed loop traces at run-time and then generates machine code on the fly that is specialized for the actual dynamic types occurring on each path through the loop. Our method provides cheap inter-procedural type specialization, and an elegant and efficient way of incrementally compiling lazily discovered alternative paths through nested loops. We have implemented a dynamic compiler for JavaScript based on our technique and we have measured speedups of 10x and more for certain benchmark programs.

REFERENCES

• 1: LuaJIT roadmap 2008 -- http://lua-users.org/lists/lua-l/2008-02/msg00051.html.
• 2: Mozilla Firefox web browser and Thunderbird email client -- http://www.mozilla.com.
• 3: SPECJVM98 -- http://www.spec.org/jvm98/.
• 4: SpiderMonkey (JavaScript-C) Engine -- http://www.mozilla.org/js/spidermonkey/.
• 5: Surfin' Safari -- Blog Archive -- Announcing SquirrelFish Extreme -- http://webkit.org/blog/214/introducing-squirrelfish-extreme/.
• 6: Alfred V. Aho , Monica S. Lam , Ravi Sethi , Jeffrey D. Ullman, Compilers: Principles, Techniques, and Tools (2nd Edition), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2006
• 7: Vasanth Bala , Evelyn Duesterwald , Sanjeev Banerjia, Dynamo: a transparent dynamic optimization system, Proceedings of the ACM SIGPLAN 2000 conference on Programming language design and implementation, p.1-12, June 18-21, 2000, Vancouver, British Columbia, Canada
• 8: Marc Berndl , Benjamin Vitale , Mathew Zaleski , Angela Demke Brown, Context Threading: A Flexible and Efficient Dispatch Technique for Virtual Machine Interpreters, Proceedings of the international symposium on Code generation and optimization, p.15-26, March 20-23, 2005 [doi>10.1109/CGO.2005.14]
• 9: C. Chambers , D. Ungar, Customization: optimizing compiler technology for SELF, a dynamically-typed object-oriented programming language, Proceedings of the ACM SIGPLAN 1989 Conference on Programming language design and implementation, p.146-160, June 19-23, 1989, Portland, Oregon, United States
• 10: Andreas Gal , Michael Franz, Efficient bytecode verification and compilation in a virtual machine, California State University at Long Beach, Long Beach, CA, 2006
• 11: Andreas Gal , Christian W. Probst , Michael Franz, HotpathVM: an effective JIT compiler for resource-constrained devices, Proceedings of the 2nd international conference on Virtual execution environments, June 14-16, 2006, Ottawa, Ontario, Canada [doi>10.1145/1134760.1134780]
• 12: C. Garrett, J. Dean, D. Grove, and C. Chambers. Measurement and Application of Dynamic Receiver Class Distributions. 1994.
• 13: J. Ha, M. R. Haghighat, S. Cong, and K. S. McKinley. A concurrent trace-based just-in-time compiler for javascript. Dept.of Computer Sciences, The University of Texas at Austin, TR--09--06, 2009.
• 14: B. McCloskey. Personal communication.
• 15: Ian Piumarta , Fabio Riccardi, Optimizing direct threaded code by selective inlining, Proceedings of the ACM SIGPLAN 1998 conference on Programming language design and implementation, p.291-300, June 17-19, 1998, Montreal, Quebec, Canada
• 16: Armin Rigo, Representation-based just-in-time specialization and the psyco prototype for python, Proceedings of the 2004 ACM SIGPLAN symposium on Partial evaluation and semantics-based program manipulation, p.15-26, August 24-25, 2004, Verona, Italy [doi>10.1145/1014007.1014010]
• 17: M. Salib. Starkiller: A Static Type Inferencer and Compiler for Python. Master's Thesis, 2004.
• 18: Toshio Suganuma , Toshiaki Yasue , Toshio Nakatani, A region-based compilation technique for dynamic compilers, ACM Transactions on Programming Languages and Systems (TOPLAS), v.28 n.1, p.134-174, January 2006 [doi>10.1145/1111596.1111600]
• 19: Mathew Zaleski , Angela Demke Brown , Kevin Stoodley, YETI: a graduallY extensible trace interpreter, Proceedings of the 3rd international conference on Virtual execution environments, June 13-15, 2007, San Diego, California, USA [doi>10.1145/1254810.1254823]

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.4 Processors
          Subjects: Run-time environments

Additional Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.4 Processors
          Subjects: Code generation; Incremental compilers

General Terms:
Design, Experimentation, Languages, Measurement, Performance

Keywords:
dynamically typed languages, trace-based compilation