Inlining java native calls at runtime

ABSTRACT

We introduce a strategy for inlining native functions into Java™ applications using a JIT compiler. We perform further optimizations to transform inlined callbacks into semantically equivalent lightweight operations. We show that this strategy can substantially reduce the overhead of performing JNI calls, while preserving the key safety and portability properties of the JNI. Our work leverages the ability to store statically-generated IL alongside native binaries, to facilitate native inlining at Java callsites at JIT compilation time. Preliminary results with our prototype implementation show speedups of up to 93X when inlining and callback transformation are combined.

REFERENCES

• 1: Jack Andrews. Interfacing Java with native code: Performance limits. ITtoolbox for Java Technologies Knowledge Base web site, Peer Publishing section. http://java.ittoolbox.com/documents/document.asp?i=780#, 2000. Also available at http://www.str.com.au/jnibench.
• 2: Andrew Ayers , Stuart de Jong , John Peyton , Richard Schooler, Scalable cross-module optimization, Proceedings of the ACM SIGPLAN 1998 conference on Programming language design and implementation, p.301-312, June 17-19, 1998, Montreal, Quebec, Canada
• 3: David F. Bacon. JaLA: A Java package for linear algebra. Presented at the Computer Science Division, University of California, Berkeley, 1998. IBM T.J. Watson Research Center.
• 4: Mark Baker, Bryan Carpenter, Geoffrey Fox, Sung Hoon Ko, and Xinying Li.m mpiJava: A Java interface to MPI. In Proceedings of the First UK Workshop, Java for High Performance Network Computing at EuroPar, Southampton, UK, September 1998.
• 5: Paolo Bellavista , Antonio Corradi , Cesare Stefanelli, How to Monitor and Control Resource Usage in Mobile Agent Systems, Proceedings of the Third International Symposium on Distributed Objects and Applications, p.65, September 17-20, 2001
• 6: Aart J. C. Bik and Dennis Gannon. A Note on Native Level 1 BLAS in Java. Concurrency: Practice and Experience, 9(11):1091--1099, 1997.
• 7: Andrew D. Birrell , Bruce Jay Nelson, Implementing remote procedure calls, ACM Transactions on Computer Systems (TOCS), v.2 n.1, p.39-59, February 1984 [doi>10.1145/2080.357392]
• 8: Per Bothner. Java/C++ integration - writing native Java methods in natural C++. http://gcc.gnu.org/java/papers/native++.html, November 1997.
• 9: Fabian Breg , Constantine D. Polychronopoulos, Java virtual machine support for object serialization, Proceedings of the 2001 joint ACM-ISCOPE conference on Java Grande, p.173-180, June 2001, Palo Alto, California, United States [doi>10.1145/376656.376846]
• 10: Michal Cierniak, Marsha Eng, Neal Glew, Brian Lewis, and James Stichnoth. The Open Runtime Platform: A Flexible High-Performance Managed Runtime Environment. Intel Technology Journal, 7(1), February 2003.
• 11: Bruce Eckel, Thinking in Java, Prentice Hall Professional Technical Reference, 2002
• 12: Robert Fitzgerald, Todd B. Knoblock, Erik Ruf, Bjarne Steensgard, and David Tarditi. Marmot: An optimizing compiler for Java. Technical Report MSN-TR-99-33, Microsoft Inc., June 16 1999.
• 13: Michael Franz , Thomas Kistler, Slim binaries, Communications of the ACM, v.40 n.12, p.87-94, Dec. 1997 [doi>10.1145/265563.265576]
• 14: Vladimira Getov, Susan Flynn Hummel, and Sava Mintchev. High-performance parallel programming in Java: exploiting native libraries. Concurrency: Practice and Experience, 10(11--13):863--872, 1998.
• 15: Andrew D. Gordon , Don Syme, Typing a multi-language intermediate code, ACM SIGPLAN Notices, v.36 n.3, p.248-260, March 2001
• 16: James Gosling , Bill Joy , Guy L. Steele, The Java Language Specification, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1996
• 17: Bjørn-Ove Heimsund. Native Numerical Interface (NNI). http://www.math.uib.no/~bjornoh/mtj/nni/, November 2004.
• 18: Ron Hitchens, Java Nio, O'Reilly & Associates, Inc., Sebastopol, CA, 2002
• 19: IBM Corporation. IBM rewrites the book on Java performance. http://www.developer.ibm.com/java/j2/j2perfpaper.html.
• 20: IBM Corporation. XL FORTRAN: Eight ways to boost performance. White Paper, 2000.
• 21: Chris Lattner , Vikram Adve, LLVM: A Compilation Framework for Lifelong Program Analysis & Transformation, Proceedings of the international symposium on Code generation and optimization: feedback-directed and runtime optimization, p.75, March 20-24, 2004, Palo Alto, California
• 22: Sheng Liang, Java Native Interface: Programmer's Guide and Reference, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 23: Microsoft Inc. Com: Component object model technologies. http://www.microsoft.com/com/default.mspx.
• 24: Michael Lazar Milvich. JavaCAVE: A 3D immersive environment in Java. Master's thesis, Montana State University, July 13 2004.
• 25: Paul M. Murray , Todd Smith , Suresh Srinivas , Matthias Jacob, Performance Issues for Multi-language Java Applications, Proceedings of the 15 IPDPS 2000 Workshops on Parallel and Distributed Processing, p.544-551, May 01-05, 2000
• 26: NewMonics Inc. Best practices for native code integration with perc. http://www.newmonics.com/perceval/native_whitepaper.shtml, February 26 2003.
• 27: Steve Northover. SWT: The Standard Widget Toolkit, Part 1: Implementation Strategy for Java™ Natives. http://www.eclipse.org/articles/Article-SWT-Design-1/SWT-Design-1.html, March 2001.
• 28: Hirotaka Ogawa , Kouya Shimura , Satoshi Matsuoka , Fuyuhiko Maruyama , Yukihiko Sohda , Yasunori Kimura, OpenJIT: An Open-Ended, Reflective JIT Compiler Framework for Java, Proceedings of the 14th European Conference on Object-Oriented Programming, p.362-387, June 12-16, 2000
• 29: Vladimir Roubtsov. Profiling cpu usage from within a Java application. http://www.javaworld.com/javaworld/javaqa/2002-11/01-qa-1108-cpu.html, November 2002.
• 30: Todd Scallan. a corba primer. http://www.omg.org/news/whitepapers/seguecorba.pdf, June 3 2002.
• 31: Davanum Srinivas. Java tip 86: Support native rendering in jdk 1.3. http://www.javaworld.com/javaworld/javatips/jw-javatip86.html.
• 32: Standard Performance Evaluation Corporation. SPEC CPU2000 V1.2. http://www.spec.org/cpu2000.
• 33: Vaidy Sunderam and Dawid Kurzyniec. Efficient cooperation between Java and native codes -- JNI performance benchmark. In Proceedings of the 2001 International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, Nevada, June 25--28 2001.
• 34: Ronald Veldema. Jcc, a native Java compiler. Master's thesis, Vrije Universiteit, Amsterdam, August 1998.
• 35: Matt Welsh and David Culler. Jaguar: Enabling efficient communication and I/O in Java. Concurrency: Practice and Experience, 12(7):519--538, May 2000.
• 36: Seth White , Cattell , Fisher , Hamilton, JDBC API Tutorial and Reference, Second Edition: Universal Data Access for the Java 2 Platform, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 37: Peng Wu , Sam Midkiff , José Moreira , Manish Gupta, Efficient support for complex numbers in Java, Proceedings of the ACM 1999 conference on Java Grande, p.109-118, June 12-14, 1999, San Francisco, California, United States [doi>10.1145/304065.304109]

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.4 Processors

General Terms:
Design, Experimentation, Languages, Performance

Keywords:
JIT compilation, JNI, Java, inlining, native code