Influence of different system abstractions on the performance analysis of distributed real-time systems

ABSTRACT

System level performance analysis plays a fundamental role in the design process of real-time embedded systems. Several different approaches have been presented so far to address the problem of accurate performance analysis of distributed embedded systems in early design stages. The existing formal analysis methods are based on essentially different concepts of abstraction. However, the influence of these different models on the accuracy of the system analysis is widely unknown, as a direct comparison of performance analysis methods has not been considered so far. We define a set of benchmarks aimed at the evaluation of performance analysis techniques for distributed systems. We apply different analysis methods to the benchmarks and compare the results obtained in terms of accuracy and analysis times, highlighting the specific effects of the various abstractions. We also point out several pitfalls for the analysis accuracy of single approaches and investigate the reasons for pessimistic performance predictions.

REFERENCES

• 1: Rajeev Alur , David L. Dill, A theory of timed automata, Theoretical Computer Science, v.126 n.2, p.183-235, April 25, 1994 [doi>10.1016/0304-3975(94)90010-8]
• 2: Gerd Behrmann , Alexandre David , Kim G. Larsen , John Hakansson , Paul Petterson , Wang Yi , Martijn Hendriks, UPPAAL 4.0, Proceedings of the 3rd international conference on the Quantitative Evaluation of Systems, p.125-126, September 11-14, 2006 [doi>10.1109/QEST.2006.59]
• 3: Samarjit Chakraborty , Simon Kunzli , Lothar Thiele, A General Framework for Analysing System Properties in Platform-Based Embedded System Designs, Proceedings of the conference on Design, Automation and Test in Europe, p.10190, March 03-07, 2003
• 4: M. González Harbour , J. J. Gutiérrez García , J. C. Palencia Gutiérrez , J. M. Drake Moyano, MAST: Modeling and Analysis Suite for Real Time Applications, Proceedings of the 13th Euromicro Conference on Real-Time Systems, p.125, June 13-15, 2001
• 5: M. Hendriks and M. Verhoef. Timed automata based analysis of embedded system architectures. In Workshop on Parallel and Distributed Real-Time Systems, 2006.
• 6: R. Henia, A. Hamann, M. Jersak, R. Racu, K. Richter, and R. Ernst. System level performance analysis - the SymTA/S approach. IEE Proc. Computers and Digital Techniques, 152(2):148--166, March 2005.
• 7: Jean-Yves Le Boudec , Patrick Thiran, Network calculus: a theory of deterministic queuing systems for the internet, Springer-Verlag New York, Inc., New York, NY, 2001
• 8: J. Lehoczky. Fixed priority scheduling of periodic task sets with arbitrary deadlines. In Proc. of the Real-Time Systems Symposium, pages 201--209, 1990.
• 9: Julio L. Medina Pasaje , Medina González Harbour , Jose M. Drake, MAST Real-Time View: A Graphic UML Tool for Modeling Object-Oriented Real-Time Systems, Proceedings of the 22nd IEEE Real-Time Systems Symposium (RTSS'01), p.245, December 03-06, 2001
• 10: Christer Norström , Anders Wall , Wang Yi, Timed Automata as Task Models for Event-Driven Systems, Proceedings of the Sixth International Conference on Real-Time Computing Systems and Applications, p.182, December 13-15, 1999
• 11: José Carlos Palencia , Michael Gonzalez Harbour, Exploiting Precedence Relations in the Schedulability Analysis of Distributed Real-Time Systems, Proceedings of the 20th IEEE Real-Time Systems Symposium, p.328, December 01-03, 1999
• 12: J. C. Palencia , M. González Harbour, Schedulability Analysis for Tasks with Static and Dynamic Offsets, Proceedings of the IEEE Real-Time Systems Symposium, p.26, December 02-04, 1998
• 13: S. Perathoner, E. Wandeler, and L. Thiele. Evaluation and comparison of performance analysis methods for distributed embedded systems. Technical Report 276, Computer Engineering and Networks Laboratory, ETH Zurich, Mar. 2006.
• 14: Paul Pop , Petru Els , Zebo Peng, Performance estimation for embedded systems with data and control dependencies, Proceedings of the eighth international workshop on Hardware/software codesign, p.62-66, May 2000, San Diego, California, United States [doi>10.1145/334012.334024]
• 15: Traian Pop , Petru Eles , Zebo Peng, Holistic scheduling and analysis of mixed time/event-triggered distributed embedded systems, Proceedings of the tenth international symposium on Hardware/software codesign, May 06-08, 2002, Estes Park, Colorado [doi>10.1145/774789.774828]
• 16: K. Richter. Compositional Performance Analysis. PhD thesis, Technical University of Braunschweig, 2004.
• 17: Kai Richter , Marek Jersak , Rolf Ernst, A Formal Approach to MpSoC Performance Verification, Computer, v.36 n.4, p.60-67, April 2003 [doi>10.1109/MC.2003.1193230]
• 18: Lothar Thiele , Samarjit Chakraborty , Matthias Gries , Alexander Maxiaguine , Jonas Greutert, Embedded Software in Network Processors - Models and Algorithms, Proceedings of the First International Workshop on Embedded Software, p.416-434, October 08-10, 2001
• 19: L. Thiele, S. Chakraborty, and M. Naedele. Real-time calculus for scheduling hard real-time systems. In Proc. Intl. Symposium on Circuits and Systems, volume 4, pages 101--104, 2000.
• 20: Ken Tindell , John Clark, Holistic schedulability analysis for distributed hard real-time systems, Microprocessing and Microprogramming, v.40 n.2-3, p.117-134, April 1994 [doi>10.1016/0165-6074(94)90080-9]
• 21: Ernesto Wandeler , Lothar Thiele, Characterizing Workload Correlations in Multi Processor Hard Real-Time Systems, Proceedings of the 11th IEEE Real Time on Embedded Technology and Applications Symposium, p.46-55, March 07-10, 2005 [doi>10.1109/RTAS.2005.13]
• 22: Ti-Yen Yen , Wayne Wolf, Performance estimation for real-time distributed embedded systems, Proceedings of the 1995 International Conference on Computer Design: VLSI in Computers and Processors, p.64-71, October 02-04, 1995

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.3 SPECIAL-PURPOSE AND APPLICATION-BASED SYSTEMS
      Subjects: Real-time and embedded systems

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS
      Subjects: Modeling techniques

General Terms:
Design, Performance, Verification

Keywords:
benchmarking, performance analysis, system abstraction