Visualizing textual redundancy in legacy source

ABSTRACT

As a result of maintenance activity legacy systems contain repeated text in the form of large and small blocks that appear in more or less the same form in several places. These repetitions define a structure that can contribute information about the development history of the source different from the documented version or the current directory structure.A strategy based on fingerprinting is used to obtain raw matches indicating where repetitions occur. The information inherent in these matches is then reorganized for easier processing, leading to a natural clustering of substrings. Suppression of detail is usually necessary to make further progress and can be done in several different ways.For example, matches of blocks of text identify associations within groups of files. In cases with complex clusters of files involving multiple overlapping subsets of files, Hasse diagrams can support visualization. Techniques useful for understanding such graphs can then be employed to provide significant insights into the structure of the redundancy and hence the source.The paper discusses this approach and shows results obtained from an example of reasonable size (40 Mbytes of source based on two releases of the GNU gcc compiler).

REFERENCES

• 1: {1} Brenda S. Baker, "A Program for Identifying Duplicated Code", Proceedings of Computing Science and Statistics: 24th Symposium on the Interface, (1992).
• 2: Ted J. Biggerstaff, Design Recovery for Maintenance and Reuse, Computer, v.22 n.7, p.36-49, July 1989 [doi>10.1109/2.30731]
• 3: E. Buss , R. De Mori , W. M. Gentleman , J. Henshaw , H. Johnson , K. Kontogiannis , E. Merlo , H. A. Müller , J. Mylopoulos , S. Paul , A. Prakash , M. Stanley , S. R. Tilley , J. Troster , K. Wong, Investigating reverse engineering technologies for the CAS program understanding project, IBM Systems Journal, v.33 n.3, p.477-500, July 1994
• 4: Erich Buss , John Henshaw, Experiences in program understanding, Proceedings of the 1992 conference of the Centre for Advanced Studies on Collaborative research, November 09-12, 1992, Toronto, Ontario, Canada
• 5: Elliot J. Chikofsky , James H. Cross II, Reverse Engineering and Design Recovery: A Taxonomy, IEEE Software, v.7 n.1, p.13-17, January 1990 [doi>10.1109/52.43044]
• 6: J. Howard Johnson, Identifying redundancy in source code using fingerprints, Proceedings of the 1993 conference of the Centre for Advanced Studies on Collaborative research: software engineering, October 24-28, 1993, Toronto, Ontario, Canada
• 7: J. Howard Johnson, Substring Matching for Clone Detection and Change Tracking, Proceedings of the International Conference on Software Maintenance, p.120-126, September 01, 1994

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.5 Document Capture
          Subjects: Document analysis

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.3 Clustering
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.1 Document and Text Editing
          Subjects: Version control; Document management

General Terms:
Algorithms, Design, Experimentation, Management, Measurement, Performance, Theory