Statistical Discrimination of the Synonymy/Antonymy Relationship Between Words

ABSTRACT

A basic hypothesis is stated about the contextual and co-occurrence properties of synonymous words. On the basis of this hypothesis, several statistics are derived for use in discriminating between pairs of words which are synonymous and pairs of words which are nonsynonymous. The discriminating power of these statistics is tested on a corpus consisting of titles of physics theses. The tests indicate that two of the derived statistics have relatively high discriminating power. The results are interpreted and the possibility of obtaining better discriminating power is discussed.

REFERENCES

• 1: H. Edmund Stiles, The Association Factor in Information Retrieval, Journal of the ACM (JACM), v.8 n.2, p.271-279, April 1961 [doi>10.1145/321062.321074]
• 2: GUIIIANO, V. E., AND JONES, P .E . Linear associative information retrieval. In Howerton slid Weeks (EDs.), Vistas in Information Handling, Vol. 1, Ch. 2, SpartanBooks, Washington, D. C., 1963.
• 3: Frank B. Baker, Information Retrieval Based upon Latent Class Analysis, Journal of the ACM (JACM), v.9 n.4, p.512-521, Oct. 1962 [doi>10.1145/321138.321148]
• 4: Lauren B. Doyle, Semantic Road Maps for Literature Searchers, Journal of the ACM (JACM), v.8 n.4, p.553-578, Oct. 1961 [doi>10.1145/321088.321095]
• 5: SPIEGEL, J., BENNETT, E., HAINES, E., VICKSELL,., AND BAKER, J. Statistical association procedures for Inessage content analysis. Information System Language Studies No. 1, Rep. No. SR-79, The Mitre Corp., Bedford, Mass., Oct. 1962.
• 6: BAXENDAIA, P. B. Art empirical model for computer indexing. In Machine Indexing, Americas U., Washington, D. C., 1962, pp. 207-218.
• 7: BIRNBAUM, A., AND MAXWELL, A.E. Classification procedures based on Bayes' formula. Appl. Statist. 9 (1960), 152-169.
• 8: MARCKWOItTH, L.M. Dissertations in Physics; An Indexed Bibliography of All Doctoral heses Accepted by American Universities, 1861-I959. Stanford U. Press, Stanford, Calif., 1961
• 9: DEWEY, GODREFY. Relativ Frequency of English Speech Sounds. Harvard U. Press, Cambridge, Mass., 1923 p. 19.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  G. Mathematics of Computing

General Terms:
Languages, Management, Measurement, Performance, Theory