Gene functional classification by semi-supervised learning from heterogeneous data

ABSTRACT

Gene function discovery is an important and interesting problem in computational analysis of microarray data. In this paper, we investigate the use of a semi-supervised learning algorithm for inferring gene functional classifications from heterogeneous data set consisting of DNA microarray expression measurements and phylogenetic profiles from whole-genome sequence compassions. The semisupervised learning approach aims at minimizing the disagreement between individual models built from each separate information source by employing a co-updating method and making use of both labeled and unlabeled data. Our results suggest that the semisupervised approach could be used for gene functional classification. The data sets and the program code used for the experiments can be accessed from our webpage.

REFERENCES

• 1: Erin L. Allwein , Robert E. Schapire , Yoram Singer, Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers, Proceedings of the Seventeenth International Conference on Machine Learning, p.9-16, June 29-July 02, 2000
• 2: A. P. Dempster, N. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39(1):1, 38 1977.
• 3: S. Becker. Mutual information maximization: Models of cortical self-organization. Network: Computation in Neural Systems, 7(1):7--31, February 1996.
• 4: Avrim Blum , Tom Mitchell, Combining labeled and unlabeled data with co-training, Proceedings of the eleventh annual conference on Computational learning theory, p.92-100, July 24-26, 1998, Madison, Wisconsin, United States [doi>10.1145/279943.279962]
• 5: M. P. S. Brown, W. N. Grundy, D. Lin, N. Cristianini, C. Sugnet, T. S. Furey, J. Manuel Ares, and D. Haussler. Knowledge-based analysis of microarray gene expression data using support vector machines. In Proc. of the National Academy of Science, volume 97, pages 262--267, 2000.
• 6: Christopher J. C. Burges, A Tutorial on Support Vector Machines for Pattern Recognition, Data Mining and Knowledge Discovery, v.2 n.2, p.121-167, June 1998 [doi>10.1023/A:1009715923555]
• 7: M. Collins and Y. Singer. Unsupervised models for named entity classification. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, 1999.
• 8: Virginia R. de Sa , Dana H. Ballard, Category learning through multimodality sensing, Neural Computation, v.10 n.5, p.1097-1117, July 1, 1998 [doi>10.1162/089976698300017368]
• 9: M. B. Eisen, P. T. Spellman, P. O. Brown, and D. Botstein. Cluster analysis and display of genome-wide expression patterns. In Proc. of the National Academy of Sciences of USA, volume 95, 1998.
• 10: T. S. Furey, N. Christianini, N. Duffy, D. W. Bednarski, M. Schummer, and D. Hauessler. Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics, 16(10):906--914, 2000.
• 11: Z. Ghahramani and M. I. Jordan. Supervised learning from incomplete data via an EM approach. In J. D. Cowan, G. Tesauro, and J. Alspector, editors, Advances in Neural Information Processing Systems, volume 6, pages 120--127. Morgan Kaufmann Publishers, Inc., 1994.
• 12: H. McGurk and MacDonald. Hearing lips and seeing voices. Nature, 264:746--748, 1976.
• 13: Kamal Nigam , Rayid Ghani, Analyzing the effectiveness and applicability of co-training, Proceedings of the ninth international conference on Information and knowledge management, p.86-93, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354805]
• 14: Kamal Nigam , Andrew Kachites McCallum , Sebastian Thrun , Tom Mitchell, Text Classification from Labeled and Unlabeled Documents using EM, Machine Learning, v.39 n.2-3, p.103-134, May-June 2000 [doi>10.1023/A:1007692713085]
• 15: Paul Pavlidis , Jason Weston , Jinsong Cai , William Noble Grundy, Gene functional classification from heterogeneous data, Proceedings of the fifth annual international conference on Computational biology, p.249-255, April 22-25, 2001, Montreal, Quebec, Canada [doi>10.1145/369133.369228]
• 16: Ellen Riloff , Rosie Jones, Learning dictionaries for information extraction by multi-level bootstrapping, Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence, p.474-479, July 18-22, 1999, Orlando, Florida, United States
• 17: Dan Roth , Dmitry Zelenko, Toward a Theory of Learning Coherent Concepts, Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, p.639-644, July 30-August 03, 2000
• 18: D. Roy. Learning from multimodal observations. In IEEE International Conference on Multimedia and Expo (I), pages 579--582, 2000.
• 19: P. Tamayo, D. Slonim, J. Mesirov, Q. Zhu, S. Kitareewan, E. Dmitrovsky, E. Lander, and T. Golub. Interpreting patterns of gene expression with self-organizing maps. In Proc. of the National Academy of Science of USA, volume 96, 1999.
• 20: M. K. Tanenhaus, S.-K. M. J., E. K. M., and S. J. E. Integration of visual and linguistic information in spoken language comprehension. Science, 268:1632--1634, 1995.
• 21: Vladimir N. Vapnik, The nature of statistical learning theory, Springer-Verlag New York, Inc., New York, NY, 1995
• 22: G. Weiss and F. Provost. The effect of class distribution on classifier learning: An empirical study. Technical Report ML-TR 44, Rutgers University, 2001.
• 23: L. Wu, S. L. Oviatt, and P. R. Cohen. Multimodal integration - a statistical view. IEEE Transactions on Multimedia, 1(4):334--341, 1999.
• 24: David Yarowsky, Unsupervised word sense disambiguation rivaling supervised methods, Proceedings of the 33rd annual meeting on Association for Computational Linguistics, p.189-196, June 26-30, 1995, Cambridge, Massachusetts [doi>10.3115/981658.981684]
• 25: Bianca Zadrozny , Charles Elkan, Learning and making decisions when costs and probabilities are both unknown, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.204-213, August 26-29, 2001, San Francisco, California [doi>10.1145/502512.502540]

INDEX TERMS

Keywords:
Support Vector Machine(SVM), gene functional classification, heterogeneous, minimize disagreement, semi-supervised