MobiMine: monitoring the stock market from a PDA

ABSTRACT

This paper describes an experimental mobile data mining system that allows intelligent monitoring of time-critical financial data from a hand-held PDA. It presents the overall system architecture and the philosophy behind the design. It explores one particular aspect of the system---automated construction of personalized focus area that calls for user's attention. This module works using data mining techniques. The paper describes the data mining component of the system that employs a novel Fourier analysis-based approach to efficiently represent, visualize, and communicate decision trees over limited bandwidth wireless networks. The paper also discusses a quadratic programming-based personalization module that runs on the PDAs and the multi-media based user-interfaces. It reports experimental results using an ad hoc peer-to-peer IEEE 802.11 wireless network.

REFERENCES

• 1: E. Michael Azoff , Eitan M. Azoff, Neural Network Time Series Forecasting of Financial Markets, John Wiley & Sons, Inc., New York, NY, 1994
• 2: N. Baba and M. Kozaki. An intelligent forecasting system of stock price using neural networks. In Proceedings of IJCNN, Baltimore, Maryland, pages 652-657, Los Alamitos, 1992. IEEE Press.
• 3: L. Breiman. Pasting bites together for prediction in large data sets and on-line. Technical report, Statistics Department, University of California at Berkeley, 1997.
• 4: L. Breiman, J. H. Freidman, R. A. Olshen, and C. J. Stone. Classification and Regression Trees. Wadsworth, Belmont, CA, 1984.
• 5: Leo Breiman, Pasting Small Votes for Classification in Large Databases and On-Line, Machine Learning, v.36 n.1-2, p.85-103, July-August 1999 [doi>10.1023/A:1007563306331]
• 6: J. Campbell, A. Lo, and A. MacKinley. The Econometrics of Financial Markets. Princeton University Press, USA, 1997.
• 7: S. Cheng. A neural network approach for forecasting and analyzing the price-volume relationship in the taiwan stock market. Master's thesis, National Jow-Tung University, Taiwan, R.O.C, 1994.
• 8: Pedro Domingos , Geoff Hulten, Mining high-speed data streams, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.71-80, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347107]
• 9: Wei Fan , Salvatore J. Stolfo , Junxin Zhang, The application of AdaBoost for distributed, scalable and on-line learning, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.362-366, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312283]
• 10: Nir Friedman , Dan Geiger , Moises Goldszmidt, Bayesian Network Classifiers, Machine Learning, v.29 n.2-3, p.131-163, Nov./Dec. 1997 [doi>10.1023/A:1007465528199]
• 11: Johannes Gehrke , Venkatesh Ganti , Raghu Ramakrishnan , Wei-Yin Loh, BOAT—optimistic decision tree construction, Proceedings of the 1999 ACM SIGMOD international conference on Management of data, p.169-180, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States
• 12: Johan Himberg , Kalle Korpiaho , Heikki Mannila , Johanna Tikanmäki , Hannu Toivonen, Time Series Segmentation for Context Recognition in Mobile Devices, Proceedings of the 2001 IEEE International Conference on Data Mining, p.203-210, November 29-December 02, 2001
• 13: W. Hoeffding. Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association, 58:13-30, 1963.
• 14: Geoff Hulten , Laurie Spencer , Pedro Domingos, Mining time-changing data streams, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.97-106, August 26-29, 2001, San Francisco, California [doi>10.1145/502512.502529]
• 15: Anil K. Jain , Richard C. Dubes, Algorithms for clustering data, Prentice-Hall, Inc., Upper Saddle River, NJ, 1988
• 16: G. Jang, F. Lsi, and T. Parng. Intelligent stock trading decision support system using dual adaptive-structure neural networks. Journal of Information Science Engineering, 9:271-297, 1993.
• 17: Hillol Kargupta , Byung-Hoon Park, Mining Decision Trees from Data Streams in a Mobile Environment, Proceedings of the 2001 IEEE International Conference on Data Mining, p.281-288, November 29-December 02, 2001
• 18: R. Kuo, L. Lee, and C. Lee. Intelligent stock market forecasting system through artificial neural networks and fuzzy delphi. In Proceedings of World Congress on Neural Networks, pages 345-350, San Deigo, 1996. INNS Press.
• 19: Eyal Kushilevitz , Yishay Mansour, Learning decision trees using the Fourier spectrum, Proceedings of the twenty-third annual ACM symposium on Theory of computing, p.455-464, May 05-08, 1991, New Orleans, Louisiana, United States [doi>10.1145/103418.103466]
• 20: C. Lee. Intelligent stock market forecasting system through artificial neural networks and fuzzy delphi. Master's thesis, Kaohsiung Polytechnic Institute, Taiwan, R.O.C, 1996.
• 21: Nathan Linial , Yishay Mansour , Noam Nisan, Constant depth circuits, Fourier transform, and learnability, Journal of the ACM (JACM), v.40 n.3, p.607-620, July 1993 [doi>10.1145/174130.174138]
• 22: H. Markowitz. Portfolio Selection: Efficient Diversification of Investments. Basil Blackwell, Cambridge, 1991.
• 23: Byung-Hoon Park , Hillol Kargupta, Knowledge discovery from heterogeneous data streams using fourier spectrum of decision trees, 2001
• 24: B. Park, Ayyagari R., and H. Kargupta. A Fourier analysis-based approach to learn classifier from distributed heterogeneous data. In Proceedings of the First SIAM Internation Conference on Data Mining, Chicago, US, 2001.
• 25: J. R. Quinlan, Induction of Decision Trees, Machine Learning, v.1 n.1, p.81-106 [doi>10.1023/A:1022643204877]
• 26: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 27: J. C. Schlimmer and R. Granger Jr. Beyond incremental processing: Tracking concept drift. In AAAI, Vol. 1, pages 502-507, 1986.
• 28: W. Nick Street , YongSeog Kim, A streaming ensemble algorithm (SEA) for large-scale classification, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, p.377-382, August 26-29, 2001, San Francisco, California [doi>10.1145/502512.502568]
• 29: P. E. Utgoff. ID5: an incremental ID3. In J. Laird, editor, Proceedings of the Fifth International Conference on Machine Learning, pages 107-120, San Mateo, CA, 1988. Morgan Kaufmann.
• 30: Paul E. Utgoff, Incremental Induction of Decision Trees, Machine Learning, v.4 n.2, p.161-186, November 1989 [doi>10.1023/A:1022699900025]
• 31: P. E. Utgoff. An improved algorithm for incremental induction of decision trees. In Proc. 11th International Conference on Machine Learning, pages 318-325. Morgan Kaufmann, 1994.
• 32: Joseph S. Zirilli, Financial Prediction Using Neural Networks, International Thomson Computer Press, Boston, MA, 1996