On the need for time series data mining benchmarks

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

On the need for time series data mining benchmarks: a survey and empirical demonstration

Full text

Pdf (1.01 MB)

Source

International Conference on Knowledge Discovery and Data Mining archive
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining table of contents

Edmonton, Alberta, Canada

SESSION: Streams and time series table of contents

Pages: 102 - 111

Year of Publication: 2002

ISBN:1-58113-567-X

Authors

Eamonn Keogh	University of California - Riverside, Riverside, CA
Shruti Kasetty	University of California - Riverside, Riverside, CA

Sponsors

SIGKDD: ACM Special Interest Group on Knowledge Discovery in Data
SIGMOD: ACM Special Interest Group on Management of Data
: AAAI

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 27, Downloads (12 Months): 258, Citation Count: 49

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/775047.775062 What is a DOI?

ABSTRACT

In the last decade there has been an explosion of interest in mining time series data. Literally hundreds of papers have introduced new algorithms to index, classify, cluster and segment time series. In this work we make the following claim. Much of this work has very little utility because the contribution made (speed in the case of indexing, accuracy in the case of classification and clustering, model accuracy in the case of segmentation) offer an amount of "improvement" that would have been completely dwarfed by the variance that would have been observed by testing on many real world datasets, or the variance that would have been observed by changing minor (unstated) implementation details.To illustrate our point, we have undertaken the most exhaustive set of time series experiments ever attempted, re-implementing the contribution of more than two dozen papers, and testing them on 50 real world, highly diverse datasets. Our empirical results strongly support our assertion, and suggest the need for a set of time series benchmarks and more careful empirical evaluation in the data mining community.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Rakesh Agrawal , Christos Faloutsos , Arun N. Swami, Efficient Similarity Search In Sequence Databases, Proceedings of the 4th International Conference on Foundations of Data Organization and Algorithms, p.69-84, October 13-15, 1993
	2	Rakesh Agrawal , King-Ip Lin , Harpreet S. Sawhney , Kyuseok Shim, Fast Similarity Search in the Presence of Noise, Scaling, and Translation in Time-Series Databases, Proceedings of the 21th International Conference on Very Large Data Bases, p.490-501, September 11-15, 1995
	3	Rakesh Agrawal , Giuseppe Psaila , Edward L. Wimmers , Mohamed Zaït, Querying Shapes of Histories, Proceedings of the 21th International Conference on Very Large Data Bases, p.502-514, September 11-15, 1995
	4	Henrik André-Jönsson , Dushan Z. Badal, Using Signature Files for Querying Time-Series Data, Proceedings of the First European Symposium on Principles of Data Mining and Knowledge Discovery, p.211-220, June 24-27, 1997
	5	Bailey, D. (1991). Twelve ways to fool the masses when giving performance results on parallel computers. Supercomputing Review, Aug. 1991, pp. 54--55.
	6	Bay, S. (1999). UCI Repository of Kdd databases {http://kdd.ics.uci.edu/}. Irvine, CA: University of California, Department of Information and Computer Science
	7	Donald J. Berndt , James Clifford, Finding patterns in time series: a dynamic programming approach, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
	8	Tolga Bozkaya , Nasser Yazdani , Meral Özsoyoğlu, Matching and indexing sequences of different lengths, Proceedings of the sixth international conference on Information and knowledge management, p.128-135, November 10-14, 1997, Las Vegas, Nevada, United States [doi>10.1145/266714.266880]
	9	Juan P. Caraça-Valente , Ignacio López-Chavarrías, Discovering similar patterns in time series, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.497-505, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347192]
	10	Efficient Time Series Matching by Wavelets, Proceedings of the 15th International Conference on Data Engineering, p.126, March 23-26, 1999
	11	Kelvin Kam Wing Chu , Man Hon Wong, Fast time-series searching with scaling and shifting, Proceedings of the eighteenth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, p.237-248, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States [doi>10.1145/303976.304000]
	12	Cohen, W. (1993). Efficient pruning methods for separate-and-conquer rule learning systems. In proceedings of the 13th International Joint Conference on Artificial Intelligence, Chambery, France. pp 88--994.
	13	Gautam Das , Dimitrios Gunopulos , Heikki Mannila, Finding Similar Time Series, Proceedings of the First European Symposium on Principles of Data Mining and Knowledge Discovery, p.88-100, June 24-27, 1997
	14	Das, G., Lin, K., Mannila, H., Renganathan, G. & Smyth, P. (1998). Rule discovery from time series. In proceedings of the 4th Int'l Conference on Knowledge Discovery and Data Mining. New York, NY, Aug 27--31. pp 16--22.
	15	Debregeas, A. & Hebrail, G. (1998). Interactive interpretation of kohonen maps applied to curves. In proceedings of the 4th Int'l Conference of Knowledge Discovery and Data Mining. New York, NY, Aug 27--31. pp 179--183.
	16	C. Faloutsos , H. Jagadish , A. Mendelzon , T. Milo, A Signature Technique for Similarity-Based Queries, Proceedings of the Compression and Complexity of Sequences 1997, p.2, June 11-13, 1997
	17	Christos Faloutsos , M. Ranganathan , Yannis Manolopoulos, Fast subsequence matching in time-series databases, Proceedings of the 1994 ACM SIGMOD international conference on Management of data, p.419-429, May 24-27, 1994, Minneapolis, Minnesota, United States
	18	Hakan Ferhatosmanoglu , Ertem Tuncel , Divyakant Agrawal , Amr El Abbadi, Approximate Nearest Neighbor Searching in Multimedia Databases, Proceedings of the 17th International Conference on Data Engineering, p.503-511, April 02-06, 2001
	19	Martin Gavrilov , Dragomir Anguelov , Piotr Indyk , Rajeev Motwani, Mining the stock market (extended abstract): which measure is best?, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.487-496, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347189]
	20	Xianping Ge , Padhraic Smyth, Deformable Markov model templates for time-series pattern matching, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.81-90, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347109]
	21	Pierre Geurts, Pattern Extraction for Time Series Classification, Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery, p.115-127, September 03-05, 2001
	22	Dina Q. Goldin , Paris C. Kanellakis, On Similarity Queries for Time-Series Data: Constraint Specification and Implementation, Proceedings of the First International Conference on Principles and Practice of Constraint Programming, p.137-153, September 19-22, 1995
	23	Valery Guralnik , Jaideep Srivastava, Event detection from time series data, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.33-42, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.312190]
	24	Yun-Wu Huang , Philip S. Yu, Adaptive query processing for time-series data, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, p.282-286, August 15-18, 1999, San Diego, California, United States [doi>10.1145/312129.318357]
	25	Huhtala, Y., Kärkkäinen, J. & Toivonen, H. (1999). Mining for similarities in aligned time series using wavelets. Data Mining and Knowledge Discovery: Theory, Tools, and Technology, SPIE Proceedings Series, Vol. 3695. Orlando, FL, Apr. pp 150--160.
	26	Piotr Indyk , Nick Koudas , S. Muthukrishnan, Identifying Representative Trends in Massive Time Series Data Sets Using Sketches, Proceedings of the 26th International Conference on Very Large Data Bases, p.363-372, September 10-14, 2000
	27	Tamer Kahveci , Ambuj K. Singh, Variable Length Queries for Time Series Data, Proceedings of the 17th International Conference on Data Engineering, p.273-282, April 02-06, 2001
	28	, A. Singh, T. Kahvec , A. Gü, An Efficient Index Structure for Shift and Scale Invariant Search of Multi-Attribute Time Sequences, Proceedings of the 18th International Conference on Data Engineering, p.266, February 26-March 01, 2002
	29	Konstantinos Kalpakis , Dhiral Gada , Vasundhara Puttagunta, Distance Measures for Effective Clustering of ARIMA Time-Series, Proceedings of the 2001 IEEE International Conference on Data Mining, p.273-280, November 29-December 02, 2001
	30	Keogh, E. & Pazzani, M. (1998). An enhanced representation of time series which allows fast and accurate classification, clustering artd relevance feedback. In proceedings of the 4th Int'l Conference on Knowledge Discovery and Data Mining. New York, NY, Aug 27--31. pp 239--241.
	31	Keogh, E. & Smyth, P. (1997). A probabilistic approach to fast pattern matching in time series databases. In proceedings of the 3rd Int'l Conference on Knowledge Discovery and Data Mining. Newport Beach, CA, Aug 14--17. pp 24--20.
	32	Eamonn Keogh , Kaushik Chakrabarti , Michael Pazzani , Sharad Mehrotra, Locally adaptive dimensionality reduction for indexing large time series databases, Proceedings of the 2001 ACM SIGMOD international conference on Management of data, p.151-162, May 21-24, 2001, Santa Barbara, California, United States
	33	Kibler, D., & Langley, P. (1988). Machine learning as an experimental science. In Proceedings of the 3rd European Working Session on Learning. pp. 81--92
	34	Edward Kim , Joyce M. W. Lam , Jiawei Han, AIM: Approximate Intelligent Matching for Time Series Data, Proceedings of the Second International Conference on Data Warehousing and Knowledge Discovery, p.347-357, September 04-06, 2000
	35	Flip Korn , H. V. Jagadish , Christos Faloutsos, Efficiently supporting ad hoc queries in large datasets of time sequences, Proceedings of the 1997 ACM SIGMOD international conference on Management of data, p.289-300, May 11-15, 1997, Tucson, Arizona, United States
	36	Sze Kin Lam , Man Hon Wong, A fast projection algorithm for sequence data searching, Data & Knowledge Engineering, v.28 n.3, p.321-339, Dec. 15, 1998 [doi>10.1016/S0169-023X(98)00023-8]
	37	Lavrenko, V., Schmill, M., Lawrie, D., Ogilvie, P., Jensen, D. & Allan, J. (2000). Mining of concurrent text and time series. In proceedings of the 6th ACM SIGKDD Int'l Conference on Knowledge Discovery and Data Mining Workshop on Text Mining. Boston, MA, Aug 20--23. pp 37--44.
	38	Similarity Search for Multidimensional Data Sequences, Proceedings of the 16th International Conference on Data Engineering, p.599, February 28-March 03, 2000
	39	Chung-Sheng Li , Philip S. Yu , Vittorio Castelli, MALM: a framework for mining sequence database at multiple abstraction levels, Proceedings of the seventh international conference on Information and knowledge management, p.267-272, November 02-07, 1998, Bethesda, Maryland, United States [doi>10.1145/288627.288666]
	40	Woong-Kee Loh , Sang-Wook Kim , Kyu-Young Whang, Index interpolation: an approach to subsequence matching supporting normalization transform in time-series databases, Proceedings of the ninth international conference on Information and knowledge management, p.480-487, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354856]
	41	Chihcheng Hsu, Efficient Searches for Similar Subsequences of Different Lengths in Sequence Databases, Proceedings of the 16th International Conference on Data Engineering, p.23, February 28-March 03, 2000
	42	Sanghyun Park , Sang-Wook Kim , Wesley W. Chu, Segment-based approach for subsequence searches in sequence databases, Proceedings of the 2001 ACM symposium on Applied computing, p.248-252, March 2001, Las Vegas, Nevada, United States [doi>10.1145/372202.372334]
	43	Sanghyun Park , Dongwon Lee , Wesley W. Chu, Fast Retrieval of Similar Subsequences in Long Sequence Databases, Proceedings of the 1999 Workshop on Knowledge and Data Engineering Exchange, p.60, November 07-07, 1999
	44	Polly Wan Po Man , Man Hon Wong, Efficient and robust feature extraction and pattern matching of time series by a lattice structure, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502631]
	45	Similarity Search Over Time-Series Data Using Wavelets, Proceedings of the 18th International Conference on Data Engineering, p.212, February 26-March 01, 2002
	46	Pratt, K. B. & Fink, E. (2002). Search for patterns in compressed time series. Int'l Journal of Image and Graphics. to appear.
	47	Prechelt. L. (1995). A quantitative study of neural network learning algorithm evaluation practices. In proceedings of the 4th Int'l Conference on Artificial Neural Networks. pp. 223--227.
	48	Yunyao Qu , Changzhou Wang , X. Sean Wang, Supporting fast search in time series for movement patterns in multiple scales, Proceedings of the seventh international conference on Information and knowledge management, p.251-258, November 02-07, 1998, Bethesda, Maryland, United States [doi>10.1145/288627.288664]
	49	Rafiei, D. & Mendelzon, A. O. (1998). Efficient retrieval of similar time sequences using DFT. In proceedings of the 5th Int'l Conference on Foundations of Data Organization and Algorithms. Kobe, Japan, Nov 12--13.
	50	On Similarity-Based Queries for Time Series Data, Proceedings of the 15th International Conference on Data Engineering, p.410, March 23-26, 1999
	51	Cyrus Shahabi , Xiaoming Tian , Wugang Zhao, TSA-Tree: A Wavelet-Based Approach to Improve the Efficiency of Multi-Level Surprise and Trend Queries on Time-Series Data, Proceedings of the 12th International Conference on Scientific and Statistical Database Management (SSDBM'00), p.55, July 26-28, 2000 [doi>10.1109/SSDM.2000.869778]
	52	Hagit Shatkay , Stanley B. Zdonik, Approximate Queries and Representations for Large Data Sequences, Proceedings of the Twelfth International Conference on Data Engineering, p.536-545, February 26-March 01, 1996
	53	Simon, J. L. (1994). What some puzzling problems teach about the theory of simulation and the use of resampling. The American Statistician, Vol. 48(4). Nov. pp 1--4.
	54	Zbigniew R. Struzik , Arno Siebes, The Haar Wavelet Transform in the Time Series Similarity Paradigm, Proceedings of the Third European Conference on Principles of Data Mining and Knowledge Discovery, p.12-22, September 15-18, 1999
	55	Walker, J. (2001). HotBits: Genuine random numbers generated by radioactive decay. www.fourrnilab.ch/hotbits/
	56	Wang, C. & Wang, X. S. (2000). Multilevel filtering for high dimensional nearest neighbor search. In proceedings of ACM SIGMOD Workshop on Research lssues in Data Mining and Knowledge Discovery. Dallas, TX, May 14. pp 37--43.
	57	Changzhou Wang , Xiaoyang Sean Wang, Supporting Content-Based Searches on Time Series via Approximation, Proceedings of the 12th International Conference on Scientific and Statistical Database Management (SSDBM'00), p.69, July 26-28, 2000 [doi>10.1109/SSDM.2000.869779]
	58	Changzhou Wang , X. Sean Wang, Supporting subseries nearest neighbor search via approximation, Proceedings of the ninth international conference on Information and knowledge management, p.314-321, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354834]
	59	Leejay Wu , Christos Faloutsos , Katia P. Sycara , Terry R. Payne, FALCON: Feedback Adaptive Loop for Content-Based Retrieval, Proceedings of the 26th International Conference on Very Large Data Bases, p.297-306, September 10-14, 2000
	60	Yi-Leh Wu , Divyakant Agrawal , Amr El Abbadi, A comparison of DFT and DWT based similarity search in time-series databases, Proceedings of the ninth international conference on Information and knowledge management, p.488-495, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354857]
	61	Byoung-Kee Yi , Christos Faloutsos, Fast Time Sequence Indexing for Arbitrary Lp Norms, Proceedings of the 26th International Conference on Very Large Data Bases, p.385-394, September 10-14, 2000
	62	Byoung-Kee Yi , H. V. Jagadish , Christos Faloutsos, Efficient Retrieval of Similar Time Sequences Under Time Warping, Proceedings of the Fourteenth International Conference on Data Engineering, p.201-208, February 23-27, 1998

CITED BY 49

	Jessica Lin , Eamonn Keogh , Wagner Truppel, Clustering of streaming time series is meaningless, Proceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery, June 13-13, 2003, San Diego, California
	Bill Chiu , Eamonn Keogh , Stefano Lonardi, Probabilistic discovery of time series motifs, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C.
	Michail Vlachos , Marios Hadjieleftheriou , Dimitrios Gunopulos , Eamonn Keogh, Indexing multi-dimensional time-series with support for multiple distance measures, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C.
	Jessica Lin , Eamonn Keogh , Stefano Lonardi , Bill Chiu, A symbolic representation of time series, with implications for streaming algorithms, Proceedings of the 8th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery, June 13-13, 2003, San Diego, California
	Eamonn Keogh , Bhrigu Celly , Chotirat Ann Ratanamahatana , Victor Brian Zordan, A novel technique for indexing video surveillance data, First ACM SIGMM international workshop on Video surveillance, November 02-08, 2003, Berkeley, California
	Jessica Lin , Eamonn Keogh , Stefano Lonardi , Jeffrey P. Lankford , Donna M. Nystrom, Visually mining and monitoring massive time series, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA
	Dina Q. Goldin , Todd D. Millstein , Ayferi Kutlu, Bounded similarity querying for time-series data, Information and Computation, v.194 n.2, p.203-241, November 1, 2004
	Lei Chen , M. Tamer Özsu , Vincent Oria, Symbolic representation and retrieval of moving object trajectories, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA
	Yi Wu , Edward Y. Chang, Distance-function design and fusion for sequence data, Proceedings of the thirteenth ACM international conference on Information and knowledge management, November 08-13, 2004, Washington, D.C., USA
	Yunyue Zhu , Dennis Shasha, Warping indexes with envelope transforms for query by humming, Proceedings of the 2003 ACM SIGMOD international conference on Management of data, June 09-12, 2003, San Diego, California
	Eamonn Keogh , Stefano Lonardi , Chotirat Ann Ratanamahatana, Towards parameter-free data mining, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA
	Fabian Mörchen , Alfred Ultsch, Optimizing time series discretization for knowledge discovery, Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, August 21-24, 2005, Chicago, Illinois, USA
	Ying Yang , Xindong Wu , Xingquan Zhu, Combining proactive and reactive predictions for data streams, Proceeding of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining, August 21-24, 2005, Chicago, Illinois, USA
	Jessica Lin , Eamonn Keogh , Stefano Lonardi, Visualizing and discovering non-trivial patterns in large time series databases, Information Visualization, v.4 n.2, p.61-82, July 2005
	Lei Chen , M. Tamer Özsu , Vincent Oria, Robust and fast similarity search for moving object trajectories, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland
	Jürgen Beringer , Eyke Hüllermeier, Online clustering of parallel data streams, Data & Knowledge Engineering, v.58 n.2, p.180-204, August 2006
	W. A. Chaovalitwongse , P. M. Pardalos, On the time series support vector machine using dynamic time warping kernel for brain activity classification, Cybernetics and Systems Analysis, v.44 n.1, p.125-138, January 2008
	Jessica Lin , Eamonn Keogh , Li Wei , Stefano Lonardi, Experiencing SAX: a novel symbolic representation of time series, Data Mining and Knowledge Discovery, v.15 n.2, p.107-144, October 2007
	Jessica Lin , Eamonn Keogh , Li Wei , Stefano Lonardi, Experiencing SAX: a novel symbolic representation of time series, Data Mining and Knowledge Discovery, v.15 n.2, p.107-144, October 2007
	Inés F. Vega-López , Bongki Moon, Quantizing time series for efficient similarity search under time warping, Proceedings of the 2nd IASTED international conference on Advances in computer science and technology, p.334-339, January 23-25, 2006, Puerto Vallarta, Mexico
	Inés F. Vega-López , Bongki Moon, Quantizing time series for efficient subsequence matching, Proceedings of the 24th IASTED international conference on Database and applications, p.209-214, February 13-15, 2006, Innsbruck, Austria
	Eamonn Keogh , Li Wei , Xiaopeng Xi , Sang-Hee Lee , Michail Vlachos, LB_Keogh supports exact indexing of shapes under rotation invariance with arbitrary representations and distance measures, Proceedings of the 32nd international conference on Very large data bases, September 12-15, 2006, Seoul, Korea
	Li Wei , Eamonn Keogh, Semi-supervised time series classification, Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, August 20-23, 2006, Philadelphia, PA, USA
	Xiaolei Li , Jiawei Han, Mining approximate top-k subspace anomalies in multi-dimensional time-series data, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
	Eamonn Keogh , Themistoklis Palpanas , Victor B. Zordan , Dimitrios Gunopulos , Marc Cardle, Indexing large human-motion databases, Proceedings of the Thirtieth international conference on Very large data bases, p.780-791, August 31-September 03, 2004, Toronto, Canada
	Lei Chen , Raymond Ng, On the marriage of Lp-norms and edit distance, Proceedings of the Thirtieth international conference on Very large data bases, p.792-803, August 31-September 03, 2004, Toronto, Canada
	Michael D. Morse , Jignesh M. Patel, An efficient and accurate method for evaluating time series similarity, Proceedings of the 2007 ACM SIGMOD international conference on Management of data, June 11-14, 2007, Beijing, China
	Li Wei , Eamonn Keogh , Helga Van Herle , Agenor Mafra-Neto , Russell J. Abbott, Efficient query filtering for streaming time series with applications to semisupervised learning of time series classifiers, Knowledge and Information Systems, v.11 n.3, p.313-344, April 2007
	Eamonn Keogh , Stefano Lonardi , Chotirat Ann Ratanamahatana , Li Wei , Sang-Hee Lee , John Handley, Compression-based data mining of sequential data, Data Mining and Knowledge Discovery, v.14 n.1, p.99-129, February 2007
	Michail Vlachos , Marios Hadjieleftheriou , Dimitrios Gunopulos , Eamonn Keogh, Indexing Multidimensional Time-Series, The VLDB Journal — The International Journal on Very Large Data Bases, v.15 n.1, p.1-20, January 2006
	Michail Vlachos , Philip S. Yu , Vittorio Castelli , Christopher Meek, Structural Periodic Measures for Time-Series Data, Data Mining and Knowledge Discovery, v.12 n.1, p.1-28, January 2006
	Jonathan S. Anstey , Dennis K. Peters , Chris Dawson, An improved feature extraction technique for high volume time series data, Proceedings of the Fourth conference on IASTED International Conference: Signal Processing, Pattern Recognition, and Applications, p.74-81, February 14-16, 2007, Innsbruck, Austria
	Li Wei , Eamonn Keogh , Xiaopeng Xi , Melissa Yoder, Efficiently finding unusual shapes in large image databases, Data Mining and Knowledge Discovery, v.17 n.3, p.343-376, December 2008
	Tak-chung Fu , Fu-lai Chung , Robert Luk , Chak-man Ng, Representing financial time series based on data point importance, Engineering Applications of Artificial Intelligence, v.21 n.2, p.277-300, March, 2008
	Ira Assent , Ralph Krieger , Farzad Afschari , Thomas Seidl, The TS-tree: efficient time series search and retrieval, Proceedings of the 11th international conference on Extending database technology: Advances in database technology, March 25-29, 2008, Nantes, France
	Jürgen Beringer , Eyke Hüllermeier, Efficient instance-based learning on data streams, Intelligent Data Analysis, v.11 n.6, p.627-650, December 2007
	Stan Salvador , Philip Chan, Toward accurate dynamic time warping in linear time and space, Intelligent Data Analysis, v.11 n.5, p.561-580, October 2007
	Xiaoqing Weng , Junyi Shen, Classification of multivariate time series using locality preserving projections, Knowledge-Based Systems, v.21 n.7, p.581-587, October, 2008
	Xiaoqing Weng , Junyi Shen, Classification of multivariate time series using two-dimensional singular value decomposition, Knowledge-Based Systems, v.21 n.7, p.535-539, October, 2008
	eljko Jagnjić , Nikola Bogunović , Ivanka Pieta , Franjo Jović, Time series classification based on qualitative space fragmentation, Advanced Engineering Informatics, v.23 n.1, p.116-129, January, 2009
	Stefano Lonardi , Jessica Lin , Eamonn Keogh , Bill Chiu, Efficient discovery of unusual patterns in time series, New Generation Computing, v.25 n.1, p.61-93, January 2007
	L. Gonzalez-Abril , F. Velasco , J. A. Ortega , F. J. Cuberos, A new approach to qualitative learning in time series, Expert Systems with Applications: An International Journal, v.36 n.6, p.9924-9927, August, 2009
	Dragomir Yankov , Eamonn Keogh , Umaa Rebbapragada, Disk aware discord discovery: finding unusual time series in terabyte sized datasets, Knowledge and Information Systems, v.17 n.2, p.241-262, November 2008
	Xiaozhe Wang , Kate Smith-Miles , Rob Hyndman, Rule induction for forecasting method selection: Meta-learning the characteristics of univariate time series, Neurocomputing, v.72 n.10-12, p.2581-2594, June, 2009
	Eamonn Keogh , Li Wei , Xiaopeng Xi , Michail Vlachos , Sang-Hee Lee , Pavlos Protopapas, Supporting exact indexing of arbitrarily rotated shapes and periodic time series under Euclidean and warping distance measures, The VLDB Journal — The International Journal on Very Large Data Bases, v.18 n.3, p.611-630, June 2009
	Chiung-Hon Leon Lee , Alan Liu , Wen-Sung Chen, Pattern Discovery of Fuzzy Time Series for Financial Prediction, IEEE Transactions on Knowledge and Data Engineering, v.18 n.5, p.613-625, May 2006
	Young-In Shin , Donald Fussell, Parametric kernels for sequence data analysis, Proceedings of the 20th international joint conference on Artifical intelligence, p.1047-1052, January 06-12, 2007, Hyderabad, India
	Sylvie Galichet , Didier Dubois , Henri Prade, Categorizing classes of signals by means of fuzzy gradual rules, Proceedings of the 18th international joint conference on Artificial intelligence, p.1039-1044, August 09-15, 2003, Acapulco, Mexico
	Lexiang Ye , Eamonn Keogh, Time series shapelets: a new primitive for data mining, Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, June 28-July 01, 2009, Paris, France