Real-time human action recognition by luminance field trajectory analysis

ABSTRACT

The explosive growth of video content in recent years fueled by the technological leaps in computing and communication has created new challenges for video content analysis that can serve applications in video surveillance, video searching and mining. Human action detection and recognition is one of the important tasks in this effort. In this paper, we present a luminance field manifold trajectory analysis based solution for human activity recognition, without explicit object level information extraction and understanding. This approach is computationally efficient and can operate in real time. The recognition performance is also comparable with the state of art in comparable set ups.

REFERENCES

• 1: S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "A Fully Automated Content-Based Video Search Engine Supporting Spatio-Temporal Queries", IEEE Trans on Circuits and Systems for Video Tech (CSVT), vol. 8, no. 5, pp. 602--615, September 1998.
• 2: Yun Fu , Zhu Li , Thomas S. Huang , Aggelos K. Katsaggelos, Locally adaptive subspace and similarity metric learning for visual data clustering and retrieval, Computer Vision and Image Understanding, v.110 n.3, p.390-402, June, 2008 [doi>10.1016/j.cviu.2007.09.017]
• 3: Yan Ke , Rahul Sukthankar , Martial Hebert, Efficient Visual Event Detection Using Volumetric Features, Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, p.166-173, October 17-20, 2005 [doi>10.1109/ICCV.2005.85]
• 4: T.-Y Kim, S.-F. Wong and R. Cipolla, "Tensor Canonical Correlation Analysis for Action Classification", In Proc. of IEEE Conf. on CVPR, Minneapolis, MN, 2007
• 5: Ivan Laptev , Tony Lindeberg, Space-time Interest Points, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.432, October 13-16, 2003
• 6: Peter N. Belhumeur , João P. Hespanha , David J. Kriegman, Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.7, p.711-720, July 1997 [doi>10.1109/34.598228]
• 7: Z. Li, L. Gao, A. K. Katsaggelos, "Locally Embedded Linear Subspaces for Efficient Video Indexing and Retrieval", Proc. of IEEE Int'l Conf on Multimedia & Expo, pp. 1765--1768, 2006.
• 8: Xiaofei He , Shuicheng Yan , Yuxiao Hu , Partha Niyogi , Hong-Jiang Zhang, Face Recognition Using Laplacianfaces, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.27 n.3, p.328-340, March 2005 [doi>10.1109/TPAMI.2005.55]
• 9: J. C. Niebles, H. Wang, and L. Fei-Fei. "Unsupervised learning of human action categories using spatial-temporal words", Proc of British Machine Vision Conference, Edinburg, 2006.
• 10: Christian Schuldt , Ivan Laptev , Barbara Caputo, Recognizing Human Actions: A Local SVM Approach, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3, p.32-36, August 23-26, 2004 [doi>10.1109/ICPR.2004.747]
• 11: Alper Yilmaz , Mubarak Shah, Recognizing Human Actions in Videos Acquired by Uncalibrated Moving Cameras, Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, p.150-157, October 17-20, 2005 [doi>10.1109/ICCV.2005.201]
• 12: L. Zelnik-Manor and M. Irani, "Event-based analysis of video", Proc. of IEEE CVPR, 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Algorithms, Experimentation, Performance

Keywords:
human action recognition, video analysis, video understanding