Learning nonlinear dynamic models

ABSTRACT

We present a novel approach for learning nonlinear dynamic models, which leads to a new set of tools capable of solving problems that are otherwise difficult. We provide theory showing this new approach is consistent for models with long range structure, and apply the approach to motion capture and high-dimensional video data, yielding results superior to standard alternatives.

REFERENCES

• 1: Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp, T. (2002). A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 50, 174--188.
• 2: Chen, R., & Liu, J. S. (2000). Mixture Kalman filters. Journal of the Royal Statistical Society: Series B, 62, 493--508.
• 3: Hal Daumé, Iii , John Langford , Daniel Marcu, Search-based structured prediction, Machine Learning, v.75 n.3, p.297-325, June 2009 [doi>10.1007/s10994-009-5106-x]
• 4: Gordon, N. J., Salmond, D. J., & Smith, A. (1993). Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE Proceedings Part F. (pp. 107--113).
• 5: Hsu, D., Kakade, S. M., & Zhang, T. (2008). A spectral algorithm for learning hidden markov models. http://arxiv.org/abs/0811.4413.
• 6: Sham Kakade , John Langford, Approximately Optimal Approximate Reinforcement Learning, Proceedings of the Nineteenth International Conference on Machine Learning, p.267-274, July 08-12, 2002
• 7: Roweis, S., & Ghahramani, Z. (2001). Learning nonlinear dynamical systems using the em algorithm. In S. Haykin (Ed.), Kalman filtering and neural networks, 175--220. Wiley.
• 8: Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2006). Modeling human motion using binary latent variables. Advances in Neural Information Processing Systems (pp. 1345--1352). MIT Press.
• 9: Mike West , Jeff Harrison, Bayesian forecasting and dynamic models (2nd ed.), Springer-Verlag New York, Inc., New York, NY, 1997
• 10: Andrew D. Wilson , Aaron F. Bobick, Parametric Hidden Markov Models for Gesture Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.21 n.9, p.884-900, September 1999 [doi>10.1109/34.790429]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning

Additional Classification:
  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
      G.1.5 Roots of Nonlinear Equations
          Subjects: Systems of equations

  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis
      I.6.5 Model Development
          Subjects: Modeling methodologies

General Terms:
Algorithms, Design, Performance, Theory