Hierarchical Gaussian process latent variable models

ABSTRACT

The Gaussian process latent variable model (GP-LVM) is a powerful approach for probabilistic modelling of high dimensional data through dimensional reduction. In this paper we extend the GP-LVM through hierarchies. A hierarchical model (such as a tree) allows us to express conditional independencies in the data as well as the manifold structure. We first introduce Gaussian process hierarchies through a simple dynamical model, we then extend the approach to a more complex hierarchy which is applied to the visualisation of human motion data sets.

REFERENCES

• 1: Awasthi, P., Gagrani, A., & Ravindran, B. (2007). Image modelling using tree structured conditional random fields. Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI 2007) (pp. 2060--2065).
• 2: Christopher M. Bishop , Markus Svensén , Christopher K. I. Williams, GTM: the generative topographic mapping, Neural Computation, v.10 n.1, p.215-234, Jan. 1, 1998 [doi>10.1162/089976698300017953]
• 3: Christopher M. Bishop , Michael E. Tipping, A Hierarchical Latent Variable Model for Data Visualization, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.3, p.281-293, March 1998 [doi>10.1109/34.667885]
• 4: Felzenszwalb, P. F., & Huttenlocher, D. P. (2000). Efficient matching of pictorial structures. Proceedings of the Conference on Computer Vision and Pattern Recognition (pp. 66--73). Hilton Head Island, South Carolina, U.S.A.: IEEE Computer Society Press.
• 5: X. Feng , C. K. I. Williams , S. N. Felderhof, Combining Belief Networks and Neural Networks for Scene Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.4, p.467-483, April 2002 [doi>10.1109/34.993555]
• 6: Ferris, B. D., Fox, D., & Lawrence, N. D. (2007). WiFi-SLAM using Gaussian process latent variable models. Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI 2007) (pp. 2480--2485).
• 7: Keith Grochow , Steven L. Martin , Aaron Hertzmann , Zoran Popović, Style-based inverse kinematics, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 8: Ioffe, S., & Forsyth, D. A. (2001). Mixtures of trees for object recognition. Proceedings of the Conference on Computer Vision and Pattern Recognition (pp. 180--185). Hawaii, U.S.A.: IEEE Computer Society Press.
• 9: Xiangyang Lan , Daniel P. Huttenlocher, Beyond Trees: Common-Factor Models for 2D Human Pose Recovery, Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, p.470-477, October 17-20, 2005 [doi>10.1109/ICCV.2005.48]
• 10: Lawrence, N. D. (2004). Gaussian process models for visualisation of high dimensional data. Advances in Neural Information Processing Systems (pp. 329--336). Cambridge, MA: MIT Press.
• 11: Neil Lawrence, Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models, The Journal of Machine Learning Research, 6, p.1783-1816, 12/1/2005
• 12: Neil D. Lawrence , Joaquin Quiñonero-Candela, Local distance preservation in the GP-LVM through back constraints, Proceedings of the 23rd international conference on Machine learning, p.513-520, June 25-29, 2006, Pittsburgh, Pennsylvania [doi>10.1145/1143844.1143909]
• 13: MacKay, D. J. C. (1995). Bayesian neural networks and density networks. Nuclear Instruments and Methods in Physics Research, A, 354, 73--80.
• 14: MacKay, D. J. C. (1998). Introduction to Gaussian Processes. In C. M. Bishop (Ed.), Neural networks and machine learning, vol. 168 of Series F: Computer and Systems Sciences, 133--166. Berlin: Springer-Verlag.
• 15: Judea Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1988
• 16: Ramanan, D., & Forsyth, D. A. (2003). Finding and tracking people from the bottom up. Proceedings of the Conference on Computer Vision and Pattern Recognition (pp. 467--474). Madison, Wisconsin, U.S.A.: IEEE Computer Society Press.
• 17: Carl Edward Rasmussen , Christopher K. I. Williams, Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning), The MIT Press, 2005
• 18: Sigal, L., Bhatia, S., Roth, S., Black, M. J., & Isard, M. (2004). Tracking loose-limbed people. Proceedings of the Conference on Computer Vision and Pattern Recognition (pp. 421--428). Washington, DC, U.S.A.: IEEE Computer Society Press.
• 19: Peter Tino , Ian Nabney, Hierarchical GTM: Constructing Localized Nonlinear Projection Manifolds in a Principled Way, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.639-656, May 2002 [doi>10.1109/34.1000238]
• 20: Tipping, M. E., & Bishop, C. M. (1999). Probabilistic principal component analysis. Journal of the Royal Statistical Society, B, 6, 611--622.
• 21: Raquel Urtasun , David J. Fleet , Pascal Fua, 3D People Tracking with Gaussian Process Dynamical Models, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.238-245, June 17-22, 2006 [doi>10.1109/CVPR.2006.15]
• 22: Raquel Urtasun , David J. Fleet , Aaron Hertzmann , Pascal Fua, Priors for People Tracking from Small Training Sets, Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1, p.403-410, October 17-20, 2005 [doi>10.1109/ICCV.2005.193]
• 23: Wang, J. M., Fleet, D. J., & Hertzmann, A. (2006). Gaussian process dynamical models. Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press.
• 24: Williams, C. K. I., & Feng, X. (1999). Tree-structured belief networks as models of images. Proceedings Ninth International Conference on Artificial Neural Networks, ICANN'99.