An Extended Kalman Filtering Approach to Modeling Nonlinear Dynamic Gene Regulatory Networks via Short Gene Expression Time Series

ABSTRACT

In this paper, the extended Kalman filter (EKF) algorithm is applied to model the gene regulatory network from gene time series data. The gene regulatory network is considered as a nonlinear dynamic stochastic model that consists of the gene measurement equation and the gene regulation equation. After specifying the model structure, we apply the EKF algorithm for identifying both the model parameters and the actual value of gene expression levels. It is shown that the EKF algorithm is an online estimation algorithm that can identify a large number of parameters (including parameters of nonlinear functions) through iterative procedure by using a small number of observations. Four real-world gene expression data sets are employed to demonstrate the effectiveness of the EKF algorithm, and the obtained models are evaluated from the viewpoint of bioinformatics.

REFERENCES

• 1: T. Akutsu, S. Miyano, and S. Kuhara, "Identification of Genetic Networks from a Small Number of Gene Expression Patterns under The Boolean Network Model," Proc. Pacific Symp. Biocomputing , vol. 4, pp. 17-28, 1999.
• 2: L.R. Baugh, A.A. Hill, J.M. Claggett, K. Hill-Harfe, J.C. Wen, D.K. Slonim, E.L. Brown, and C.P. Hunter, "The Homeodomain Protein PAL-1 Specifies a Lineage-Specific Regulatory Network in the C. Elegans Embryo," Development, vol. 132, pp. 1843-1854, 2005.
• 3: Matthew J. Beal , Francesco Falciani , Zoubin Ghahramani , Claudia Rangel , David L. Wild, A Bayesian approach to reconstructing genetic regulatory networks with hidden factors, Bioinformatics, v.21 n.3, p.349-356, February 2005 [doi>10.1093/bioinformatics/bti014]
• 4: Z. Bozdech, M. Llinas, B.L. Pulliam, E.D. Wong, and J. Zhu, "The Transcriptome of the Intraerythrocytic Developmental Cycle of Plasmodium Falciparum," PLoS Biology, vol. 1, no. 1, pp. 85-100, 2003.
• 5: T. Chen, H.L. He, and G.M. Church, "Modeling Gene Expression with Differential Equations," Proc. Pacific Symp. Biocomputing, vol. 4, pp. 29-40, 1999.
• 6: Luonan Chen , Kazuyuki Aihara, Chaos and asymptotical stability in discrete-time neural networks, Physica D, v.104 n.3-4, p.286-325, June 1, 1997 [doi>10.1016/S0167-2789(96)00302-8]
• 7: D.L. Cook, A.N. Gerber, and S.J. Tapscott, "Modeling Stochastic Gene Expression: Implications for Haploinsufficiency," Proc. Nat'l Academy of Science USA, vol. 95, pp. 15641-15646, 1998.
• 8: A. Corigliano and S. Mariani, "Parameter Identification in Explicit Structural Dynamics: Performance of the Extended Kalman Filter," Computer Methods in Applied Mechanics and Eng., vol. 193, pp. 3807-3835, 2004.
• 9: M.J. de Hoon, S. Imoto, K. Kobayashi, N. Ogasawara, and S. Miyano, "Inferring Gene Regulatory Networks from Time-Ordered Gene Expression Data of Bacillus Subtilis Using Differential Equations," Proc. Pacific Symp. Biocomputing, pp. 17- 28, 2003.
• 10: H. de Jong, "Modeling and Simulation of Genetic Regulatory Systems: A Literature Review," J. Computational Biology, vol. 9, no. 1, pp. 67-103, 2002.
• 11: P. D'haeseleer, X. Wen, S. Fuhrman, and R. Somogyi, "Linear Modeling of mRNA Expression Levels during CNS Development and Injury," Proc. Pacific Symp. Biocomputing, pp. 41-52, 1999.
• 12: M.B. Eisen, P.T. Spellman, P.O. Brown, and D. Botstein, "Cluster Analysis and Display of Genome-Wide Expression Patterns," Proc. Nat'l Academy of Science USA, vol. 95, pp. 14863-14868, 1998.
• 13: H. Gao, X. Meng, and T. Chen, "A Parameter-Dependent Approach to Robust H¿ Filtering for Time-Delay Systems," IEEE Trans. Automatic Control, vol. 53, no. 10, pp. 2420-2425, 2008.
• 14: H. Gao, X. Meng, and T. Chen, "A New Design of Robust H2 Filters for Uncertain Systems," Systems and Control Letters, vol. 57, no. 7, pp. 585-593, 2008.
• 15: Z. Gao, H. Wang, and T. Chai, "A Robust Fault Detection Filtering for Stochastic Distribution Systems via Descriptor Estimator and Parametric Gain Design," IET Control Theory Applications, vol. 1, no. 5, pp. 1286-1293.
• 16: Z. Gao and S.X. Ding, "State and Disturbance Estimator for Time-Delay Systems with Application to Fault Estimation and Signal Compensation," IEEE Trans. Signal Processing, vol. 55, no. 12, pp. 5541-5551, 2007.
• 17: Z. Gao and D.W.C. Ho, "State/noise Estimator for Descriptor Systems with Application to Sensor Fault Diagnosis," IEEE Trans. Signal Processing, vol. 54, no. 4, pp. 1316-1326, 2006.
• 18: Z. Gao, X. Dai, T. Breikin, and H. Wang, "High-Gain Observer-Based Parameter Identification with Application in a Gas Turbine," Proc. IFAC Control Congress, pp. 1408-1413, July 2008.
• 19: Zoubin Ghahramani, Learning Dynamic Bayesian Networks, Adaptive Processing of Sequences and Data Structures, International Summer School on Neural Networks, "E.R. Caianiello"-Tutorial Lectures, p.168-197, September 06-13, 1997
• 20: N.S. Holter, A. Maritan, M. Cieplak, N.V. Fedoroff, and J.R. Banavar, "Dynamic Modeling of Gene Expression Data," Proc. Nat'l Academy of Science USA, vol. 98, pp. 1693-1698, 2001.
• 21: S. Huang, "Gene Expression Profiling, Genetic Networks, and Cellular States: An Integrating Concept for Tumorigenesis and Drug Discovery," J. Molecular Medicine, vol. 77, pp. 469-480, 1999.
• 22: S. Huang and D. Dissanayake, "Convergence and Consistency Analysis for Extended Kalman Filter Based SLAM," IEEE Trans. Robotics, vol. 23, no. 5, pp. 1036-1049, 2007.
• 23: A. K. Jain , M. N. Murty , P. J. Flynn, Data clustering: a review, ACM Computing Surveys (CSUR), v.31 n.3, p.264-323, Sept. 1999 [doi>10.1145/331499.331504]
• 24: P. Kellam, X. Liu, N. Martin, C. Orengo, S. Swift, and A. Tucker, "A Framework for Modeling Virus Gene Expression Data," Intelligent Data Analysis, vol. 6, pp. 265-279, 2002.
• 25: T.B. Kepler and T.C. Elston, "Stochasticity in Transcriptional Regulation: Origins, Consequences, and Mathematical Representations," Biophysics J., vol. 81, no. 6, pp. 3116-3136, 2001.
• 26: A.J. Krener, "The Convergence of the Extended Kalman Filter," Directions in Mathematical Systems Theory and Optimization, pp. 173- 182, 2003.
• 27: S. Liang, S. Fuhrman, and R. Somogyi, "REVEAL: A General Reverse Engineering Algorithm for Inference of Genetic Network Architectures," Proc. Pacific Symp. Biocomputing, vol. 3, pp. 18-29, 1998.
• 28: T. Liu, W. Sung, and A. Mittal, "Model Gene Network by Semi-Fixed Bayesian Network," Expert Systems with Applications, vol. 30, no. 1, pp. 42-49, 2006.
• 29: H.M. McAdams and A. Arkin, "Stochastic Mechanisms in Gene Expression," Proc. Nat'l Academy of Science USA, vol. 94, pp. 814- 819, 1997.
• 30: M.F. Maduro and J.H. Rothman, "Making Worm Guts: The Gene Regulatory Network of the Caenorhabditis Elegans Endoderm," Developmental Biology, vol. 246, pp. 68-85, 2002.
• 31: K. Murphy and S. Mian, "Modeling Gene Expression Data Using Dynamic Bayesian Networks," technical report, Univ. of California, 1999.
• 32: Minh Quach , Nicolas Brunel , Florence d'Alché-Buc, Estimating parameters and hidden variables in non-linear state-space models based on ODEs for biological networks inference, Bioinformatics, v.23 n.23, p.3209-3216, December 2007 [doi>10.1093/bioinformatics/btm510]
• 33: M.F. Ramoni, P. Sebastiani, and I.S. Kohane, "Cluster Analysis of Gene Expression Dynamics," Proc. Nat'l Academy of Science USA, vol. 99, pp. 9121-9126, 2002.
• 34: Claudia Rangel , John Angus , Zoubin Ghahramani , Maria Lioumi , Elizabeth Sotheran , Alessia Gaiba , David L. Wild , Francesco Falciani, Modeling T-cell activation using gene expression profiling and state-space models, Bioinformatics, v.20 n.9, p.1361-1372, June 2004 [doi>10.1093/bioinformatics/bth093]
• 35: P. Smolen, D.A. Baxter, and J.H. Byrne, "Mathematical Modeling of Gene Networks Review," Neuron, vol. 26, no. 3, pp. 567-580, 2000.
• 36: R. Somogyi and C.A. Sniegoski, "Modeling the Complexity of Genetic Networks: Understanding Multigenic and Pleiotropic Regulation," Complexity, vol. 1, no. 6, pp. 45-63, 1996.
• 37: S. Swift and X. Liu, "Predicting Glaucomatous Visual Field Deterioration through Short Multivariate Time Series Modeling," Artificial Intelligence in Medicine, vol. 24, pp. 5-24, 2002.
• 38: P. Tamayo, D. Slonim, J. Mesirov, Q. Zhu, S. Kitareewan, E. Dmitrovsky, E.S. Lander, and T.R. Golub, "Interpreting Patterns of Gene Expression with Self-Organizing Maps: Methods and Application to Hematopoietic Differentiation," Proc. Nat'l Academy of Science USA, vol. 96, pp. 2907-2912, 1999.
• 39: S. Tavazoie, J.D. Hughes, M.J. Campbell, R.J. Cho, and G.M. Church, "Systematic Determination of Genetic Network Architecture," Nature Genetics, vol. 22, no. 3, pp. 281-285, 1999.
• 40: T. Thattai and A. van Oudenaarden, "Stochastic Gene Expression in Fluctuating Environments," Proc. Genetics Soc. Am., pp. 523-530, 2004.
• 41: T. Tian and K. Burrage, "Stochastic Neural Network Models for Gene Regulatory Networks," Proc. 2003 IEEE Congress Evolutionary Computation, pp. 162-169, 2003.
• 42: Z. Wang, F. Yang, D.W.C. Ho, S. Swift, A. Tucker, and X. Liu, "Stochastic Dynamic Modeling of Short Gene Expression Time Series Data," IEEE Trans. NanoBioscience, vol. 7, no. 1, pp. 44-55, 2008.
• 43: Z. Wang, H. Gao, J. Cao, and X. Liu, "On Delayed Genetic Regulatory Networks with Polytopic Uncertainties: Robust Stability Analysis," IEEE Trans. NanoBioscience, vol. 7, no. 2, pp. 154- 163, 2008.
• 44: F. Wu, W. Zhang, and A.J. Kusalik, "Modeling Gene Expression from Microarray Expression Data with State-Space Equations," Proc. Pacific Symp. Biocomputing, pp. 581-592, 2004.
• 45: F. Lewis, L. Xie, and D. Popa, Optimal and Robust Estimation: With an Introduction to Stochastic Control Theory, CRC Press, 2007.
• 46: K.Y. Yeung, C. Fraley, A. Murua, A.E. Raftery, and W.L. Ruzzo, "Model-Based Clustering and Data Transformations for Gene Expression Data," Bioinformatics, vol. 17, no. 10, pp. 977-987, 2001.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES
      Subjects: Biology and genetics

Additional Classification:
  G. Mathematics of Computing
  G.3 PROBABILITY AND STATISTICS
      Subjects: Time series analysis

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.3 Clustering
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis
      I.6.5 Model Development
          Subjects: Modeling methodologies

General Terms:
Algorithms, Design, Performance, Theory

Keywords:
Modeling, clustering, DNA microarray technology, extended Kalman filtering, gene expression, time series data.