Automatic in vivo microscopy video mining for leukocytes

ABSTRACT

Biological videos are very different from conventional videos. Automatic spatiotemporal mining of moving cells from in vivo microscopy videos is extremely difficult because of the severe noises, camera/subject movements, deformations, and strong dependencies on microscopy operators. In this paper, we present an automatic spatiotemporal mining system of rolling and adherent leukocytes for intravital videos. The magnitude of leukocyte adhesion and decrease in rolling velocity are common interests in inflammation response studies. Currently, there is no existing system which is perfect for such purposes. Several approaches have been proposed for tracking leukocytes. However, these approaches can either only track leukocytes that roll along the centerline of the blood vessel, or can only handle leukocytes with fixed morphologies. In addition, the camera/subject movement is a severe problem which occurs frequently while analyzing in vivo microscopy videos. In this paper, we proposed a new method for automatic recognition of non-adherent and adherent leukocytes. The proposed method includes three steps: (1) camera/subject movement alignment; (2) moving leukocytes detection; (3) adherent leukocytes detection. The experimental results demonstrate the effectiveness of the proposed method.

REFERENCES

• 1: Acton, S. T., Wethmar, K., and Ley, K. Automatic tracking of rolling leukocytes in vivo. Microvasc Res., 63 (2002), 139--148.
• 2: Anderson, S. I., Shiner, R., Brown, M. D., and Hudlicka, O. Icam-1 expression and leukocyte behavior in the microcirculation of chronically ischemic rat skeletal muscles. Microvasc Res., 71 (2006), 205--211.
• 3: Jeffrey S. Beis , David G. Lowe, Shape Indexing Using Approximate Nearest-Neighbour Search in High-Dimensional Spaces, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1000, June 17-19, 1997
• 4: Dorffner, G. Neural network for time series processing. Neural Network World, 6, 4 (1996), 447--468.
• 5: Eden, E., Waisman, D., Rudzsky, M., Bitterman, H., Brod, V., and Rivlin, E. An automated method for analysis of flow characteristics of circulating particles from in vivo video microscopy. IEEE Transactions on Med Imaging, 24 (2005), 1011--1024.
• 6: Ahmed M. Elgammal , David Harwood , Larry S. Davis, Non-parametric Model for Background Subtraction, Proceedings of the 6th European Conference on Computer Vision-Part II, p.751-767, June 26-July 01, 2000
• 7: Martin A. Fischler , Robert C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, Communications of the ACM, v.24 n.6, p.381-395, June 1981 [doi>10.1145/358669.358692]
• 8: Richard Hartley , Andrew Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, New York, NY, 2003
• 9: Lawrence, M. B., and Springer, T. A. Leukocytes roll on a selection at physiologic flow rates: Distinction from and prerequisites for adhesion through integrins. Cell, 65 (1991), 859--873.
• 10: David G. Lowe, Object Recognition from Local Scale-Invariant Features, Proceedings of the International Conference on Computer Vision-Volume 2, p.1150, September 20-25, 1999
• 11: Krystian Mikolajczyk , Cordelia Schmid, A Performance Evaluation of Local Descriptors, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.27 n.10, p.1615-1630, October 2005 [doi>10.1109/TPAMI.2005.188]
• 12: Otsu, N. A threshold selection method from gray-level histogram. IEEE Transactions Systems, Man, Cybernetics, 9 (1979), 62--66.
• 13: Schölkopf, B. and Platt, J. C. Estimating the support of a high-dimensional distribution. Microsoft Research Corporation Technical Report MSR-TR-99-87 (1999).
• 14: Yuan, H., Goetz, D. J., Gaber, M. W., Issekutz, A. C., Merchant, T. E., and Kiani, M. F. Radiation-induced up-regulation of adhesion molecules in brain microvasculature and their modulation by dexamethasone. Radiat Res., 163 (2005), 544--551.
• 15: Alan McIvor , Qi Zang , Reinhard Klette, The Background Subtraction Problem for Video Surveillance Systems, Proceedings of the International Workshop on Robot Vision, p.176-183, February 16-18, 2001
• 16: Schutz, G. J., Schindler, H., and Schmidt, Th. Single molecule microscopy on model membranes reveals anomalous diffusion. Biophysical Journal, 73, (1997), 1073--1080.
• 17: Ghosh, R. N., and Webb, W. W. Automated detection and tracking of individual and clustered cell surface low density lipoprotein receptor molecules. Biophysical Journal, 66, (1994), 1301--1318.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES
      Subjects: Medical information systems

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis

  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES
      Subjects: Health

General Terms:
Algorithms, Design, Experimentation, Measurement, Performance

Keywords:
leukocytes, temporal and spatial mining of biological videos