Cyclops: in situ image sensing and interpretation in wireless sensor networks

ABSTRACT

Despite their increasing sophistication, wireless sensor networks still do not exploit the most powerful of the human senses: vision. Indeed, vision provides humans with unmatched capabilities to distinguish objects and identify their importance. Our work seeks to provide sensor networks with similar capabilities by exploiting emerging, cheap, low-power and small form factor CMOS imaging technology. In fact, we can go beyond the stereo capabilities of human vision, and exploit the large scale of sensor networks to provide multiple, widely different perspectives of the physical phenomena.To this end, we have developed a small camera device called Cyclops that bridges the gap between the computationally constrained wireless sensor nodes such as Motes, and CMOS imagers which, while low power and inexpensive, are nevertheless designed to mate with resource-rich hosts. Cyclops enables development of new class of vision applications that span across wireless sensor network. We describe our hardware and software architecture, its temporal and power characteristics and present some representative applications.

REFERENCES

• 1: Deborah Estrin , Ramesh Govindan , John Heidemann , Satish Kumar, Next century challenges: scalable coordination in sensor networks, Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking, p.263-270, August 15-19, 1999, Seattle, Washington, United States [doi>10.1145/313451.313556]
• 2: Alberto Cerpa , Jeremy Elson , Michael Hamilton , Jerry Zhao , Deborah Estrin , Lewis Girod, Habitat monitoring: application driver for wireless communications technology, Workshop on Data communication in Latin America and the Caribbean, p.20-41, April 2001, San Jose, Costa Rica [doi>10.1145/371626.371720]
• 3: David A. Forsyth , Jean Ponce, Computer Vision: A Modern Approach, Prentice Hall Professional Technical Reference, 2002
• 4: Crossbow Technology, "http://www.xbow.com"
• 5: Ember Corporation, "http://www.ember.com/index.html"
• 6: El Gamal A., "Trends in CMOS Image Sensor Technology and Design", International Electron Devices Meeting Digest of Technical Papers, 2002.
• 7: Hurwitz J., Smith S.G., Murray A.A., Denyer P.B., Thomson J., Anderson S., "miniature imaging module for mobile applications", ISSCC Digest of Technical Papers, 2001.
• 8: Atmel Corporation, "http://www.atmel.com/products/avr"
• 9: David Gay , Philip Levis , Robert von Behren , Matt Welsh , Eric Brewer , David Culler, The nesC language: A holistic approach to networked embedded systems, Proceedings of the ACM SIGPLAN 2003 conference on Programming language design and implementation, June 09-11, 2003, San Diego, California, USA
• 10: Tinyos: An operating system for networked sensors, "http://tinyos.millennium.berkeley.edu".
• 11: Polastre J., Szewczyk R., Culler D., "Telos: Enabling Ultra-Low Power Wireless Research", The Fourth International Conference on Information Processing in Sensor Networks: Special track on Platform Tools and Design Methods for Network Embedded Sensors, 2005.
• 12: Cheung S.C. and Kamath C., "Robust techniques for background subtraction in urban traffic video", Video Communications and Image Processing, SPIE Electronic Imaging, San Jose, 2004.
• 13: William T. Freeman, Michal Roth "Orientation Histograms for Hand Gesture Recognition" IEEE Intl. Workshop on Automatic Face and Gesture Recognition, Zurich, 1995.
• 14: William T. Freeman , David B. Anderson , Paul A. Beardsley , Chris N. Dodge , Michal Roth , Craig D. Weissman , William S. Yerazunis , Hiroshi Kage , Kazuo Kyuma , Yasunari Miyake , Ken-ichi Tanaka, Computer Vision for Interactive Computer Graphics, IEEE Computer Graphics and Applications, v.18 n.3, p.42-53, May 1998 [doi>10.1109/38.674971]
• 15: Rhodes H., Agranov G., Hong C., Boettiger U., Mauritzson R., Ladd J., Karasev I., McKee J., Jenkins E., Quinlin W., Patrick I., Li J., Fan X., Panicacci R., Smith S., Mouli C., and Bruce J., "CMOS Imager Technology Shrinks and Image Performance", Micron Technology, Inc., 8000 S. Federal Way, Boise, Idaho.
• 16: Eric R. Fossum, Digital Camera System on a Chip, IEEE Micro, v.18 n.3, p.8-15, May 1998 [doi>10.1109/40.683047]
• 17: Findlater K.M., "A CMOS camera employing a double junction active pixel", Thesis submitted for the degree of Doctor of Philosophy, University of Edinburgh, 2001.
• 18: STMicroelectronics, "http://www.st.com/"
• 19: Micron, "http://www.micron.com/"
• 20: Agilent Technologies, "http://www.agilent.com/"
• 21: OmniVision Technologies Inc., "http://www.ovt.com/index.html"
• 22: Chandrakasan A., Burstein A. and Robert Brodersen W., "A low power chipset for portable multimedia applications", IEEE Int. Solid-State Circuits Conference, 1994.
• 23: Simon T., Chandrakasan A.P., "An Ultra Low Power Adaptive Wavelet Video Encoder with Integrated Memory", IEEE Journal of Solid-State Circuits, 2000.
• 24: Collins, Lipton and Kanade, "A System for Video Surveillance and Monitoring", American Nuclear Society (ANS) Eighth International Topical Meeting on robotics and Remote Systems, Pittsburgh, April 1999.
• 25: Chu M., Reich J.E., Zhao F., "Distributed Attention for Large Video Sensor Networks", Intelligent Distributed Surveillance Systems seminar, London, UK. 2004.
• 26: Aman Kansal , Eric Yuen , William J. Kaiser , Gregory J. Pottie , Mani B. Srivastava, Sensing uncertainty reduction using low complexity actuation, Proceedings of the third international symposium on Information processing in sensor networks, April 26-27, 2004, Berkeley, California, USA [doi>10.1145/984622.984679]
• 27: Belongie S., Branson K., Dollr P. and Rabaud V. "Monitoring Animal Behavior in the Smart Vivarium", Measuring Behavior, Wageningen, The Netherlands, 2005.

INDEX TERMS

Primary Classification:
  B. Hardware
  B.0 GENERAL

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.11 Software Architectures

General Terms:
Design, Experimentation, Measurement, Performance

Keywords:
CMOS imaging, imaging, power efficiency, sensor network, vision