IrisNet: an internet-scale architecture for multimedia sensors

ABSTRACT

Most current sensor network research explores the use of extremely simple sensors on small devices called motes and focuses on over-coming the resource constraints of these devices. In contrast, our research explores the challenges of multimedia sensors and is motivated by the fact that multimedia devices, such as cameras, are rapidly becoming inexpensive, yet their use in a sensor network presents a number of unique challenges. For example, the data rates involved with multimedia sensors are orders of magnitude greater than those for sensor motes and this data cannot easily be processed by traditional sensor network techniques that focus on scalar data. In addition, the richness of the data generated by multimedia sensors makes them useful for a wide variety of applications. This paper presents an overview of IRISNET, a sensor network architecture that enables the creation of a planetary-scale infrastructure of multimedia sensors that can be shared by a large number of applications. To ensure the efficient collection of sensor readings, IRISNET enables the application-specific processing of sensor feeds on the significant computation resources that are typically attached to multimedia sensors. IRISNET enables the storage of sensor readings close to their source by providing a convenient and extensible distributed XML database infrastructure. Finally, IRISNET provides a number of multimedia processing primitives that enable the effective processing of sensor feeds in-network and at-sensor.

REFERENCES

• 1: The Argus program. http://cil-www.oce.orst.edu:8080/.
• 2: IrisLog: A distributed syslog. http://www.intel-iris.net/irislog.php.
• 3: IrisNet: Internet-scale resource-intensive sensor network services. http://www.intel-iris.net/.
• 4: Planetlab. http://www.planet-lab.net/.
• 5: XML path language (XPATH). http://www.w3.org/TR/xpath.
• 6: D. Agrawal , S. Sengupta, Modular Synchronization in Distributed, Multiversion Databases: Version Control and Concurrency Control, IEEE Transactions on Knowledge and Data Engineering, v.5 n.1, p.126-137, February 1993 [doi>10.1109/69.204097]
• 7: Rafael Alonso , Daniel Barbara , Hector Garcia-Molina, Data caching issues in an information retrieval system, ACM Transactions on Database Systems (TODS), v.15 n.3, p.359-384, Sept. 1990 [doi>10.1145/88636.87848]
• 8: Maxim A. Batalin , Mohammad Rahimi , Yan Yu , Duo Liu , Aman Kansal , Gaurav S. Sukhatme , William J. Kaiser , Mark Hansen , Gregory J. Pottie , Mani Srivastava , Deborah Estrin, Call and response: experiments in sampling the environment, Proceedings of the 2nd international conference on Embedded networked sensor systems, November 03-05, 2004, Baltimore, MD, USA [doi>10.1145/1031495.1031499]
• 9: Philippe Bonnet , Johannes Gehrke , Praveen Seshadri, Towards Sensor Database Systems, Proceedings of the Second International Conference on Mobile Data Management, p.3-14, January 08-10, 2001
• 10: J.-Y. Bouguet. Camera calibration toolbox. http://www.vision.caltech.edu/bouguetj/calib_doc/.
• 11: G. Bradski. Programmer's tool chest: The OpenCV library. Dr. Dobbs Journal, November 2000.
• 12: M. Brown , D. G. Lowe, Recognising Panoramas, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.1218, October 13-16, 2003
• 13: S. Chen, P. B. Gibbons, and S. Nath. Database-centric programming for wide-area sensor systems. In IEEE Intl. Conf. Distributed Computing in Sensor Systems, 2005.
• 14: S. W. Chen and C. Pu. A structural classification of integrated replica control mechanisms. Technical Report CUCS-006-92, Columbia University, New York, NY, 1992.
• 15: R. Collins, A. Lipton, H. Fujiyoshi, and T. Kanade. Algorithms for cooperative multisensor surveillance. Proc. IEEE, 89(10), Oct. 2001.
• 16: Amol Deshpande , Suman Nath , Phillip B. Gibbons , Srinivasan Seshan, Cache-and-query for wide area sensor databases, Proceedings of the 2003 ACM SIGMOD international conference on Management of data, June 09-12, 2003, San Diego, California [doi>10.1145/872757.872818]
• 17: N. Fauchald. Wi-fi hits the vineyeard. Wine Spectator online. http://www.winespectator.com/Wine/Free/Sign_In_redirect?cds_misc_1=/Win%e/ Daily/News_Print/0,,2539,00.html, July 2004.
• 18: P. B. Gibbons, B. Karp, Y. Ke, S. Nath, and S. Seshan. IrisNet: An architecture for a worldwide sensor web. IEEE Pervasive Computing, 2(4), 2003.
• 19: Lewis Girod , Thanos Stathopoulos , Nithya Ramanathan , Jeremy Elson , Deborah Estrin , Eric Osterweil , Tom Schoellhammer, A system for simulation, emulation, and deployment of heterogeneous sensor networks, Proceedings of the 2nd international conference on Embedded networked sensor systems, November 03-05, 2004, Baltimore, MD, USA [doi>10.1145/1031495.1031519]
• 20: Jim Gray , Pat Helland , Patrick O'Neil , Dennis Shasha, The dangers of replication and a solution, Proceedings of the 1996 ACM SIGMOD international conference on Management of data, p.173-182, June 04-06, 1996, Montreal, Quebec, Canada
• 21: Matthew Harren , Joseph M. Hellerstein , Ryan Huebsch , Boon Thau Loo , Scott Shenker , Ion Stoica, Complex Queries in DHT-based Peer-to-Peer Networks, Revised Papers from the First International Workshop on Peer-to-Peer Systems, p.242-259, March 07-08, 2002
• 22: Richard Hartley , Andrew Zisserman, Multiple view geometry in computer visiond, Cambridge University Press, New York, NY, 2001
• 23: John Heidemann , Fabio Silva , Chalermek Intanagonwiwat , Ramesh Govindan , Deborah Estrin , Deepak Ganesan, Building efficient wireless sensor networks with low-level naming, Proceedings of the eighteenth ACM symposium on Operating systems principles, October 21-24, 2001, Banff, Alberta, Canada
• 24: Jason Hill , Robert Szewczyk , Alec Woo , Seth Hollar , David Culler , Kristofer Pister, System architecture directions for networked sensors, Proceedings of the ninth international conference on Architectural support for programming languages and operating systems, p.93-104, November 2000, Cambridge, Massachusetts, United States
• 25: R. Holman, J. Stanley, and T. Ozkan-Haller. The application of video sensor networks to the study of nearshore oceanography. IEEE Pervasive Computing, 2(4), 2003.
• 26: W. Hu, V. N. Tran, N. Bulusu, C.-T. Chou, S. Jha, and A. Taylor. The design and evaluation of a hybrid sensor network for cane-toad monitoring. In IEEE IPSN, 2005.
• 27: Y. Ke and R. Sukthankar. PCA-SIFT: A more distinctive representation for local image descriptors. In IEEE CVPR, 2004.
• 28: Yan Ke , Rahul Sukthankar , Larry Huston, An efficient parts-based near-duplicate and sub-image retrieval system, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027729]
• 29: Narayanan Krishnakumar , Arthur J. Bernstein, Bounded ignorance in replicated systems, Proceedings of the tenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.63-74, May 29-31, 1991, Denver, Colorado, United States [doi>10.1145/113413.113419]
• 30: Wendi Rabiner Heinzelman , Joanna Kulik , Hari Balakrishnan, Adaptive protocols for information dissemination in wireless sensor networks, Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking, p.174-185, August 15-19, 1999, Seattle, Washington, United States [doi>10.1145/313451.313529]
• 31: Lily Lee , Raquel Romano , Gideon Stein, Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.758-767, August 2000 [doi>10.1109/34.868678]
• 32: David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
• 33: S. Madden and M. J. Franklin. Fjording the stream: An architecture for queries over streaming sensor data. In IEEE ICDE, 2002.
• 34: Samuel Madden , Michael J. Franklin , Joseph M. Hellerstein , Wei Hong, TAG: a Tiny AGgregation service for Ad-Hoc sensor networks, Proceedings of the 5th symposium on Operating systems design and implementation

  Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading

  , December 09-11, 2002, Boston, Massachusetts [doi>10.1145/1060289.1060303]
• 35: Samuel Madden , Michael J. Franklin , Joseph M. Hellerstein , Wei Hong, The design of an acquisitional query processor for sensor networks, Proceedings of the 2003 ACM SIGMOD international conference on Management of data, June 09-12, 2003, San Diego, California [doi>10.1145/872757.872817]
• 36: S. Nath, Y. Ke, P. B. Gibbons, B. Karp, and S. Seshan. A distributed filtering architecture for multimedia sensors. In IEEE Int'l Workshop on Broadband Advanced Sensor Networks, 2004. Extended version appears as Technical Report, Intel Research Pittsburgh, 2005.
• 37: S. Nath, H. Yu, P. B. Gibbons, and S. Seshan. Tolerating correlated failures in wide-area monitoring services. Technical report, Intel Research Pittsburgh, 2004.
• 38: L. Peterson, T. Anderson, D. Culler, and T. Roscoe. A blueprint for introducing disruptive technology into the internet. In ACM Hotnets-I, 2002.
• 39: Calton Pu , Avraham Leff, Replica control in distributed systems: as asynchronous approach, Proceedings of the 1991 ACM SIGMOD international conference on Management of data, p.377-386, May 29-31, 1991, Denver, Colorado, United States
• 40: Loren Schwiebert , Sandeep K.S. Gupta , Jennifer Weinmann, Research challenges in wireless networks of biomedical sensors, Proceedings of the 7th annual international conference on Mobile computing and networking, p.151-165, July 2001, Rome, Italy [doi>10.1145/381677.381692]
• 41: Jeff Sidell , Paul M. Aoki , Adam Sah , Carl Staelin , Michael Stonebraker , Andrew Yu, Data Replication in Mariposa, Proceedings of the Twelfth International Conference on Data Engineering, p.485-494, February 26-March 01, 1996
• 42: Abraham Silberschatz , Henry F. Korth , S. Sudarshan, Database Systems Concepts, McGraw-Hill Higher Education, 2001
• 43: Mani Srivastava , Richard Muntz , Miodrag Potkonjak, Smart kindergarten: sensor-based wireless networks for smart developmental problem-solving enviroments, Proceedings of the 7th annual international conference on Mobile computing and networking, p.132-138, July 2001, Rome, Italy [doi>10.1145/381677.381690]
• 44: C. Stauffer and K. Tieu. Automated multi-camera planar tracking correspondence modeling. In IEEE CVPR, 2003.
• 45: Dan Suciu, Distributed query evaluation on semistructured data, ACM Transactions on Database Systems (TODS), v.27 n.1, p.1-62, March 2002 [doi>10.1145/507234.507235]
• 46: Robert Szewczyk , Alan Mainwaring , Joseph Polastre , John Anderson , David Culler, An analysis of a large scale habitat monitoring application, Proceedings of the 2nd international conference on Embedded networked sensor systems, November 03-05, 2004, Baltimore, MD, USA [doi>10.1145/1031495.1031521]
• 47: P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In IEEE CVPR, 2001.
• 48: Ning Xu , Sumit Rangwala , Krishna Kant Chintalapudi , Deepak Ganesan , Alan Broad , Ramesh Govindan , Deborah Estrin, A wireless sensor network For structural monitoring, Proceedings of the 2nd international conference on Embedded networked sensor systems, November 03-05, 2004, Baltimore, MD, USA [doi>10.1145/1031495.1031498]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.11 Software Architectures
            Subjects: Domain-specific architectures

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

General Terms:
Algorithms, Design

Keywords:
multimedia sensors, sensor networks, wide-area sensing infrastructure