Design and development of an indoor navigation and object identification system for the blind

ABSTRACT

In this paper we present a new system that assists blind users in orienting themselves in indoor environments. We developed a sensor module that can be handled like a flashlight by a blind user and can be used for searching tasks within the three-dimensional environment. By pressing keys, inquiries concerning object characteristics, position, orientation and navigation can be sent to a connected portable computer, or to a federation of data servers providing models of the environment. Finally these inquiries are acoustically answered over a text-to-speech engine.

REFERENCES

• 1: Axess Inc, Active Tag,™, http://www.axsi.com/products/ rfidoverview.shtml.
• 2: Coroama, V. The Chatty Environment - A World Explorer for the Visually Impaired. Adjunct Proceedings of Ubicomp (2003).
• 3: Criterion Software Inc., Renderware. http://www.renderware.com.
• 4: Dürr, F., Rothermel, K. On a Location Model for Fine-Grained Geocast. In: Dey, Anind K. (ed.); Schmidt, Albrecht (ed.); McCarthy, Joseph F. (ed.): Proceedings of the 5th International Conference on Ubiquitous Computing: UbiComp '03 (Seattle, Oct. 12-15, 2003), Springer, 18--35.
• 5: Ekahau, Inc. Ekahau Positioning Engine. http://www.ekahau.com/products/positioningengine/.
• 6: Helmholtz, H. v. Handbuch der physiologischen Optik, Issue 2, 3rd Edition, Voss Hamburg Leipzig, 1911.
• 7: Hering, E. Grundzüge der Lehre vom Lichtsinn, Handbuch der gesamten Augenheilkunde, Issue 3, 2nd Edition, Julius Springer Verlag, 1925.
• 8: Hub, A. Von der Objektunabhängigkeit der Farbe im Landschen Versuch über ein Messverfahren der Farbbenennung zum Prototyp einer Orientierungshilfe fur Blinde. PhD Thesis, Technische Universitat Munchen, 2001.
• 9: Hub, A., Teufel, H. Messung von wahrgenommenen Farben in realen Szenen und Vorausberechnung von Objektfarben in verschiedenfarbigen Umgebungen. In: Rahman Jamal, Hans Jaschinski (ed.): Virtuelle Instrumente in der Praxis, Begleitband zum Kongress VIP (2003), Huthig, 11--4.
• 10: Hightower, J., Want, R., Borriello, G. SpotON: An Indoor 3D Location Sensing Technology Based on RF Signal Strength, UW CSE 2000-02-02, University of Washington, Seattle, 2000.
• 11: Identec LTD., Census (RFID). http://www.identec.com/ index.php?p=products/census/matrix.
• 12: Lamb T., Bourriau J. Colour: Art and Science (Darwin College Lectures), Cambridge University Press, 1995.
• 13: Luo, A., Zhang X.-F., Tao W., Burkhardt H. Recognition of Artificial 3-D Landmarks from Depth and Color - a first Prototype of Electronic Glasses for Blind People, Proceedings of the 11th Scandinavian Conf. on Image Analysis (SCIA'99), 1999.
• 14: Daniela Nicklas , Matthias Großmann , Thomas Schwarz , Steffen Volz , Bernhard Mitschang, A Model-Based, Open Architecture for Mobile, Spatially Aware Applications, Proceedings of the 7th International Symposium on Advances in Spatial and Temporal Databases, p.117-135, July 12-15, 2001
• 15: Nissanka B. Priyantha , Anit Chakraborty , Hari Balakrishnan, The Cricket location-support system, Proceedings of the 6th annual international conference on Mobile computing and networking, p.32-43, August 06-11, 2000, Boston, Massachusetts, United States [doi>10.1145/345910.345917]
• 16: OpenSceneGraph API http://www.openscenegraph.org/.
• 17: David A. Ross , Bruce B. Blasch, Wearable interfaces for orientation and wayfinding, Proceedings of the fourth international ACM conference on Assistive technologies, p.193-200, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354380]
• 18: Sillicon Graphics Inc., OpenGL Performer. http://oss.sgi.com /projects/performer/.
• 19: Sonnenblick, Y. An Indoor Navigation System for Blind Individuals, Proceedings of the 13th Annual Conference on Technology and Persons with Disabilities, 1998.
• 20: Sun Microsystem Inc., Java3D. http://java.sun.com/products/ java-media/3D/.
• 21: Shevell, S. K., Wei, J. Chromatic induction: Border Contrast or Adaption to Surrounding Light? Vision Research Vol. 38 (11), (1998), 1561--1566.
• 22: Strothotte, T., Petrie H., Johnson, V., Reichert L. MoBIC: User Needs and Premlimary Design for a Mobility Aid for Blind and Elderly Travellers, Proceedings of the 2nd Tide congress, (1995), 348--351.
• 23: VisuAide Inc., VisuAide Trekker. http://www.visuaide.com/ gpssol.html.
• 24: Wang, Y., Jia, X., Lee, H.K. An Indoors Wireless Positioning System Based on Wireless Local Area Network Infrastructure, Proceedings of the 6th International Symposium on Satellite Navigation Technology Including Mobile Positioning & Location Services, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Prototyping

  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

General Terms:
Design, Experimentation, Human Factors, Measurement

Keywords:
blind users, impaired vision, indoor navigation, mobile computing