Designing an assistive device for the blind based on object localization and augmented auditory reality

ABSTRACT

There are many electronic devices for the visually impaired but few actually get used on a daily basis. This is due in part to the fact that many devices often fail to address the real needs of the users. In this study, we begin with a review of the existing literature followed by a survey of 54 blind people which suggests that one particular function could be particularly useful in a new device, namely, the ability to localize objects. We have tested the possibility of using a sound rendering system to indicate a particular spatial location, and propose to couple this with a biologically inspired image processing system that can locate visual patterns that correspond to particular objects and places. We believe that such a system can address one of the major problems faced by the visually handicapped, namely their difficulty in localizing specific objects.

REFERENCES

• 1: S. Thorpe, D. Fize, and C. Marlot, "Speed of processing in the human visual system," Nature, vol. 381, no. 6582, pp. 520--522, June1996.
• 2: F. Dramas, S. Thorpe, B. Oriola and C. Jouffrais "Localisation d'objets pour les non--voyants par analyse d'image: analyse du besoin et prototypage", ASSISTH, 2007.
• 3: J. Blauert, "Binaural localization," Scand. Audiol. Suppl, vol. 15, pp. 7--26, 1982.
• 4: D. S. Brungart, N. I. Durlach, and W. M. Rabinowitz, "Auditory localization of nearby sources. II. Localization of a broadband source," J. Acoust. Soc. Am., vol. 106, no. 4 Pt 1, pp. 1956--1968, Oct.1999.
• 5: D. S. Brungart and W. M. Rabinowitz, "Auditory localization of nearby sources. Head-related transfer functions," J. Acoust. Soc. Am., vol. 106, no. 3 Pt 1, pp. 1465--1479, Sept.1999.
• 6: D. S. Brungart, A. J. Kordik, B. D. Simpson, and R. L. McKinley, "Auditory localization in the horizontal plane with single and double hearing protection," Aviat. Space Environ. Med., vol. 74, no. 9, pp. 937--946, Sept.2003.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Object recognition

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Depth cues; Color; Tracking

General Terms:
Algorithms, Design, Experimentation, Human Factors, Measurement

Keywords:
assistive device, binaural synthesis, blind, need analysis, object detection