Usability evaluation of the South African National Accessibility Portal interactive voice response system

ABSTRACT

One of the most prominent problems that persons with disabilities face in South Africa, is access to relevant disability related information. To address this need the South African National Accessibility Portal (NAP Portal) was developed, that enable people with disabilities to easily get access to information. However, most people in South Africa do not have access to adequate Internet facilities. To overcome this obstacle, an Interactive Voice Response (IVR) engine was connected to the NAP Portal, which allows access to information through a telephony interface. The IVR engine and scripts guide the user through information categories on the portal to the desired information, which is then voiced out to the user. In this paper, we present the evaluation of the IVR system to determine how easy or difficult users experience the whole process of retrieving information via a telephone. A usability evaluation was performed on the current NAP IVR system. Furthermore, a heuristic evaluation was done on a new design of the NAP IVR system to determine whether the major problems, that were highlighted by an expert, are addressed in the new design. Inputs from both of these evaluations will be used to design the next version of the NAP IVR system.

REFERENCES

• 1: Statistics south africa. census 2001. primary tables south africa. census '96 and 2001 compared. http://www.statssa.gov.za/census01/html/c2001primtables.asp, 2004. Accessed August 29, 2008.
• 2: The National Accessibility Portal Initiative. http://www.napsa.org.za. Accessed August 29, 2008.
• 3: The South African National Accessibility Portal. http://www.napsa.org.za/portal. Accessed August 29, 2008.
• 4: L. Coetzee , N. Govender , I. Viviers, The national accessibility portal: an accessible information sharing portal for the South African disability sector, Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), May 07-08, 2007, Banff, Canada [doi>10.1145/1243441.1243456]
• 5: L. Coetzee and I. Viviers. Accessibility Observations of Visually Impaired Users using the South African National Accessibility Portal. In P. Cunningham and M. Cunningham, editors, IST-Africa 2008 Conference Proceedings, Windhoek, Namibia, May 2008. IST-Africa. ISBN: 978-1-905824-07-6.
• 6: Asterisk: The Open Source PBX & Telephony Platform. http://www.asterisk.org/. Accessed August 29, 2008.
• 7: G. Gaffney. Usability evaluation checklist for voice interaction systems. http://www.infodesign.com.au/ftp/VoiceCheck.pdf. Accessed August 29, 2008.
• 8: J. Gant and D. Gant. Web portal functionality and state government e-service. In Proceedings of the 35th Annual Hawaii International Conference on System Sciences, pages 1627--1636, January 2002.
• 9: M. Greeff and P. Kotze. Invidual difficulties faced by individuals with mobility impairments. In Proceedings of IADIS Multi Conference on Computer Science and Information Systems (MCCSIS 2007): IADIS International Conference on interfaces and human computer interaction (IHCI), pages 186--191, Lisbon, Portugal, July 2007.
• 10: MobilED. http://mobiled.uiah.fi/. Accessed August 29, 2008.
• 11: M. Karim. Technology and improved service delivery: Learning points from the malaysian experience. International Review of Administrative Sciences, 69(2):191--204, 2003.
• 12: J. Nielsen. Ten usability heuristics. http://www.useit.com/papers/heuristic/heuristic_list.html. Accessed August 29, 2008.
• 13: G. Radha Krishna Rao and E. Siew. Design, development and implementation of a voice portal builder using next generation networks technology - a case study. In Proceedings of the 7th International Conference on Advanced Communication Technology, pages 201--204, July 2005.
• 14: Y. Yamazaki, H. Iwamida, and K. Watanabe. Technologies for voice portal platform. Fujitsu scientific and technical journal, 40(1):179--186.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

General Terms:
Design, Human Factors

Keywords:
IVR system, heuristic evaluation, usability evaluation