Real users, real results: examining the limitations of learning styles within AEH

ABSTRACT

This paper examines the current state of AEH (adaptive educational hypermedia) research into explicit learning style modelling for user personalisation. It addresses the problem of non-naïve test subjects, who are often in user trials, thus contributing to experimental bias. Instead, the authors suggest using real people, i.e. users with a range of backgrounds and abilities, in order to gain a truer insight into evidence-based research.

We report on a study carried out with No statistically significant differences were found between experimental groups, learning style preferences or learning environments. We discuss the significance of this, and then critically analyse the use of learning styles in relation to this study and also in the wider context.real users: around 80 children at a UK primary school. The study investigated sequential and global learning styles as a personalisation mechanism in an AEH system. The user trial involved matching and mismatching users and learning environments to see if learning improved. The AEH system used by the children was DEUS, a new e-learning platform that is conceptually similar to WHURLE, an AEH that also used learning styles as its user model.

No statistically significant differences were found between experimental groups, learning style preferences or learning environments. We discuss the significance of this, and then critically analyse the use of learning styles in relation to this study and also in the wider context.

REFERENCES

• 1: Badger, B. and E. O'Hare (1989). Disruptive Behaviour and Weather Patterns in a West Cumbria Secondary School. British Educational Research Journal 15 (1): 89--94.
• 2: Bajraktarevic, N., W. Hall and P. Fullick (2003). ILASH: Incorporating Learning Strategies in Hypermedia. Proceedings of Fourteenth Conference on Hypertext and Hypermedia, Nottingham.
• 3: Bajraktarevic, N., W. Hall and P. Fullick (2003). Incorporating learning styles in hypermedia environment: Empirical evaluation. Proceedings of Fourteenth Conference on Hypertext and Hypermedia, Nottingham.
• 4: Barker, T., S. Jones, C. Britton and D. Messer (2000). The user of the verbaliser-imager cognitive style as a descriptor in a student model of learner characteristics in a multimedia application. Proceedings of 5th Annual Conference of the European Learning Styles Information Network (ELSIN), University of Hertfordshire, UK.
• 5: Elizabeth Brown , Tim Brailsford , Tony Fisher , Adam Moore , Helen Ashman, Reappraising cognitive styles in adaptive web applications, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135827]
• 6: Elizabeth Brown , Craig Stewart , Tim Brailsford, Adapting for Visual and Verbal Learning Styles in AEH, Proceedings of the Sixth IEEE International Conference on Advanced Learning Technologies, p.1145-1146, July 05-07, 2006
• 7: Brusilovsky, P. and J. Eklund (1998). A Study of User Model Based Link Annotation in Educational Hypermedia. Journal of Universal Computer Science 4 (4): 429--448.
• 8: Carver, C. A., R. A. Howard and W. D. Lane (1999). Addressing different learning styles through course hypermedia. IEEE Transactions on Education 42 (1): 33--38.
• 9: Cassidy, S. (2003). Learning styles: an overview of theories, models and measures. Proceedings of 8th Annual Conference of the European Learning Styles Information Network (ELSIN), Hull, UK.
• 10: Coffield, F., D. Moseley, E. Hall and K. Ecclestone (2004). Should we be using learning styles? What research has to say to practice, Learning & Skills Research Centre.
• 11: Coffield, F. J., D. V. Moseley, E. Hall and K. Ecclestone (2004). Learning Styles for Post 16 Learners: What Do We Know? London: Learning and Skills Research Centre/University of Newcastle upon Tyne.
• 12: Cristea, A. I. and A. de Mooij (2003). Adaptive Course Authoring: My Online Teacher. Proceedings of ICT'03, Papeete, French Polynesia.
• 13: Paul De Bra , Ad Aerts , Bart Berden , Barend de Lange , Brendan Rousseau , Tomi Santic , David Smits , Natalia Stash, AHA! The adaptive hypermedia architecture, Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, August 26-30, 2003, Nottingham, UK [doi>10.1145/900051.900068]
• 14: Dunn, R. and K. Dunn (1978). Teaching Students Through Their Individual Learning Styles: A Practical Approach. Virginia, Reston Publishing.
• 15: Felder, R. M. Learning styles {online}. Available at http://www2.ncsu.edu/unity/lockers/users/f/felder/public/Learning_Styles.html> {Accessed on January 2004}.
• 16: Felder, R. M. and B. A. Soloman Index of Learning Styles {online}. Available at http://www.ncsu.edu/felder-public/ILSpage.html {Accessed on 10 April 2007}.
• 17: Gardner, H. (1993). Frames of Mind: The Theory of Multiple Intelligences (2nd Edition). London, Fontana.
• 18: Graff, M. (2003). Assessing learning from hypertext: an individual differences perspective. Journal of Interactive Learning Research 14 (4): 425--438.
• 19: Graff, M. (2003). Learning from web-based instructional systems and cognitive style. British Journal of Educational Technology 34 (4): 407--418.
• 20: Hargreaves, D. (1995). About Learning: Report of the Learning Working Group, DEMOS.
• 21: Litzinger, T. A., S. H. Lee, J. C. Wise and R. M. Felder (2005). A Study of the Reliability and Validity of the Felder-Soloman Index of Learning Styles. Proceedings of the 2005 American Society for Engineering Education Annual Conference & Exposition, American Society for Engineering Education.
• 22: Merten, D. M. (1998). Research Methods in Education and Psychology: Integrating Diversity with Quantitative and Qualitative Approaches Thousand Oaks, California, Sage.
• 23: Paivio, A. (1986). Mental Representations New York, Oxford University Press.
• 24: Pask, G. (1988). Learning strategies, teaching strategies, and conceptual or learning style in: R. R. Schmeck,(ed. Learning strategies and learning styles. New York, Plenum Press: 83--100.
• 25: Pillay, H. and L. Wilss (1996). Computer assisted instruction and individual cognitive style preferences in learning: does it matter? Australian Educational Computing 11 (2): 28--33.
• 26: Riding, R. J. and I. Cheema (1991). Cognitive Styles - An Overview And Integration. Educational Psychology 11 (3&4): 193--215.
• 27: Rittel, H. and M. Webber (1973). Dilemmas in a General Theory of Planning Amsterdam, Elsevier Scientific Publishing Company, Inc. {Reprinted in N. Cross (ed.) (1984), Developments in Design Methodology, J. Wiley & Sons, Chichester, pp. 135--144.}.
• 28: Robson, C. (2002). Real World Research: A Resource for Social Scientists and Practitioner-researchers Oxford, UK, Blackwell Publishing.
• 29: Triantafillou, E., A. Pomportsis and E. Georgiadou (2002). AES-CS: Adaptive Educational System based on Cognitive Styles. Proceedings of AH2002 Workshop, Second International Conference on Adaptive Hypermedia and Adaptive Web-based Systems., University of Malaga, Spain.
• 30: Mohamed Ramzy Zakaria , Tim Brailsford, Technical note: user modelling, and adaptive hypermedia frameworks for education, The New Review of Hypermedia and Multimedia, v.8 n.1, p.83-97, January 2003 [doi>10.1080/13614560208914737]
• 31: Mohamed Ramzy Zakaria , Adam Moore , Helen Ashman , Craig D. Stewart , Tim J. Brailsford, The Hybrid Model for Adaptive Educational Hypermedia, Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.580-585, May 29-31, 2002
• 32: Zywno, M. S. (2003). A contribution to validation of score meaning for Felder-Soloman's Index of Learning Styles. Proceedings of 2003 ASEE Annual Conference and Exposition, Nashville, Tennessee (June 23--25).

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Architectures; User issues

  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-managed instruction (CMI)

General Terms:
Design, Experimentation, Human Factors, Measurement, Theory

Keywords:
DEUS, adaptive educational hypermedia, learning styles, real users, user modelling, user trials