Enhancing user experience in online learning environments: Design, evaluation, and usability techniques
Published 2024-12-01
abstract views: 80 // Full text article (PDF): 31
Keywords
- Usability evaluation,
- online learning platforms,
- design principles,
- user experience,
- heuristic evaluation
- cognitive walkthroughs,
- graphical user interface (GUI),
- learning efficacy,
- user satisfaction,
- task success rate ...More
How to Cite
Copyright (c) 2024 © 2024 Authors. Published by the University of Novi Sad, Faculty of Technical Sciences, Department of Graphic Engineering and Design. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license 3.0 Serbia (http://creativecommons.org/licenses/by/3.0/rs/).
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
Abstract
This study aims to enhance user experience on online learning platforms by investigating design principles, usability evaluation techniques, and redesign processes. A total of 150 participants, divided equally among students, educators, and professionals, were stratified by age, gender, education level, and familiarity with online learning. Various evaluation methods, including heuristic evaluation, guideline reviews, and cognitive walkthroughs, were employed. Metrics such as task success rate, time-on-task, and Net Promoter Score (NPS) were used to quantify user satisfaction and effectiveness. Additionally, five qualitative interviews were conducted for deeper insights. The results revealed specific usability issues and demonstrated the effectiveness of the applied evaluation techniques. Post-redesign metrics indicated significant improvements in user satisfaction and engagement. The study underscores the importance of a multi-faceted approach to design and evaluation in online learning platforms and suggests avenues for future research.
Article history: Received (April 14, 2023); Revised (October 23, 2023); Accepted (February 19, 2024)
Dimensions Citation Metrics
References
- Alojaiman, B. (2021) Toward Selection of Trustworthy and Efficient E-Learning Platform. IEEE Access. 9, 133889-133901. Available from:
- doi: 10.1109/ACCESS.2021.3114150
- Bargas-Avila, J. A. & Hornbæk, K. (2011) Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In: Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI'11, 7-12 May 2011, Vancouver, Canada. New York, Association for Computing Machinery. pp. 2689 – 2698. Available from: doi: 10.1145/1978942.1979336
- Bilgin, A., Hagras, H., Van Helvert, J. & Alghazzawi, D. (2015) A linear general type-2 fuzzy-logic-based computing with words approach for realizing an ambient intelligent platform for cooking recipe recommendation. IEEE Transactions on Fuzzy Systems. 24 (2), 306-329. Available from: doi: https://doi.org/10.1109/TFUZZ.2015.2453400
- Boyd, H. (1998) In Memoriam Dr. John Henrik Clarke (1915-1998). The Black Scholar. 28 (3/4), 50-52.
- Demmans Epp, C., Phirangee, K., Hewitt, J. & Perfetti, C. A. (2020) Learning management system and course influences on student actions and learning experiences. Educational Technology Research and Development. 68, 3263-3297. Available from: doi: 10.1007/s11423-020-09821-1
- Diaz-Infante, N., Lazar, M., Ram, S. & Ray, A. (2022) Demand for online education is growing. are providers ready?. McKinsey & Company. Available from: https://www.mckinsey.com/industries/education/our-insights/demand-for-online-education-is-growing-are-providers-ready [Accessed 12th June 2023]
- Ennouamani, S., Mahani, Z. & Akharraz, L. (2020) A context-aware mobile learning system for adapting learning content and format of presentation: design, validation and evaluation. Education and Information Technologies. 25, 3919-3955. Available from: doi: 10.1007/s10639-020-10149-9
- Galić, S., Lušić, Z. & Stanivuk, T. (2020) E-learning in maritime affairs. Journal of Naval Architecture & Marine Engineering. 17 (1). Available
- from: doi: 10.3329/jname.v17i1.42203
- Ivory, M. Y. (2000) Web TANGO: towards automated comparison of information-centric web site designs. In: CHI '00 Extended Abstracts on Human Factors in Computing Systems, CHI EA '00, 1-6 April 2000, Hague, Netherlands. New York, Association for Computing Machinery. pp. 239-330. Available from: doi: 10.1145/633292.633491
- Kouroupetroglou, G. & Spiliotopoulos, D. (2009) Usability methodologies for real-life voice user interfaces. International Journal of Information Technology and Web Engineering (IJITWE). 4 (4), 78-94. Available from: doi: 10.4018/jitwe.2009100105
- Lidwell, W., Holden, K. & Butler, J. (2010) Universal principles of design, revised and updated: 125 ways to enhance usability, influence perception, increase appeal, make better design decisions, and teach through design. Gloucester, Rockport Publishers.
- Lu, J., Schmidt, M., Lee, M. & Huang, R. (2022) Usability research in educational technology: A state-ofthe- art systematic review. Educational Technology Research and Development. 70 (6), 1951-1992. Available from: doi: 10.1007/s11423-022-10152-6
- Maslov, I., Nikou, S. & Hansen, P. (2021) Exploring user experience of learning management system. The International Journal of Information and Learning Technology. 38 (4), 344-363. Available from: doi: 10.1108/IJILT-03-2021-0046
- McLeod, J. M., Scheufele, D. A. & Moy, P. (1999) Community, communication, and participation: The role of mass media and interpersonal discussion in local political participation. Political communication. 16 (3), 315- 336. Available from: doi: 10.1080/105846099198659
- Misra, P. (2018) MOOCs for teacher professional development: Reflections and suggested actions. Open Praxis. 10 (1), 67-77. Available from: 10.5944/openpraxis.10.1.780
- Mshigeni, S., Arroyo-Romano, J. & Becerra, M. (2022) “We don’t all have the privilege of having our own quiet place”: College Students in a Hispanic Serving Institution during the COVID-19 Pandemic. Journal of Latinos and Education. 21 (3), 251-265. Available from: doi: 10.1080/15348431.2022.2056463.
- Nielsen, J. (1994) Heuristic evaluation. In: Nielsen J., Mack R. L. (eds.) Usability inspection methods. New York, John Wiley & Sons, pp. 25-62.
- Nielsen, J. & Molich, R. (1990) Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '90, 1-5 April 1990, Seattle, Washington. New York, Association for Computing Machinery. Available from: doi: 10.1145/97243.97281
- Norman, D. A. (1988) The psychology of everyday things. New York, Basic books.
- Rundo, L., Pirrone, R., Vitabile, S., Sala, E. & Gambino, O. (2020) Recent advances of HCI in decision-making tasks for optimized clinical workflows and precision medicine. Journal of biomedical informatics. 108, 103479. Available from: doi:10.1016/j.jbi.2020.103479
- Sani, A., Wiliani, N. & Husain, T. (2019) Spreadsheet Usability Testing in Nielsen’s Model among Users of ITSMEs to Improve Company Performance. European Journal of Scientific Exploration. 2 (6), 1-9.
- Sarrab, M., Elbasir, M. & Alnaeli, S. (2016) Towards a quality model of technical aspects for mobile learning services: An empirical investigation. Computers in Human Behavior. 55, 100-112. Available from: doi: 10.1016/j.chb.2015.09.003
- Speicher, M. (2021) Conversion rate & average order value are not UX metrics UX is an elusive thing. Medium. Available from: https://uxdesign.cc/conversion-rate-average-order-value-are-not-ux-metrics-
- d6e7e40e286 [Accessed 12th June 2023]
- Wharton, C. & Lewis, C. (1994) The role of psychological theory in usability inspection methods. In: Nielsen, J. & Mack, R. (eds.) Usability inspection methods. New York, John Wiley & Sons, pp. 341-350.