Arab Online Courses and the Disabled: An Automated and User-Testing Approach

(Jamilah Mohammed Alamri , Wejdan Abdulrahman Barashi , Rehab Alsulami , Lulwah AlHarigy , Bassmah Shuaib , Sulafa Hariri , Ahlam Alsomahi , Dania Alamoudi and Rozan Barri )

---

Abstract

There is a significant increase in the adoption of Learning Management Systems (LMSs) by higher education institutions worldwide and Saudi universities in particular. These pedagogical tools empower teaching and learning by providing access to online learning materials. However, all university students, including students with disabilities, encounter countless instances of inaccessibility that negatively impact their learning experience. In order to offer equal access to all students, it is of paramount importance to enhance the accessibility of LMSs and remove such barriers. The purpose of this case study is to evaluate an online course in the LMS Blackboard (Bb) using an automated and end-user evaluation approach. First, automated testing was carried out by Ally software. Second, end-user testing was conducted using a think-aloud protocol to understand the actual learning experiences. Data from the think-aloud protocol was examined to extract accessibility issues. The findings from the automated testing indicate that the online course is highly accessible in terms of the course materials. However, students were challenged by several accessibility obstacles that surfaced during the think-aloud Bb tasks. To the best of our knowledge, this is the first study that incorporates Bb Ally as an automated checker to test an online course for disabled Saudi students.


KEYWORDS
Think-aloud protocol, Ally software, Blackboard, Web content accessibility guidelines (WCAG 2.1), World Wide Web Consortium (W3C), Blind and visually impaired (BVI) students

PDF

References

Abou-Zahra, S. (2008). Web accessibility evaluation. In: S. Harper, Y. Yesilada (eds.) Web Accessibility: A Foundation for Research. London, the UK: Springer. 
Aldiab, A., Chowdhury, H., Kootsookos, A., Alam, F. and Allhibi, H. (2019). Utilization of learning management systems (LMSs) in higher education system: A case review for Saudi Arabia. Energy Procedia, 160(n/a), 731–7. 
Aljuhney, Y. and Murray, L. (2015). A comparison of the utilization of e-learning management systems in the Republic of Ireland and Kingdom of Saudi Arabia: A case study. International Journal on Recent and Innovation Trends in Computing and Communication, 4(2), 1–12.
Alkarani, A. and AlThobaity, A. (2020). Medical staff members’ experiences with Blackboard at Taif University, Saudi Arabia. Journal of Multidisciplinary Healthcare, 13(n/a), 1629–34. 
Almufarreh, A., Arshad, M. and Mohammed, S. (2021). An efficient utilization of Blackboard ally in higher education institution. Intelligent Automation & Soft Computing, 29(1), 73–87. 
Alnfiai, M. and Alhakami, W. (2021). The accessibility of Taif University Blackboard for visually impaired students. International Journal of Computer Science and Network Security, 21(6), 258–68. 
Alokluk, J. (2018). The effectiveness of Blackboard system, uses and limitations in information management. Intelligent Information Management, 10(6), 133–49. DOI:10.4236/iim.2018.106012. 
Alotaibi, S.J. (2015). Evaluating the Blackboard system based on web accessibility and usability guidelines. International Journal of Digital Society, 6(4), 1094–101.
Alturki, U., Aldraiweesh, A. and Kinshuk, Dr. (2016). Evaluating the usability and accessibility of LMS“Blackboard” at King Saud University. Contemporary Issues in Education Research, 9(1), 33–44. 
Arroway, P., Davenport, E., Xu, G. and Updegrove, D. (2010). Educause Core Data Service Fiscal Year 2009 Summary Report. Available at: https://library.educause.edu/resources/2009/10/educause-core-data-service-fiscal-year-2008-summary-report (accessed on 02/12/2020)
Babu, R. and Singh, R. (2013). Accessibility and usability of social media: Convergence between blind users and design standards. In: The 19th Americas Conference on Information Systems, Chicago, USA, 15-17/08/2013.
Babu, R., Singh, R. and Ganesh, J. (2010). Understanding blind users’ web accessibility and usability problems. AIS Transactions on Human Computer Interaction, 2(3), 78–91.
Bastedo, K. and Swenson, N. (2020). General accessibility guidelines for online course content creation. In: S.L. Gronseth and E.M. Dalton (eds.) Universal Access through Inclusive Instructional Design: International Perspectives on UDL. New York: Routledge.
Blackboard Ally (2018). Blackboard Ally help. Available at: https://help.Bb.com/Ally/Ally_for_LMS/Instructor (accessed on 02/12/2020)
Chen, J., Dobinson, T. and Kent, S. (2020). Students' perspectives on the impact of Blackboard collaborate on Open University Australia (OUA) online learning. Journal of Educators Online, 17(1), n/a.
Chen, S., Gao, F., Lau, K.O. and Wang, Y. (2012). Design an innovative pe learning package through Blackboard to enhance students self-learning and generic skills. The Global Journal of Health and Physical Education Pedagogy, 1(2), 143–58.
Clark, J. (2006). To Hell with WCAG 2. Available at: http://alistapart.com/articles/tohellwithwcag2. (accessed on 02/12/2020).
De Smet, C., Bourgonjon, J., De Wever, B., Schellens, T. and Valcke, M. (2012). Researching instructional use and the technology acceptation of learning management systems by secondary school teachers. Computers & Education, 58(2), 688–96.
El-Senousy, H. and Alquda, J. (2017). The effect of flipped classroom strategy using Blackboard mash-up tools in enhancing achievement and self–regulated learning skills of university students. World Journal on Educational Technology, 9(3), 144–57.
Ericsson, K.A. and Simon, H.A. (1993). Protocol Analysis: Verbal Reports as Data. Cambridge, Mass: MIT Press.
Goodhue, D.L. (1986). Is attitudes: Towards theoretical definition and measurement clarity. In: Proceedings of the Seventh International Conference on Information Systems, San Diego, 14-17/12/1986.
Moreno, L., Iglesias, A., Calvo, R., Delgado, S. and Zaragoza, L. (2012). Disability standards and guidelines for learning management systems: Evaluating accessibility. In: R. Babo and A. Azevedo (eds.) Higher Education Institutions and Learning Management Systems: Adoption and Standardization. Hershey, PA: Information Science Reference.
Pacheco, E., Yoong, P. and Lips, M. (2017). The role of icts in students with vision impairments’ transition to university. In: The International Conference on Information Resources Management, Santiago, Chile, 17-19/05/2017.
Pauls, J. (2015). The Blackboard Online Coursework and Learning Environment: Accessibility Reports from Two College Students and One Instructor. Available at: https://www.afb.org/aw/16/7/15442 (accessed on 27/04/2021)
Ristovska, A., Canevska, O., Tasevska, A., Bruziene, R., Orechova, M., Paiva dias, G., Brito, E. and Haubro, H. (2021). Accessible learning management systems: Students’ experiences and insights. Prizren Social Science Journal, 5(2), 1–13. DOI: 10.32936/pssj.v5i2.224. 
Sapp, W. (2009). Universal design: Online educational media for students with disabilities. Journal of Visual Impairment & Blindness, 103(8), 495–500. 
White, D. (2017). Blackboard Delivers Worldwide Growth. Available at: https://press.blackboard.com/2017-01-27-Blackboard-Delivers-Worldwide-Growth (accessed on 07/10/2021).
W3C Web Accessibility Initiative. (2018). Web Content Accessibility Guidelines (WCAG) Overview. Available at: www.w3.org/WAI/standards-guidelines/wcag/ (accessed on 27/04/2021).