Development and usability testing of online debate dashboard based on learning analytics approach

Abstract

Background/Objectives: The purpose of this study is to develop Debate Dashboard to promote learners’ online debate activities and provide suggestions that could be adopted to improve the online debate dashboard. Methods/Statistical analysis: Debate dashboard was developed by computer scientists, and usability test and user experience evaluation were conducted to identify and usability problems and determine the participants’ satisfaction with the dashboard. The usability questionnaires were 9 items and 35 students and 6 instructors were participated. User experience evaluation was performed to determine how users perceived when experiencing the dashboard, the questionnaires were 26 items and 34 students and 6 instructors were participated. Findings: Based on the characteristics of the learning analysis, the debate dashboard was developed by applying the visualization guidelines such as comparability, implicity, and overview-detail. The usability test and user experience evaluation were conducted for students and instructors. The results of the usability test showed that the average score of ease of learning and ease of use was high. As a result of user experience evaluation, perspicuity and efficiency were found to be the highest among students and instructors. These findings show that Debate Dashboard seemed useful to both learners and instructors in identifying debate status. This study sought to support learners debate activities by visualizing debate status on Debate Dashboard by applying comparability, which is a unique characteristic of learning analysis, rather than programming or visualization techniques. The results of this study will help to develop a dashboard to support various learning situations in the future.Improvements/Applications: It is necessary to investigate the effect of Debate Dashboard on learner participation in debate activities and provide intervention by analyzing quality of the debate contents.