eLSE Methodology: a Systematic Approach to the e-Learning Systems Evaluation

Quality of e-learning systems is one of the important topics that the researchers are investigating in the last years. This paper refines the concept of quality of e-learning systems and proposes a new framework, called TICS (Technology, Interaction, Content, Services), which focuses on the most important aspects to be considered when designing or evaluating an e-learning system. Our proposal emphasizes user-system interaction as one of such important aspects. Guidelines that address the TICS aspects and an evaluation methodology, called eLSE (e-Learning Systematic Evaluation) have been derived. eLSE methodology combines a specific inspection technique with user-testing. This inspection, called AT inspection, uses evaluation patterns, called Abstract Tasks (ATs), that precisely describe the activities to be performed during inspection. The results of an empirical validation of the AT inspection technique, carried out to validate this technique, have shown an advantage of the AT inspection over the other two usability evaluation methods, demonstrating that Abstract Tasks are effective and efficient tools to drive evaluators and improve their performance.