by Lujak, Marin, Slavkovik, Marija, Lebis, Alexis, Vermeulen, Mathieu and Doniec, Arnaud
Abstract:
In this chapter, we analyze and mutually compare the most used objective tests in computer science courses in Learning Management Systems (e.g., Moodle) and MOOCs. We outline their advantages, technical limitations, and ethical challenges. We also consider test feedback mechanisms that facilitate continuous learning for students as well as the identification and recognition of possible evaluation mistakes of the system of AI-supported methods for automating objective tests in programming. These tests come with a range of technical challenges to promote students' empowerment and support their autonomy in the learning process. There are also ethical challenges that arise when a human evaluator is replaced by software. We discuss and analyze these tests and focus on identifying and mitigating the context-specific ethical challenges. A clearly defined form of evaluation also checks and promotes students' integrity and genuineness in summative evaluations. Contrarily, in formative evaluations, automated objective tests should help to motivate students to commit to the learning process. We emphasize the essential characteristics for these tests to correctly provide these two types of evaluations in courses.
Reference:
Objective Tests in Automated Grading of Computer Science Courses: An Overview (Lujak, Marin, Slavkovik, Marija, Lebis, Alexis, Vermeulen, Mathieu and Doniec, Arnaud), Chapter in (Ivanović, Mirjana, KlaĆĄnja-Milićević, Aleksandra, Jain, Lakhmi C., eds.), Springer International Publishing, 2022.
Bibtex Entry:
@inbook{Lujak2022,
abstract = {In this chapter, we analyze and mutually compare the most used objective tests in computer science courses in Learning Management Systems (e.g., Moodle) and MOOCs. We outline their advantages, technical limitations, and ethical challenges. We also consider test feedback mechanisms that facilitate continuous learning for students as well as the identification and recognition of possible evaluation mistakes of the system of AI-supported methods for automating objective tests in programming. These tests come with a range of technical challenges to promote students' empowerment and support their autonomy in the learning process. There are also ethical challenges that arise when a human evaluator is replaced by software. We discuss and analyze these tests and focus on identifying and mitigating the context-specific ethical challenges. A clearly defined form of evaluation also checks and promotes students' integrity and genuineness in summative evaluations. Contrarily, in formative evaluations, automated objective tests should help to motivate students to commit to the learning process. We emphasize the essential characteristics for these tests to correctly provide these two types of evaluations in courses.},
address = {Cham},
author = {Lujak, Marin and Slavkovik, Marija and Lebis, Alexis and Vermeulen, Mathieu and Doniec, Arnaud},
booktitle = {Handbook on Intelligent Techniques in the Educational Process: Vol 1 Recent Advances and Case Studies},
doi = {10.1007/978-3-031-04662-9_12},
editor = {Ivanovi{\'{c}}, Mirjana
and Kla{\v{s}}nja-Mili{\'{c}}evi{\'{c}}, Aleksandra
and Jain, Lakhmi C.},
isbn = {978-3-031-04662-9},
pages = {239--268},
publisher = {Springer International Publishing},
title = {Objective Tests in Automated Grading of Computer Science Courses: An Overview},
url = {https://doi.org/10.1007/978-3-031-04662-9_12},
year = {2022},
bdsk-url-1 = {https://doi.org/10.1007/978-3-031-04662-9_12}}