Assessment of code, which aspects do teachers consider and how are they valued?
- Author
- Tom Neutens (UGent) , Kris Coolsaet (UGent) and Francis wyffels (UGent)
- Organization
- Abstract
- In many countries, computer programming is becoming an integral part of the secondary school curriculum. However, many teachers, especially in the first years of Flemish secondary school, have limited experience with teaching programming. To improve their knowledge about programming, many different types of professional development programs have been proposed. Nevertheless, these programs mostly focus on technical skills and less on pedagogical skills. One aspect that is often overlooked in these programs is how teachers can assess code. To get insight into what teachers currently value when assessing code, we designed an experiment that analyzes the different aspects teachers consider during the assessment of code. During the experiment, the teachers (N=13) assess a set of programs from five different fictional learners. After the assessment, they participated in a structured interview giving us insight into the assessment process. We evaluated the transcripts of the interviews using deductive thematic analysis using a coding schema defining the different aspects of code that can be assessed. Additionally, we linked the assessment strategies of teachers to their teaching experience. Our results indicate that many teachers are unaware of the different concepts that can be part of the assessment of code which might lead to inaccurate or invalid feedback. Moreover, although our experimental group was too small to draw hard conclusions about the inter case results, our results indicate that the number of concepts considered by teachers seems to increase with experience. These results provide an initial insight into the code assessment practices of teachers and reveals interesting pathways for future research into the assessment of code.
- Keywords
- Education, General Computer Science, K12, programming, assessment, thematic analysis, teachers, COMPUTATIONAL THINKING, VALIDITY
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 1.03 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8748195
- MLA
- Neutens, Tom, et al. “Assessment of Code, Which Aspects Do Teachers Consider and How Are They Valued?” ACM TRANSACTIONS ON COMPUTING EDUCATION, vol. 22, no. 4, 2022, doi:10.1145/3517133.
- APA
- Neutens, T., Coolsaet, K., & wyffels, F. (2022). Assessment of code, which aspects do teachers consider and how are they valued? ACM TRANSACTIONS ON COMPUTING EDUCATION, 22(4). https://doi.org/10.1145/3517133
- Chicago author-date
- Neutens, Tom, Kris Coolsaet, and Francis wyffels. 2022. “Assessment of Code, Which Aspects Do Teachers Consider and How Are They Valued?” ACM TRANSACTIONS ON COMPUTING EDUCATION 22 (4). https://doi.org/10.1145/3517133.
- Chicago author-date (all authors)
- Neutens, Tom, Kris Coolsaet, and Francis wyffels. 2022. “Assessment of Code, Which Aspects Do Teachers Consider and How Are They Valued?” ACM TRANSACTIONS ON COMPUTING EDUCATION 22 (4). doi:10.1145/3517133.
- Vancouver
- 1.Neutens T, Coolsaet K, wyffels F. Assessment of code, which aspects do teachers consider and how are they valued? ACM TRANSACTIONS ON COMPUTING EDUCATION. 2022;22(4).
- IEEE
- [1]T. Neutens, K. Coolsaet, and F. wyffels, “Assessment of code, which aspects do teachers consider and how are they valued?,” ACM TRANSACTIONS ON COMPUTING EDUCATION, vol. 22, no. 4, 2022.
@article{8748195,
abstract = {{In many countries, computer programming is becoming an integral part of the secondary school curriculum. However, many teachers, especially in the first years of Flemish secondary school, have limited experience with teaching programming. To improve their knowledge about programming, many different types of professional development programs have been proposed. Nevertheless, these programs mostly focus on technical skills and less on pedagogical skills. One aspect that is often overlooked in these programs is how teachers can assess code. To get insight into what teachers currently value when assessing code, we designed an experiment that analyzes the different aspects teachers consider during the assessment of code. During the experiment, the teachers (N=13) assess a set of programs from five different fictional learners. After the assessment, they participated in a structured interview giving us insight into the assessment process. We evaluated the transcripts of the interviews using deductive thematic analysis using a coding schema defining the different aspects of code that can be assessed. Additionally, we linked the assessment strategies of teachers to their teaching experience. Our results indicate that many teachers are unaware of the different concepts that can be part of the assessment of code which might lead to inaccurate or invalid feedback. Moreover, although our experimental group was too small to draw hard conclusions about the inter case results, our results indicate that the number of concepts considered by teachers seems to increase with experience. These results provide an initial insight into the code assessment practices of teachers and reveals interesting pathways for future research into the assessment of code.}},
articleno = {{46}},
author = {{Neutens, Tom and Coolsaet, Kris and wyffels, Francis}},
issn = {{1946-6226}},
journal = {{ACM TRANSACTIONS ON COMPUTING EDUCATION}},
keywords = {{Education,General Computer Science,K12,programming,assessment,thematic analysis,teachers,COMPUTATIONAL THINKING,VALIDITY}},
language = {{eng}},
number = {{4}},
pages = {{27}},
title = {{Assessment of code, which aspects do teachers consider and how are they valued?}},
url = {{http://doi.org/10.1145/3517133}},
volume = {{22}},
year = {{2022}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: