Sylvia Vitello

Rushton, N., Vitello, S., Suto, I. (2021). What do we mean by question paper error? An analysis of criteria and working definitions. Research Matters: A Cambridge University Press & Assessment publication, 32, 67-81.

It is important to define what an error in a question paper is so that there is a common understanding and to avoid people’s own conceptions impacting upon the way in which they write or check question papers. We carried out an interview study to investigate our colleagues’ definitions of error. We found that there is no single accepted definition of a question paper error. There were three interacting aspects that participants considered when deciding whether a problem was an error: the manifestation of the error, the (potential) impact upon candidates, and the stage at which it was discovered.

Vidal Rodeiro, C.L. and Vitello, S. (2021). Progression to post-16 education in England: the role of vocational qualifications. Research Papers in Education (ahead of print). 

Suto, I., Greatorex, J., Vitello, S., and Child, S. (2020). A way of using taxonomies to demonstrate that applied qualifications and curricula cover multiple domains of knowledge. Research Matters: A Cambridge Assessment publication, 30, 26-34.

Educational taxonomies are classification schemes which provide the terminology that educationalists need to describe and work with different areas of knowledge. It is good practice to use taxonomies to formulate and review curricula, learning objectives, and associated assessments. Demonstrating sufficient coverage of each of an adequate range of knowledge domains is critical for authenticity, for assessment reliability, and for transparency surrounding what students are learning.

In this study we explored whether any educational taxonomies that were designed for general educational contexts (sometimes called ‘academic’ contexts) could be utilised in applied educational contexts (often called ‘vocationally-related’ in England) . To do this, we identified nine published taxonomies with sufficient potential, and selected and combined the most appropriate. This process led us to develop a new model of demand.  We then applied the selected taxonomies experimentally to existing curricula in a range of applied subjects which are taught at secondary and tertiary level in England. We also used the selected taxonomies to develop a tool for writing educational objectives. This article ends with suggestions for applying the selected taxonomies in other areas of assessment.

Vidal Rodeiro, C. L., & Vitello, S. (2020). Vocational Qualifications at Key Stage 4 and Key Stage 5: who takes them and how they fit into students' programmes of study. Cambridge Assessment Research Report. Cambridge, UK: Cambridge Assessment.

Bramley, T. and Vitello, S. (2019). The effect of adaptivity on the reliability coefficient in adaptive comparative judgement.  Assessment in Education: Principles, Policy and Practice, 26(1), 43-58.

Vitello, S. and Williamson, J. (2018). Cambridge Assessment Research Report. Cambridge, UK: Cambridge Assessment.