A104: Psychometrics in Educational Assessment

A104: Psychometrics in Educational Assessment A104_course_banner
Date: 24 Feb 2025 - 27 Apr 2025 Venue: Online
Type: Scheduled (9 weeks) Fee: From £310.50 to £345

Course options: Monitored - £345 (Members - £310.50)

Please note that from 8 February 2025 the price of the monitored course option will increase to £395 (Members - £355.50)

Register for Feb 2025 course

Bookings for Feb course close 21 Feb 2025 at 12pm (UK time)

A104: Psychometrics in Educational Assessment is a CPD accredited online course that will provide you with the tools and understanding to analyse assessment data and ensure your tests are reliable, valid and fair.

Upcoming courses

Feb 2025: 24 Feb-27 Apr 2025 Book: Register for Feb 2025 course
Sep 2025: 1 Sep-2 Nov 2025 Book: Register for Sep 2025 course

All courses are accredited for continuing professional development (27-30 hours of CPD), with certification and digital badges available on successful completion.

Over nine weeks, you’ll:

  • Learn how to interpret typical analyses and undertake such analyses yourself using realistic assessment data.
  • Understand the fundamental concepts in psychometrics, as applied to educational assessment.
  • Evaluate assessment quality using classical item-level statistics.
  • Understand the features of classical statistics and their limitations.
  • Understand item response theory and how it differs from classical test theory.
  • Define equating and understand how items are calibrated in the applied context of item banking.
Tom Benton 
A104 explains how we use quantitative methods from psychometrics to improve the quality of educational assessments. Starting from simple statistical concepts, this course provides enough detail so that participants can apply the techniques themselves.
Tom Benton, Principal Research Officer, Cambridge University Press & Assessment

Course information

  • Participants should be numerate and comfortable interpreting basic statistics such as means, standard deviations and correlations. Participants should also be comfortable using Excel and familiar with the following topics: Validity, Reliability, Fairness, Standards and Comparability (covered in A101: Introducing the Principles of Assessment)
  • Average 3 hours per week over nine weeks
  • Online group course delivered over 9 weeks featuring Monitor/Educator, discussion forum and journal
  • Certification option available

Learning outcomes

  • Understand the fundamental concepts in psychometrics, as applied to educational assessment.
  • Evaluate assessment quality using classical item-level statistics.
  • Understand the features of classical statistics and their limitations.
  • Understand item response theory and how it differs from classical test theory.
  • Define equating and understand how items are calibrated in the applied context of item banking.

Course outline

After providing a broad overview of the kinds of tasks where techniques from psychometrics are used in assessments, the course will cover:

Reliability of marking
Looking at reliability purely from the point of view of reproducibility of marking.
Classical item level data (ILD) 
We'll introduce key terms like facility, discrimination, item characteristic curves and understand how to interpret statistics such as R_rest for judging item quality.
From item level data to test reliability
Defining test reliability and understanding how item level data can tell us about the reliability of a test. 
Item response theory (IRT) in test and item evaluation
We’ll show how the item response theory can build upon the concepts and statistics introduced in earlier weeks. 
Equating
Understanding the different definitions of equating and some simple equating techniques.
Item calibration and item banking
We'll learn how anchor items can be used alongside item response theory to calibrate individual items and how this can help us to predict item behaviour in new contexts.
Methods of test construction
We'll look at how we might use psychometrics to construct tests with: optimal reliability, targeted reliability at a particular point in the ability range, and grade boundaries in pre-determined places.

Who should attend?

The course is open to everyone working in the field of educational assessment who wants to learn how to analyse assessment data in order to ensure tests are reliable, valid and fair.

Participants should have some existing familiarity with the topics of validity, reliability, fairness, standards and comparability. Participants should also be comfortable interpreting basic statistics such as means, standard deviations and correlations. (If you are not yet comfortable with these topics, A101: Introducing the Principles of Assessment and/or A103: Introducing Data Literacy may be of interest).

Because the course is online, and learning is done in your own time, it can be completed from anywhere in the world. 

What you will learn

You will learn more about how to analyse assessment data in order to ensure tests are reliable, valid and fair. All participants will learn how to interpret typical analyses. Optional extension activities will give participants the chance to undertake such analyses for themselves using realistic assessment data.

The course covers a wide range of topics related to psychometrics including: introducing psychometrics, reliability of marking, classical item level data, item response theory, and item calibration and item banking. 

How you will learn

A104 is an interactive online course, which means that alongside weekly activities and video content, you'll learn through forum discussions with fellow participants.

How much does it cost?

Online group course delivered over 9 weeks featuring Monitor/Educator, discussion forum and journal - £345 per person (Members fee: £310.50).

How to enrol

Bookings are taken on a first-come, first-served basis. We will confirm your place on the course once the payment has been received. Payment can be made by a credit or debit card (not incl. American Express) or by invoice. Please use the booking link above.

FAQs

Is attendance on the course required 9-5pm for the full 9 weeks? Or can the course content be accessed in your own time?

This online course continues for 9 weeks, but there is no set times that you need to access the course. The weekly tasks can be completed whenever fits in with your existing schedule. We anticipate that you would need to allocate an average of 3 hours per week for study time.

What level of English do I need to be able to complete the course?

The course is delivered in English so participants are required to have sufficient competence in English to participate in the training. All participants should have English language competence comparable to Level B2 in the Common European Framework of Reference for Languages (CEFR). We recommend a minimum requirement of 5.5 on the International English Language Testing System. Further information may be obtained through the IELTS website.

INDEPENDENT USER
B2 Vantage or upper intermediate

  • Can understand the main ideas of complex text on both concrete and abstract topics, including technical discussions in his/her field of specialisation.
  • Can interact with a degree of fluency and spontaneity that makes regular interaction with native speakers quite possible without strain for either party.
  • Can produce clear, detailed text on a wide range of subjects and explain a viewpoint on a topical issue giving the advantages and disadvantages of various options.

My place on the course is now confirmed, what happens next?

You will receive an email with joining instructions on the Friday afternoon before the course starts.

Please get in touch if you don't receive the email by the Saturday before the course starts and make sure to check any junk or spam folders first.

The A104 material is available from 5pm (UK time) on Fridays, but the week officially begins on Monday at 12:00 noon (UK time).

What kind of certification is available upon completion of the course?

Statement of Participation (Certificate and digital badge)

  • You must provide evidence of your learning and participation by logging into each of the week’s lessons, completing the activities, marking the activities as completed and posting weekly on the discussion forum.

Certificate of Achievement (Certificate and digital badge)

  • In addition to the above, successful completion of an optional end of course assignment will enable you to claim a Certificate of Achievement.

This course is CPD accredited and earns 27 hours of CPD when the completion criteria are fulfilled. An extra 3 hours of CPD is awarded with an assignment pass.

Both our Statement of Participation and Certificate of Achievement are awarded by Cambridge and include the CPD accreditation logo.

Can I have some more details on the end of course assignment?

The purpose of the assignment is to provide you with an opportunity to reflect on the topics covered in the course and to apply your learning in practice to a trial of two assessments. The assignment will allow you to demonstrate that you have understood the course material so that you can interpret the kinds of analyses that have been described in practice. 

Remember, the assignment is optional. However, if you want to claim a Certificate of Achievement, successfully completing the assignment is a requirement. If you choose to complete the assignment, you have three weeks to submit after the course has finished.

I would recommend this course to my colleagues because it gives a very solid overview of the important statistical and psychometric concepts a practitioner needs to consider when designing tests.

It is designed to allow you to blend theory with practice in a balanced and well paced way. All the examples were relevant and based on real data."

Verónica Floretta 
Assessment Consultant 
Uruguay

CPD dual logo

The Assessment Network has been recognised as a provider of Training Excellence by the Professional Development Consortium and is a trusted source of CPD accredited learning activities.


Find out more

woman looking at mobile phone

Sign up for our mailing lists

Receive regular email updates about upcoming training, special offers, events and educational news.


Keep in touch