1 June 2016: Adaptive Comparative Judgement for online grading of project-based assessment

Presenter: Professor Richard Kimbell (Goldsmiths College, University of London).

Hosted by Professor Geoffrey Crisp, PVC Education, University of New South Wales and Dr Mathew Hillier, Monash University, Australia. Starting 07:00AM UTC/GMT. Duration 60 Minutes.

Adaptive Comparative Judgement (ACJ) offers an alternative to marking, especially for performance assessments for which achievement can be difficult to describe in mark schemes. The ACJ system uses a web-browser to deliver pairs of candidates’ work to judges. The judges apply their subject expertise to select which of the two sets of work is better in terms of meeting appropriate educational objectives. A quality parameter is estimated for each piece of candidates’ work using the Rasch logistic model to analyse the judges’ decisions. Placing the pieces of work on a measurement scale gives them a rank order.

This webinar looked at how ACJ delivered through online technologies can be a valid and highly reliable alternative to traditional analytical marking. This alternative has been underused in educational assessment and measurement in the past, mainly due to the lack of supporting technologies to facilitate large-scale testing for large number of judgements and judges.  

In this webinar Richard presented and engaged with ACJ, explored the problems it solves for both summative and formative assessment and highlighted the benefits it offers for peer to peer review with a focus on raising awareness and transforming assessment.

Further information

Session Recording

Multiple formats are available.

play via you tube

You Tube version (Flash video) - recommended version.

A screen cast of the session.

Start playing via You Tube (note: this is a single file): https://youtu.be/ftsDbDPqb2w (You can choose to view in standard definition or high definition and in full screen mode).

Blackboard Collaborate archive version

This uses the classroom system itself to re-play a recording of the event. You are also able to jump forward, back and pause the recording.

Note: links shown inside this recording are only 'clickable' when displayed in the lower left 'text chat' area.

If you are having trouble accessing the classroom system please read the help page.