To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations

This study sought to ascertain the extent to which the use of statistical scaling procedures to establish comparable Grade III/IV cut scores for different examinations of the same subject resulted in cut scores that were comparable to those obtained when judgmental procedures are used. The study used data from three subjects of the Caribbean Examinations Council (CXC) where the same Grade III/IV cut scores were retained over a five-year period. Through linear transformation, the Grade III/IV cut scores for each subject were converted to scale scores on a base form. The extent to which scaling procedures validated CXC’s maintenance of the same Grade III/IV cut scores across years was considered. For all but one of the 11 cut scores considered in this study, the calculated scale scores were dissimilar from those retained by CXC. The calculated scale scores, therefore, could not be regarded as comparable to the cut scores established by CXC through the use of its judgmental procedures. However, it was found that the direction of change in the proportion candidates obtaining Grades I to III with the CXC judgmental procedures was consistent with the outcome of scaling.

Saved in:
Bibliographic Details
Main Author: Griffith, Stafford Alexander
Format: Article biblioteca
Published: School of Education, UWI 2018
Subjects:Academic Achievement, CXC, Grade Comparability, Standards,
Online Access:http://hdl.handle.net/2139/49432
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:oai:uwispace.sta.uwi.edu:2139:2139-49432
record_format koha
spelling oai:oai:uwispace.sta.uwi.edu:2139:2139-494322021-01-15T04:43:00Z To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations Griffith, Stafford Alexander Academic Achievement, CXC, Grade Comparability, Standards This study sought to ascertain the extent to which the use of statistical scaling procedures to establish comparable Grade III/IV cut scores for different examinations of the same subject resulted in cut scores that were comparable to those obtained when judgmental procedures are used. The study used data from three subjects of the Caribbean Examinations Council (CXC) where the same Grade III/IV cut scores were retained over a five-year period. Through linear transformation, the Grade III/IV cut scores for each subject were converted to scale scores on a base form. The extent to which scaling procedures validated CXC’s maintenance of the same Grade III/IV cut scores across years was considered. For all but one of the 11 cut scores considered in this study, the calculated scale scores were dissimilar from those retained by CXC. The calculated scale scores, therefore, could not be regarded as comparable to the cut scores established by CXC through the use of its judgmental procedures. However, it was found that the direction of change in the proportion candidates obtaining Grades I to III with the CXC judgmental procedures was consistent with the outcome of scaling. 2021-01-14T14:31:45Z 2021-01-14T14:31:45Z 2018 Article Caribbean Curriculum Vol 26 2018/2019 http://hdl.handle.net/2139/49432 application/pdf School of Education, UWI
institution UWI TT
collection DSpace
country Trinidad y Tobago
countrycode TT
component Bibliográfico
access En linea
databasecode dig-uwi-tt
tag biblioteca
region Caribe
libraryname UWI library system TT
topic Academic Achievement, CXC, Grade Comparability, Standards
Academic Achievement, CXC, Grade Comparability, Standards
spellingShingle Academic Achievement, CXC, Grade Comparability, Standards
Academic Achievement, CXC, Grade Comparability, Standards
Griffith, Stafford Alexander
To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
description This study sought to ascertain the extent to which the use of statistical scaling procedures to establish comparable Grade III/IV cut scores for different examinations of the same subject resulted in cut scores that were comparable to those obtained when judgmental procedures are used. The study used data from three subjects of the Caribbean Examinations Council (CXC) where the same Grade III/IV cut scores were retained over a five-year period. Through linear transformation, the Grade III/IV cut scores for each subject were converted to scale scores on a base form. The extent to which scaling procedures validated CXC’s maintenance of the same Grade III/IV cut scores across years was considered. For all but one of the 11 cut scores considered in this study, the calculated scale scores were dissimilar from those retained by CXC. The calculated scale scores, therefore, could not be regarded as comparable to the cut scores established by CXC through the use of its judgmental procedures. However, it was found that the direction of change in the proportion candidates obtaining Grades I to III with the CXC judgmental procedures was consistent with the outcome of scaling.
format Article
topic_facet Academic Achievement, CXC, Grade Comparability, Standards
author Griffith, Stafford Alexander
author_facet Griffith, Stafford Alexander
author_sort Griffith, Stafford Alexander
title To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
title_short To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
title_full To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
title_fullStr To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
title_full_unstemmed To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
title_sort to scale or not to scale: insights from a study of grade comparability in cxc examinations
publisher School of Education, UWI
publishDate 2018
url http://hdl.handle.net/2139/49432
work_keys_str_mv AT griffithstaffordalexander toscaleornottoscaleinsightsfromastudyofgradecomparabilityincxcexaminations
_version_ 1756094419905282048