To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
This study sought to ascertain the extent to which the use of statistical scaling procedures to establish comparable Grade III/IV cut scores for different examinations of the same subject resulted in cut scores that were comparable to those obtained when judgmental procedures are used. The study used data from three subjects of the Caribbean Examinations Council (CXC) where the same Grade III/IV cut scores were retained over a five-year period. Through linear transformation, the Grade III/IV cut scores for each subject were converted to scale scores on a base form. The extent to which scaling procedures validated CXC’s maintenance of the same Grade III/IV cut scores across years was considered. For all but one of the 11 cut scores considered in this study, the calculated scale scores were dissimilar from those retained by CXC. The calculated scale scores, therefore, could not be regarded as comparable to the cut scores established by CXC through the use of its judgmental procedures. However, it was found that the direction of change in the proportion candidates obtaining Grades I to III with the CXC judgmental procedures was consistent with the outcome of scaling.
Main Author: | |
---|---|
Format: | Article biblioteca |
Published: |
School of Education, UWI
2018
|
Subjects: | Academic Achievement, CXC, Grade Comparability, Standards, |
Online Access: | http://hdl.handle.net/2139/49432 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
oai:oai:uwispace.sta.uwi.edu:2139:2139-49432 |
---|---|
record_format |
koha |
spelling |
oai:oai:uwispace.sta.uwi.edu:2139:2139-494322021-01-15T04:43:00Z To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations Griffith, Stafford Alexander Academic Achievement, CXC, Grade Comparability, Standards This study sought to ascertain the extent to which the use of statistical scaling procedures to establish comparable Grade III/IV cut scores for different examinations of the same subject resulted in cut scores that were comparable to those obtained when judgmental procedures are used. The study used data from three subjects of the Caribbean Examinations Council (CXC) where the same Grade III/IV cut scores were retained over a five-year period. Through linear transformation, the Grade III/IV cut scores for each subject were converted to scale scores on a base form. The extent to which scaling procedures validated CXC’s maintenance of the same Grade III/IV cut scores across years was considered. For all but one of the 11 cut scores considered in this study, the calculated scale scores were dissimilar from those retained by CXC. The calculated scale scores, therefore, could not be regarded as comparable to the cut scores established by CXC through the use of its judgmental procedures. However, it was found that the direction of change in the proportion candidates obtaining Grades I to III with the CXC judgmental procedures was consistent with the outcome of scaling. 2021-01-14T14:31:45Z 2021-01-14T14:31:45Z 2018 Article Caribbean Curriculum Vol 26 2018/2019 http://hdl.handle.net/2139/49432 application/pdf School of Education, UWI |
institution |
UWI TT |
collection |
DSpace |
country |
Trinidad y Tobago |
countrycode |
TT |
component |
Bibliográfico |
access |
En linea |
databasecode |
dig-uwi-tt |
tag |
biblioteca |
region |
Caribe |
libraryname |
UWI library system TT |
topic |
Academic Achievement, CXC, Grade Comparability, Standards Academic Achievement, CXC, Grade Comparability, Standards |
spellingShingle |
Academic Achievement, CXC, Grade Comparability, Standards Academic Achievement, CXC, Grade Comparability, Standards Griffith, Stafford Alexander To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations |
description |
This study sought to ascertain the extent to which the use of statistical scaling procedures to establish comparable Grade III/IV cut scores for different examinations of the same subject resulted in cut scores that were comparable to those obtained when judgmental procedures are used. The study used data from three subjects of the Caribbean Examinations Council (CXC) where the same Grade III/IV cut scores were retained over a five-year period. Through linear transformation, the Grade III/IV cut scores for each subject were converted to scale scores on a base form. The extent to which scaling procedures validated CXC’s maintenance of the same Grade III/IV cut scores across years was considered. For all but one of the 11 cut scores considered in this study, the calculated scale scores were dissimilar from those retained by CXC. The calculated scale scores, therefore, could not be regarded as comparable to the cut scores established by CXC through the use of its judgmental procedures. However, it was found that the direction of change in the proportion candidates obtaining Grades I to III with the CXC judgmental procedures was consistent with the outcome of scaling. |
format |
Article |
topic_facet |
Academic Achievement, CXC, Grade Comparability, Standards |
author |
Griffith, Stafford Alexander |
author_facet |
Griffith, Stafford Alexander |
author_sort |
Griffith, Stafford Alexander |
title |
To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations |
title_short |
To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations |
title_full |
To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations |
title_fullStr |
To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations |
title_full_unstemmed |
To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations |
title_sort |
to scale or not to scale: insights from a study of grade comparability in cxc examinations |
publisher |
School of Education, UWI |
publishDate |
2018 |
url |
http://hdl.handle.net/2139/49432 |
work_keys_str_mv |
AT griffithstaffordalexander toscaleornottoscaleinsightsfromastudyofgradecomparabilityincxcexaminations |
_version_ |
1756094419905282048 |