Test Score Gap Robustness to Scaling
Social scientists frequently rely on the cardinal comparability of test scores to assess achievement gaps between population subgroups and their evolution over time. This approach has been criticized due to the ordinal nature of test scores and the sensibility of results to order-preserving transformations, which are theoretically plausible. Bond and Lang (2013) document the sensitivity of measured ability to scaling choices and develop a method to assess the robustness of changes in ability over time to scaling choices. This paper presents the scale transformation command, which expands the Bond and Lang method to more general cases and optimizes their algorithm to work with large data sets. The program assesses the robustness of an achievement gap between two subgroups to any arbitrary choice of scale by finding bounds for the original gap estimation. Additionally, the program finds scale transformations that are very likely and unlikely to benchmark against the results obtained. Finally, the program also allows the user to measure how much gap growth coefficients change when including controls in their specifications.
| Main Author: | |
|---|---|
| Format: | Working Paper biblioteca |
| Language: | English |
| Published: |
World Bank, Washington, DC
2019-08
|
| Subjects: | TEST SCORES, STUDENT ACHIEVEMENT, PSYCHOMETRICS, STATA, SCALE TRANSFORMATION, ACHIEVEMENT GAPS, EDUCATION, MEASUREMENT, ABILITY, |
| Online Access: | http://documents.worldbank.org/curated/en/942501566218257874/Test-Score-Gap-Robustness-to-Scaling-The-Scale-Transformation-Command https://hdl.handle.net/10986/32311 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
dig-okr-1098632311 |
|---|---|
| record_format |
koha |
| spelling |
dig-okr-10986323112024-08-30T07:07:20Z Test Score Gap Robustness to Scaling The Scale Transformation Command Chang, Andres Yi TEST SCORES STUDENT ACHIEVEMENT PSYCHOMETRICS STATA SCALE TRANSFORMATION ACHIEVEMENT GAPS EDUCATION MEASUREMENT ABILITY Social scientists frequently rely on the cardinal comparability of test scores to assess achievement gaps between population subgroups and their evolution over time. This approach has been criticized due to the ordinal nature of test scores and the sensibility of results to order-preserving transformations, which are theoretically plausible. Bond and Lang (2013) document the sensitivity of measured ability to scaling choices and develop a method to assess the robustness of changes in ability over time to scaling choices. This paper presents the scale transformation command, which expands the Bond and Lang method to more general cases and optimizes their algorithm to work with large data sets. The program assesses the robustness of an achievement gap between two subgroups to any arbitrary choice of scale by finding bounds for the original gap estimation. Additionally, the program finds scale transformations that are very likely and unlikely to benchmark against the results obtained. Finally, the program also allows the user to measure how much gap growth coefficients change when including controls in their specifications. 2019-08-22T15:55:45Z 2019-08-22T15:55:45Z 2019-08 Working Paper Document de travail Documento de trabajo http://documents.worldbank.org/curated/en/942501566218257874/Test-Score-Gap-Robustness-to-Scaling-The-Scale-Transformation-Command https://hdl.handle.net/10986/32311 English Policy Research Working Paper;No. 8986 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo World Bank application/pdf World Bank, Washington, DC |
| institution |
Banco Mundial |
| collection |
DSpace |
| country |
Estados Unidos |
| countrycode |
US |
| component |
Bibliográfico |
| access |
En linea |
| databasecode |
dig-okr |
| tag |
biblioteca |
| region |
America del Norte |
| libraryname |
Biblioteca del Banco Mundial |
| language |
English |
| topic |
TEST SCORES STUDENT ACHIEVEMENT PSYCHOMETRICS STATA SCALE TRANSFORMATION ACHIEVEMENT GAPS EDUCATION MEASUREMENT ABILITY TEST SCORES STUDENT ACHIEVEMENT PSYCHOMETRICS STATA SCALE TRANSFORMATION ACHIEVEMENT GAPS EDUCATION MEASUREMENT ABILITY |
| spellingShingle |
TEST SCORES STUDENT ACHIEVEMENT PSYCHOMETRICS STATA SCALE TRANSFORMATION ACHIEVEMENT GAPS EDUCATION MEASUREMENT ABILITY TEST SCORES STUDENT ACHIEVEMENT PSYCHOMETRICS STATA SCALE TRANSFORMATION ACHIEVEMENT GAPS EDUCATION MEASUREMENT ABILITY Chang, Andres Yi Test Score Gap Robustness to Scaling |
| description |
Social scientists frequently rely on the
cardinal comparability of test scores to assess achievement
gaps between population subgroups and their evolution over
time. This approach has been criticized due to the ordinal
nature of test scores and the sensibility of results to
order-preserving transformations, which are theoretically
plausible. Bond and Lang (2013) document the sensitivity of
measured ability to scaling choices and develop a method to
assess the robustness of changes in ability over time to
scaling choices. This paper presents the scale
transformation command, which expands the Bond and Lang
method to more general cases and optimizes their algorithm
to work with large data sets. The program assesses the
robustness of an achievement gap between two subgroups to
any arbitrary choice of scale by finding bounds for the
original gap estimation. Additionally, the program finds
scale transformations that are very likely and unlikely to
benchmark against the results obtained. Finally, the program
also allows the user to measure how much gap growth
coefficients change when including controls in their specifications. |
| format |
Working Paper |
| topic_facet |
TEST SCORES STUDENT ACHIEVEMENT PSYCHOMETRICS STATA SCALE TRANSFORMATION ACHIEVEMENT GAPS EDUCATION MEASUREMENT ABILITY |
| author |
Chang, Andres Yi |
| author_facet |
Chang, Andres Yi |
| author_sort |
Chang, Andres Yi |
| title |
Test Score Gap Robustness to Scaling |
| title_short |
Test Score Gap Robustness to Scaling |
| title_full |
Test Score Gap Robustness to Scaling |
| title_fullStr |
Test Score Gap Robustness to Scaling |
| title_full_unstemmed |
Test Score Gap Robustness to Scaling |
| title_sort |
test score gap robustness to scaling |
| publisher |
World Bank, Washington, DC |
| publishDate |
2019-08 |
| url |
http://documents.worldbank.org/curated/en/942501566218257874/Test-Score-Gap-Robustness-to-Scaling-The-Scale-Transformation-Command https://hdl.handle.net/10986/32311 |
| work_keys_str_mv |
AT changandresyi testscoregaprobustnesstoscaling AT changandresyi thescaletransformationcommand |
| _version_ |
1809105298357485568 |