Can standards-referenced, large-scale assessment data lead to improvement in the education system?
This paper documents the development of performance standards for the Trinidad and Tobago primary school national assessments of educational achievement. Performance standards are written expectations of student achievement operationalized in defensible cutscores. A major argument in this paper is that these standards are necessary to evaluate quality in the education system because they directly address the question of "how good is good enough?" Standards-referenced measurement systems are the basis of both compensatory and accountability systems. Standard-setting procedures in the 2005 and 2006 national assessments of educational achievement are described, followed by an evaluation of procedural validity using quantitative and qualitative data gathered from panellists. The findings indicated that while panellists appear confident about procedures and outcomes, cognitive complexity and organizational inefficiency could prove to be critical constraints. While the introduction of student performance standards appears useful; by itself, it cannot lead to significant education improvement unless there is also a coherent policy for effective data use within a national evaluation system. In developing such a policy, consideration must be given to choosing between (a) low versus high examination stakes, (b) compensatory versus accountability policies, and (c) school-based versus centralized management of test processes. At the very least, stakeholders must understand the purpose of national assessments of educational achievement
Main Author: | |
---|---|
Format: | Article biblioteca |
Language: | English |
Published: |
School of Education, UWI, St. Augustine
2008
|
Subjects: | Primary school students, Performance criteria, Performance standards, Student evaluation, Assessment data, Data analysis, Trinidad and Tobago, |
Online Access: | http://hdl.handle.net/2139/6588 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
oai:oai:uwispace.sta.uwi.edu:2139:2139-6588 |
---|---|
record_format |
koha |
spelling |
oai:oai:uwispace.sta.uwi.edu:2139:2139-65882011-03-03T21:38:29Z Can standards-referenced, large-scale assessment data lead to improvement in the education system? De Lisle, Jerome Primary school students Performance criteria Performance standards Student evaluation Assessment data Data analysis Trinidad and Tobago This paper documents the development of performance standards for the Trinidad and Tobago primary school national assessments of educational achievement. Performance standards are written expectations of student achievement operationalized in defensible cutscores. A major argument in this paper is that these standards are necessary to evaluate quality in the education system because they directly address the question of "how good is good enough?" Standards-referenced measurement systems are the basis of both compensatory and accountability systems. Standard-setting procedures in the 2005 and 2006 national assessments of educational achievement are described, followed by an evaluation of procedural validity using quantitative and qualitative data gathered from panellists. The findings indicated that while panellists appear confident about procedures and outcomes, cognitive complexity and organizational inefficiency could prove to be critical constraints. While the introduction of student performance standards appears useful; by itself, it cannot lead to significant education improvement unless there is also a coherent policy for effective data use within a national evaluation system. In developing such a policy, consideration must be given to choosing between (a) low versus high examination stakes, (b) compensatory versus accountability policies, and (c) school-based versus centralized management of test processes. At the very least, stakeholders must understand the purpose of national assessments of educational achievement 2010-04-14T19:56:40Z 2010-04-14T19:56:40Z 2008 Article De Lisle, J. (2008). Can standards-referenced, large-scale assessment data lead to improvement in the education system?. Caribbean Curriculum, 15, 71-114 1017-5636 http://hdl.handle.net/2139/6588 en application/pdf School of Education, UWI, St. Augustine |
institution |
UWI TT |
collection |
DSpace |
country |
Trinidad y Tobago |
countrycode |
TT |
component |
Bibliográfico |
access |
En linea |
databasecode |
dig-uwi-tt |
tag |
biblioteca |
region |
Caribe |
libraryname |
UWI library system TT |
language |
English |
topic |
Primary school students Performance criteria Performance standards Student evaluation Assessment data Data analysis Trinidad and Tobago Primary school students Performance criteria Performance standards Student evaluation Assessment data Data analysis Trinidad and Tobago |
spellingShingle |
Primary school students Performance criteria Performance standards Student evaluation Assessment data Data analysis Trinidad and Tobago Primary school students Performance criteria Performance standards Student evaluation Assessment data Data analysis Trinidad and Tobago De Lisle, Jerome Can standards-referenced, large-scale assessment data lead to improvement in the education system? |
description |
This paper documents the development of performance standards for the Trinidad and Tobago primary school national assessments of educational achievement. Performance standards are written expectations of student achievement operationalized in defensible cutscores. A major argument in this paper is that these standards are necessary to evaluate quality in the education system because they directly address the question of "how good is good enough?" Standards-referenced measurement systems are the basis of both compensatory and accountability systems. Standard-setting procedures in the 2005 and 2006 national assessments of educational achievement are described, followed by an evaluation of procedural validity using quantitative and qualitative data gathered from panellists. The findings indicated that while panellists appear confident about procedures and outcomes, cognitive complexity and organizational inefficiency could prove to be critical constraints. While the introduction of student performance standards appears useful; by itself, it cannot lead to significant education improvement unless there is also a coherent policy for effective data use within a national evaluation system. In developing such a policy, consideration must be given to choosing between (a) low versus high examination stakes, (b) compensatory versus accountability policies, and (c) school-based versus centralized management of test processes. At the very least, stakeholders must understand the purpose of national assessments of educational achievement |
format |
Article |
topic_facet |
Primary school students Performance criteria Performance standards Student evaluation Assessment data Data analysis Trinidad and Tobago |
author |
De Lisle, Jerome |
author_facet |
De Lisle, Jerome |
author_sort |
De Lisle, Jerome |
title |
Can standards-referenced, large-scale assessment data lead to improvement in the education system? |
title_short |
Can standards-referenced, large-scale assessment data lead to improvement in the education system? |
title_full |
Can standards-referenced, large-scale assessment data lead to improvement in the education system? |
title_fullStr |
Can standards-referenced, large-scale assessment data lead to improvement in the education system? |
title_full_unstemmed |
Can standards-referenced, large-scale assessment data lead to improvement in the education system? |
title_sort |
can standards-referenced, large-scale assessment data lead to improvement in the education system? |
publisher |
School of Education, UWI, St. Augustine |
publishDate |
2008 |
url |
http://hdl.handle.net/2139/6588 |
work_keys_str_mv |
AT delislejerome canstandardsreferencedlargescaleassessmentdataleadtoimprovementintheeducationsystem |
_version_ |
1756093166414462976 |