Can standards-referenced, large-scale assessment data lead to improvement in the education system?

This paper documents the development of performance standards for the Trinidad and Tobago primary school national assessments of educational achievement. Performance standards are written expectations of student achievement operationalized in defensible cutscores. A major argument in this paper is that these standards are necessary to evaluate quality in the education system because they directly address the question of "how good is good enough?" Standards-referenced measurement systems are the basis of both compensatory and accountability systems. Standard-setting procedures in the 2005 and 2006 national assessments of educational achievement are described, followed by an evaluation of procedural validity using quantitative and qualitative data gathered from panellists. The findings indicated that while panellists appear confident about procedures and outcomes, cognitive complexity and organizational inefficiency could prove to be critical constraints. While the introduction of student performance standards appears useful; by itself, it cannot lead to significant education improvement unless there is also a coherent policy for effective data use within a national evaluation system. In developing such a policy, consideration must be given to choosing between (a) low versus high examination stakes, (b) compensatory versus accountability policies, and (c) school-based versus centralized management of test processes. At the very least, stakeholders must understand the purpose of national assessments of educational achievement

Saved in:
Bibliographic Details
Main Author: De Lisle, Jerome
Format: Article biblioteca
Language:English
Published: School of Education, UWI, St. Augustine 2008
Subjects:Primary school students, Performance criteria, Performance standards, Student evaluation, Assessment data, Data analysis, Trinidad and Tobago,
Online Access:http://hdl.handle.net/2139/6588
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:oai:uwispace.sta.uwi.edu:2139:2139-6588
record_format koha
spelling oai:oai:uwispace.sta.uwi.edu:2139:2139-65882011-03-03T21:38:29Z Can standards-referenced, large-scale assessment data lead to improvement in the education system? De Lisle, Jerome Primary school students Performance criteria Performance standards Student evaluation Assessment data Data analysis Trinidad and Tobago This paper documents the development of performance standards for the Trinidad and Tobago primary school national assessments of educational achievement. Performance standards are written expectations of student achievement operationalized in defensible cutscores. A major argument in this paper is that these standards are necessary to evaluate quality in the education system because they directly address the question of "how good is good enough?" Standards-referenced measurement systems are the basis of both compensatory and accountability systems. Standard-setting procedures in the 2005 and 2006 national assessments of educational achievement are described, followed by an evaluation of procedural validity using quantitative and qualitative data gathered from panellists. The findings indicated that while panellists appear confident about procedures and outcomes, cognitive complexity and organizational inefficiency could prove to be critical constraints. While the introduction of student performance standards appears useful; by itself, it cannot lead to significant education improvement unless there is also a coherent policy for effective data use within a national evaluation system. In developing such a policy, consideration must be given to choosing between (a) low versus high examination stakes, (b) compensatory versus accountability policies, and (c) school-based versus centralized management of test processes. At the very least, stakeholders must understand the purpose of national assessments of educational achievement 2010-04-14T19:56:40Z 2010-04-14T19:56:40Z 2008 Article De Lisle, J. (2008). Can standards-referenced, large-scale assessment data lead to improvement in the education system?. Caribbean Curriculum, 15, 71-114 1017-5636 http://hdl.handle.net/2139/6588 en application/pdf School of Education, UWI, St. Augustine
institution UWI TT
collection DSpace
country Trinidad y Tobago
countrycode TT
component Bibliográfico
access En linea
databasecode dig-uwi-tt
tag biblioteca
region Caribe
libraryname UWI library system TT
language English
topic Primary school students
Performance criteria
Performance standards
Student evaluation
Assessment data
Data analysis
Trinidad and Tobago
Primary school students
Performance criteria
Performance standards
Student evaluation
Assessment data
Data analysis
Trinidad and Tobago
spellingShingle Primary school students
Performance criteria
Performance standards
Student evaluation
Assessment data
Data analysis
Trinidad and Tobago
Primary school students
Performance criteria
Performance standards
Student evaluation
Assessment data
Data analysis
Trinidad and Tobago
De Lisle, Jerome
Can standards-referenced, large-scale assessment data lead to improvement in the education system?
description This paper documents the development of performance standards for the Trinidad and Tobago primary school national assessments of educational achievement. Performance standards are written expectations of student achievement operationalized in defensible cutscores. A major argument in this paper is that these standards are necessary to evaluate quality in the education system because they directly address the question of "how good is good enough?" Standards-referenced measurement systems are the basis of both compensatory and accountability systems. Standard-setting procedures in the 2005 and 2006 national assessments of educational achievement are described, followed by an evaluation of procedural validity using quantitative and qualitative data gathered from panellists. The findings indicated that while panellists appear confident about procedures and outcomes, cognitive complexity and organizational inefficiency could prove to be critical constraints. While the introduction of student performance standards appears useful; by itself, it cannot lead to significant education improvement unless there is also a coherent policy for effective data use within a national evaluation system. In developing such a policy, consideration must be given to choosing between (a) low versus high examination stakes, (b) compensatory versus accountability policies, and (c) school-based versus centralized management of test processes. At the very least, stakeholders must understand the purpose of national assessments of educational achievement
format Article
topic_facet Primary school students
Performance criteria
Performance standards
Student evaluation
Assessment data
Data analysis
Trinidad and Tobago
author De Lisle, Jerome
author_facet De Lisle, Jerome
author_sort De Lisle, Jerome
title Can standards-referenced, large-scale assessment data lead to improvement in the education system?
title_short Can standards-referenced, large-scale assessment data lead to improvement in the education system?
title_full Can standards-referenced, large-scale assessment data lead to improvement in the education system?
title_fullStr Can standards-referenced, large-scale assessment data lead to improvement in the education system?
title_full_unstemmed Can standards-referenced, large-scale assessment data lead to improvement in the education system?
title_sort can standards-referenced, large-scale assessment data lead to improvement in the education system?
publisher School of Education, UWI, St. Augustine
publishDate 2008
url http://hdl.handle.net/2139/6588
work_keys_str_mv AT delislejerome canstandardsreferencedlargescaleassessmentdataleadtoimprovementintheeducationsystem
_version_ 1756093166414462976