Validating the performance standards in the 2005 and 2006 national primary school achievement tests in Mathematics and Language Arts
Performance standards are informed expectations of student achievement levels in a population. These expectations are based on knowledge or skills in the curriculum (content standards) or on the content and demands of test items. Arguably, performance standards for national assessments of educational achievement are required to evaluate quality and equity within an education system. In 2005, performance standards were introduced into the reporting system for the Trinidad and Tobago primary school national assessments. The critical question was the meaningfulness and usefulness of these performance standards; an issue that relates to validity. Validation considers the legitimacy and defensibility of procedures. Evidence for the validity of standards may come from three different sources: procedural, internal, and external. This paper analysed these three sources of validity evidence for the performance standards established in the 2005 and 2006 national assessments. Following recent trends, the study makes significant use of qualitative data obtained from the judges in evaluating the cognitive processes and perceptions associated with judging and setting standards in situ. This type of data was obtained from journals and responses to open-ended questions in a questionnaire administered to participants during the standard-setting process. The 2005 data suggest that while some evidence was strongly supportive of procedural validity, problems in logistics and management of the process proved noteworthy limitations. Targets of improvement for future standard-setting exercises should focus on addressing these deficiencies. Additionally, future evaluations of the process should include additional quantitative information necessary to judge the internal and external validity
| Main Author: | |
|---|---|
| Format: | Book chapter biblioteca |
| Language: | English |
| Published: |
School of Education, UWI, St. Augustine
2008
|
| Subjects: | Primary schools, Achievement tests, Mathematics, Language arts, Examination standards, Validity, Trinidad and Tobago, |
| Online Access: | http://hdl.handle.net/2139/6732 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|