DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHD

Abstract:The detection of differential item functioning (DIF) is fundamental to ensure instruments’ invariance, and, therefore, a better estimate of the construct being measured across the different groups of examinees. The purpose of this research was to provide substantive hypothesizes related to possible sources of DIF, comparing students reported with accommodations for ADHD (focal group) and students with no accommodations (reference group), using the Standardized-P Difference and the Mantel Haenszel (MH) methods. Data from the Costa Rican national high school exit tests in Spanish and Math, from the year 2004, in public schools, were analyzed. First, these two methods were used to detect items with DIF, and then, using a more qualitative approach, drew hypotheses related to possible sources of DIF. Some degree of agreement was verified between the two different empirical methods, being Mantel-Haenszel more sensitive. In the Spanish test, DIF was hypothesized to be caused by the length and wording of the options, and the literary and non-literary texts in the stem. In Math, possible sources of DIF involved vocabulary, wording, the transition of verbal to mathematical language, the visuospatial item organization, and the drawing of graphs and geometrical figures. At the methodological level, complementing the statistical analyses with the judges’ criteria was helpful to identify possible sources of irrelevant variance in the construct measured by these tests. The hypotheses must be interpreted with caution, though, since the number of items detected as exhibiting DIF was relatively small.

Saved in:
Bibliographic Details
Main Authors: Montero-Rojas,Eiliana, Moreira-Mora,Tania Elena
Format: Digital revista
Language:English
Published: Instituto de Investigación en Educación, Universidad de Costa Rica 2017
Online Access:http://www.scielo.sa.cr/scielo.php?script=sci_arttext&pid=S1409-47032017000200068
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:scielo:S1409-47032017000200068
record_format ojs
spelling oai:scielo:S1409-470320170002000682017-09-18DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHDMontero-Rojas,EilianaMoreira-Mora,Tania Elena DIF validity testing accommodations adhd mathematics language. Abstract:The detection of differential item functioning (DIF) is fundamental to ensure instruments’ invariance, and, therefore, a better estimate of the construct being measured across the different groups of examinees. The purpose of this research was to provide substantive hypothesizes related to possible sources of DIF, comparing students reported with accommodations for ADHD (focal group) and students with no accommodations (reference group), using the Standardized-P Difference and the Mantel Haenszel (MH) methods. Data from the Costa Rican national high school exit tests in Spanish and Math, from the year 2004, in public schools, were analyzed. First, these two methods were used to detect items with DIF, and then, using a more qualitative approach, drew hypotheses related to possible sources of DIF. Some degree of agreement was verified between the two different empirical methods, being Mantel-Haenszel more sensitive. In the Spanish test, DIF was hypothesized to be caused by the length and wording of the options, and the literary and non-literary texts in the stem. In Math, possible sources of DIF involved vocabulary, wording, the transition of verbal to mathematical language, the visuospatial item organization, and the drawing of graphs and geometrical figures. At the methodological level, complementing the statistical analyses with the judges’ criteria was helpful to identify possible sources of irrelevant variance in the construct measured by these tests. The hypotheses must be interpreted with caution, though, since the number of items detected as exhibiting DIF was relatively small.info:eu-repo/semantics/openAccessInstituto de Investigación en Educación, Universidad de Costa RicaActualidades Investigativas en Educación v.17 n.2 20172017-08-01info:eu-repo/semantics/articletext/htmlhttp://www.scielo.sa.cr/scielo.php?script=sci_arttext&pid=S1409-47032017000200068en10.15517/aie.v17i1.28661
institution SCIELO
collection OJS
country Costa Rica
countrycode CR
component Revista
access En linea
databasecode rev-scielo-cr
tag revista
region America Central
libraryname SciELO
language English
format Digital
author Montero-Rojas,Eiliana
Moreira-Mora,Tania Elena
spellingShingle Montero-Rojas,Eiliana
Moreira-Mora,Tania Elena
DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHD
author_facet Montero-Rojas,Eiliana
Moreira-Mora,Tania Elena
author_sort Montero-Rojas,Eiliana
title DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHD
title_short DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHD
title_full DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHD
title_fullStr DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHD
title_full_unstemmed DIF in Spanish and Mathematics from Costa Rica’s national tests in reported students with ADHD
title_sort dif in spanish and mathematics from costa rica’s national tests in reported students with adhd
description Abstract:The detection of differential item functioning (DIF) is fundamental to ensure instruments’ invariance, and, therefore, a better estimate of the construct being measured across the different groups of examinees. The purpose of this research was to provide substantive hypothesizes related to possible sources of DIF, comparing students reported with accommodations for ADHD (focal group) and students with no accommodations (reference group), using the Standardized-P Difference and the Mantel Haenszel (MH) methods. Data from the Costa Rican national high school exit tests in Spanish and Math, from the year 2004, in public schools, were analyzed. First, these two methods were used to detect items with DIF, and then, using a more qualitative approach, drew hypotheses related to possible sources of DIF. Some degree of agreement was verified between the two different empirical methods, being Mantel-Haenszel more sensitive. In the Spanish test, DIF was hypothesized to be caused by the length and wording of the options, and the literary and non-literary texts in the stem. In Math, possible sources of DIF involved vocabulary, wording, the transition of verbal to mathematical language, the visuospatial item organization, and the drawing of graphs and geometrical figures. At the methodological level, complementing the statistical analyses with the judges’ criteria was helpful to identify possible sources of irrelevant variance in the construct measured by these tests. The hypotheses must be interpreted with caution, though, since the number of items detected as exhibiting DIF was relatively small.
publisher Instituto de Investigación en Educación, Universidad de Costa Rica
publishDate 2017
url http://www.scielo.sa.cr/scielo.php?script=sci_arttext&pid=S1409-47032017000200068
work_keys_str_mv AT monterorojaseiliana difinspanishandmathematicsfromcostarica8217snationaltestsinreportedstudentswithadhd
AT moreiramorataniaelena difinspanishandmathematicsfromcostarica8217snationaltestsinreportedstudentswithadhd
_version_ 1755934278916505600