Outlier Detection for Welfare Analysis
Extreme values are common in survey data and represent a recurring threat to the reliability of both poverty and inequality estimates. The adoption of a consistent criterion for outlier detection is useful in many practical applications, particularly when international and intertemporal comparisons are involved. This paper discusses a simple, univariate detection procedure to flag outliers in the distribution of any variable of interest. It presents outdetect, a Stata command that implements the procedure and provides useful diagnostic tools. The output of outdetect compares statistics—with focus on inequality and poverty measures—obtained before and after the exclusion of outliers. Finally, the paper carries out an extensive sensitivity exercise, where the same outlier detection method is applied consistently to per capita expenditure across more than 30 household budget surveys. The results are clear-cut and provide a sense of the influence of extreme values on poverty and inequality estimates.
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Working Paper biblioteca |
| Language: | English English |
| Published: |
World Bank, Washington, DC
2022-11
|
| Subjects: | OUTLIERS, EXTREME VALUES, INEQUALITY, POVERTY, INCREMENTAL TRIMMING CURVE, SURVEY DATA OUTLIER CRITERION, OUTLIER DETECTION, STATA, INEQUALITY MEASURE, POVERTY MEASURE, HOUSEHOLD BUDGET SURVEYS, INFLUENCE OF EXTREME SURVEY DATA, |
| Online Access: | http://documents.worldbank.org/curated/en/099536211152218834/IDU0d8c0f49d0042704e31095c7006964c6e8ce5 http://hdl.handle.net/10986/38318 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
dig-okr-1098638318 |
|---|---|
| record_format |
koha |
| spelling |
dig-okr-10986383182022-11-28T15:24:48Z Outlier Detection for Welfare Analysis Belotti, Federico Mancini, Giulia Vecchi, Giovanni OUTLIERS EXTREME VALUES INEQUALITY POVERTY INCREMENTAL TRIMMING CURVE SURVEY DATA OUTLIER CRITERION OUTLIER DETECTION STATA INEQUALITY MEASURE POVERTY MEASURE HOUSEHOLD BUDGET SURVEYS INFLUENCE OF EXTREME SURVEY DATA Extreme values are common in survey data and represent a recurring threat to the reliability of both poverty and inequality estimates. The adoption of a consistent criterion for outlier detection is useful in many practical applications, particularly when international and intertemporal comparisons are involved. This paper discusses a simple, univariate detection procedure to flag outliers in the distribution of any variable of interest. It presents outdetect, a Stata command that implements the procedure and provides useful diagnostic tools. The output of outdetect compares statistics—with focus on inequality and poverty measures—obtained before and after the exclusion of outliers. Finally, the paper carries out an extensive sensitivity exercise, where the same outlier detection method is applied consistently to per capita expenditure across more than 30 household budget surveys. The results are clear-cut and provide a sense of the influence of extreme values on poverty and inequality estimates. 2022-11-16T16:52:03Z 2022-11-16T16:52:03Z 2022-11 Working Paper http://documents.worldbank.org/curated/en/099536211152218834/IDU0d8c0f49d0042704e31095c7006964c6e8ce5 http://hdl.handle.net/10986/38318 English en Policy Research Working Papers;10231 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo World Bank World Bank, Washington, DC Policy Research Working Paper Publications & Research |
| institution |
Banco Mundial |
| collection |
DSpace |
| country |
Estados Unidos |
| countrycode |
US |
| component |
Bibliográfico |
| access |
En linea |
| databasecode |
dig-okr |
| tag |
biblioteca |
| region |
America del Norte |
| libraryname |
Biblioteca del Banco Mundial |
| language |
English English |
| topic |
OUTLIERS EXTREME VALUES INEQUALITY POVERTY INCREMENTAL TRIMMING CURVE SURVEY DATA OUTLIER CRITERION OUTLIER DETECTION STATA INEQUALITY MEASURE POVERTY MEASURE HOUSEHOLD BUDGET SURVEYS INFLUENCE OF EXTREME SURVEY DATA OUTLIERS EXTREME VALUES INEQUALITY POVERTY INCREMENTAL TRIMMING CURVE SURVEY DATA OUTLIER CRITERION OUTLIER DETECTION STATA INEQUALITY MEASURE POVERTY MEASURE HOUSEHOLD BUDGET SURVEYS INFLUENCE OF EXTREME SURVEY DATA |
| spellingShingle |
OUTLIERS EXTREME VALUES INEQUALITY POVERTY INCREMENTAL TRIMMING CURVE SURVEY DATA OUTLIER CRITERION OUTLIER DETECTION STATA INEQUALITY MEASURE POVERTY MEASURE HOUSEHOLD BUDGET SURVEYS INFLUENCE OF EXTREME SURVEY DATA OUTLIERS EXTREME VALUES INEQUALITY POVERTY INCREMENTAL TRIMMING CURVE SURVEY DATA OUTLIER CRITERION OUTLIER DETECTION STATA INEQUALITY MEASURE POVERTY MEASURE HOUSEHOLD BUDGET SURVEYS INFLUENCE OF EXTREME SURVEY DATA Belotti, Federico Mancini, Giulia Vecchi, Giovanni Outlier Detection for Welfare Analysis |
| description |
Extreme values are common in survey
data and represent a recurring threat to the reliability of
both poverty and inequality estimates. The adoption of a
consistent criterion for outlier detection is useful in many
practical applications, particularly when international and
intertemporal comparisons are involved. This paper discusses
a simple, univariate detection procedure to flag outliers in
the distribution of any variable of interest. It presents
outdetect, a Stata command that implements the procedure and
provides useful diagnostic tools. The output of outdetect
compares statistics—with focus on inequality and poverty
measures—obtained before and after the exclusion of
outliers. Finally, the paper carries out an extensive
sensitivity exercise, where the same outlier detection
method is applied consistently to per capita expenditure
across more than 30 household budget surveys. The results
are clear-cut and provide a sense of the influence of
extreme values on poverty and inequality estimates. |
| format |
Working Paper |
| topic_facet |
OUTLIERS EXTREME VALUES INEQUALITY POVERTY INCREMENTAL TRIMMING CURVE SURVEY DATA OUTLIER CRITERION OUTLIER DETECTION STATA INEQUALITY MEASURE POVERTY MEASURE HOUSEHOLD BUDGET SURVEYS INFLUENCE OF EXTREME SURVEY DATA |
| author |
Belotti, Federico Mancini, Giulia Vecchi, Giovanni |
| author_facet |
Belotti, Federico Mancini, Giulia Vecchi, Giovanni |
| author_sort |
Belotti, Federico |
| title |
Outlier Detection for Welfare Analysis |
| title_short |
Outlier Detection for Welfare Analysis |
| title_full |
Outlier Detection for Welfare Analysis |
| title_fullStr |
Outlier Detection for Welfare Analysis |
| title_full_unstemmed |
Outlier Detection for Welfare Analysis |
| title_sort |
outlier detection for welfare analysis |
| publisher |
World Bank, Washington, DC |
| publishDate |
2022-11 |
| url |
http://documents.worldbank.org/curated/en/099536211152218834/IDU0d8c0f49d0042704e31095c7006964c6e8ce5 http://hdl.handle.net/10986/38318 |
| work_keys_str_mv |
AT belottifederico outlierdetectionforwelfareanalysis AT mancinigiulia outlierdetectionforwelfareanalysis AT vecchigiovanni outlierdetectionforwelfareanalysis |
| _version_ |
1756576224164970496 |