Blackout or Blanked Out?

Access to reliable electricity is a Sustainable Development Goal, and key for both economic growth and individual wellbeing. Yet, in the absence of sophisticated monitoring systems, policy makers in developing countries commonly rely on surveys to measure electricity reliability and prioritize investments. The accuracy of such survey-based methods is unclear. This study built a low-cost national electricity outage monitoring network, using off-the-shelf components in Tajikistan – a country with severe electricity service constraints. The system was introduced alongside a monthly household survey called Listening to Tajikistan, which allowed benchmarking the survey summary statistics against unbiased measures. The results show that although the two measures were well correlated, the survey data suffered from significant and systematic bias. Survey respondents (i) systematically underreported the incidence and severity of electricity outages on average, but (ii) systematically overreported the incidence of outages during a period of abnormally widespread service disruption of long duration. These findings suggest that bias in survey-based measures is sensitive to the salience of outages to the respondent, and that, where feasible, automated electricity monitoring can provide more accurate quality measurement. For survey settings, the results also suggest that estimates are more accurate over short (daily) reference periods.

Saved in:
Bibliographic Details
Main Authors: Seitz, William, Kudo, Yuya, Azevedo, Joao Pedro
Format: Working Paper biblioteca
Language:English
English
Published: World Bank 2023-04-26
Subjects:ELECTRICITY OUTAGE MONITORING, ELECTRICITY CUSTOMER SURVEY METHODS, SURVEY BIAS, AUTOMATED ELECTRICITY MONITORING, ELECTRIC SERVICE INVESTMENT, INFRASTRUCTURE ASSESSMENT,
Online Access:http://documents.worldbank.org/curated/en/099543304252337204/IDU0a65f8c1f08a96046d60931d0c0767d304d63
https://openknowledge.worldbank.org/handle/10986/39744
Tags: Add Tag
No Tags, Be the first to tag this record!
id dig-okr-1098639744
record_format koha
spelling dig-okr-10986397442024-03-11T19:25:38Z Blackout or Blanked Out? Monitoring the Quality of Electricity Service in Developing Countries Seitz, William Kudo, Yuya Azevedo, Joao Pedro ELECTRICITY OUTAGE MONITORING ELECTRICITY CUSTOMER SURVEY METHODS SURVEY BIAS AUTOMATED ELECTRICITY MONITORING ELECTRIC SERVICE INVESTMENT INFRASTRUCTURE ASSESSMENT Access to reliable electricity is a Sustainable Development Goal, and key for both economic growth and individual wellbeing. Yet, in the absence of sophisticated monitoring systems, policy makers in developing countries commonly rely on surveys to measure electricity reliability and prioritize investments. The accuracy of such survey-based methods is unclear. This study built a low-cost national electricity outage monitoring network, using off-the-shelf components in Tajikistan – a country with severe electricity service constraints. The system was introduced alongside a monthly household survey called Listening to Tajikistan, which allowed benchmarking the survey summary statistics against unbiased measures. The results show that although the two measures were well correlated, the survey data suffered from significant and systematic bias. Survey respondents (i) systematically underreported the incidence and severity of electricity outages on average, but (ii) systematically overreported the incidence of outages during a period of abnormally widespread service disruption of long duration. These findings suggest that bias in survey-based measures is sensitive to the salience of outages to the respondent, and that, where feasible, automated electricity monitoring can provide more accurate quality measurement. For survey settings, the results also suggest that estimates are more accurate over short (daily) reference periods. 2023-04-26T20:49:13Z 2023-04-26T20:49:13Z 2023-04-26 Working Paper http://documents.worldbank.org/curated/en/099543304252337204/IDU0a65f8c1f08a96046d60931d0c0767d304d63 https://openknowledge.worldbank.org/handle/10986/39744 English en Policy Research Working Papers; 10423 CC BY 3.0 IGO https://creativecommons.org/licenses/by/3.0/igo/ World Bank application/pdf text/plain World Bank
institution Banco Mundial
collection DSpace
country Estados Unidos
countrycode US
component Bibliográfico
access En linea
databasecode dig-okr
tag biblioteca
region America del Norte
libraryname Biblioteca del Banco Mundial
language English
English
topic ELECTRICITY OUTAGE MONITORING
ELECTRICITY CUSTOMER SURVEY METHODS
SURVEY BIAS
AUTOMATED ELECTRICITY MONITORING
ELECTRIC SERVICE INVESTMENT
INFRASTRUCTURE ASSESSMENT
ELECTRICITY OUTAGE MONITORING
ELECTRICITY CUSTOMER SURVEY METHODS
SURVEY BIAS
AUTOMATED ELECTRICITY MONITORING
ELECTRIC SERVICE INVESTMENT
INFRASTRUCTURE ASSESSMENT
spellingShingle ELECTRICITY OUTAGE MONITORING
ELECTRICITY CUSTOMER SURVEY METHODS
SURVEY BIAS
AUTOMATED ELECTRICITY MONITORING
ELECTRIC SERVICE INVESTMENT
INFRASTRUCTURE ASSESSMENT
ELECTRICITY OUTAGE MONITORING
ELECTRICITY CUSTOMER SURVEY METHODS
SURVEY BIAS
AUTOMATED ELECTRICITY MONITORING
ELECTRIC SERVICE INVESTMENT
INFRASTRUCTURE ASSESSMENT
Seitz, William
Kudo, Yuya
Azevedo, Joao Pedro
Blackout or Blanked Out?
description Access to reliable electricity is a Sustainable Development Goal, and key for both economic growth and individual wellbeing. Yet, in the absence of sophisticated monitoring systems, policy makers in developing countries commonly rely on surveys to measure electricity reliability and prioritize investments. The accuracy of such survey-based methods is unclear. This study built a low-cost national electricity outage monitoring network, using off-the-shelf components in Tajikistan – a country with severe electricity service constraints. The system was introduced alongside a monthly household survey called Listening to Tajikistan, which allowed benchmarking the survey summary statistics against unbiased measures. The results show that although the two measures were well correlated, the survey data suffered from significant and systematic bias. Survey respondents (i) systematically underreported the incidence and severity of electricity outages on average, but (ii) systematically overreported the incidence of outages during a period of abnormally widespread service disruption of long duration. These findings suggest that bias in survey-based measures is sensitive to the salience of outages to the respondent, and that, where feasible, automated electricity monitoring can provide more accurate quality measurement. For survey settings, the results also suggest that estimates are more accurate over short (daily) reference periods.
format Working Paper
topic_facet ELECTRICITY OUTAGE MONITORING
ELECTRICITY CUSTOMER SURVEY METHODS
SURVEY BIAS
AUTOMATED ELECTRICITY MONITORING
ELECTRIC SERVICE INVESTMENT
INFRASTRUCTURE ASSESSMENT
author Seitz, William
Kudo, Yuya
Azevedo, Joao Pedro
author_facet Seitz, William
Kudo, Yuya
Azevedo, Joao Pedro
author_sort Seitz, William
title Blackout or Blanked Out?
title_short Blackout or Blanked Out?
title_full Blackout or Blanked Out?
title_fullStr Blackout or Blanked Out?
title_full_unstemmed Blackout or Blanked Out?
title_sort blackout or blanked out?
publisher World Bank
publishDate 2023-04-26
url http://documents.worldbank.org/curated/en/099543304252337204/IDU0a65f8c1f08a96046d60931d0c0767d304d63
https://openknowledge.worldbank.org/handle/10986/39744
work_keys_str_mv AT seitzwilliam blackoutorblankedout
AT kudoyuya blackoutorblankedout
AT azevedojoaopedro blackoutorblankedout
AT seitzwilliam monitoringthequalityofelectricityserviceindevelopingcountries
AT kudoyuya monitoringthequalityofelectricityserviceindevelopingcountries
AT azevedojoaopedro monitoringthequalityofelectricityserviceindevelopingcountries
_version_ 1794797265347411968