A Cautionary Tale

Several studies in the literature have adopted attitude or perception-based survey questions to evaluate the business environment and its effect on firms. The Enterprise Surveys of the World Bank are not an exception. In the case of the Enterprise Surveys, these questions involve rating an element of the business environment at the end of each section of the survey instrument. Such questions are often used but sometimes are inconsistent with responses elicited on the experience of the firm over a specific timeframe—experience-based questions. The literature is mixed as to whether perception-based questions are susceptible to anchoring or context effects. In this study, an experiment is set up to explore whether perceptions of the business environment are stable or vulnerable to the ordering of questions in the Enterprise Surveys questionnaire. The experiment entails randomizing the placement order of the perception-based questions at the end of a section or at the beginning of the survey. Significant question-order effects are uncovered only for perceptions of corruption and business licensing and permits but not the other elements, after accounting for a variety of factors. The study recommends that analysis in these two areas should go beyond perception-based questions and verify their findings with experience-based questions.

Saved in:
Bibliographic Details
Main Authors: Islam, Asif M., Rodriguez Meza, Jorge
Format: Working Paper biblioteca
Language:English
Published: World Bank, Washington, DC 2021-04
Subjects:BUSINESS ENVIRONMENT, FIRM SURVEY, PERCEPTION OF CORRUPTION, SURVEY BIAS, SUBJECTIVE RESPONSE, QUESTION ORDER, ENTERPRISE SURVEY, CONTEXT EFFECTS, BUSINESS LICENSE, PERMITS,
Online Access:http://documents.worldbank.org/curated/en/791411617632412553/A-Cautionary-Tale-An-Experiment-on-The-Stability-of-Business-Environment-Perceptions-in-a-Firm-Survey
https://hdl.handle.net/10986/35405
Tags: Add Tag
No Tags, Be the first to tag this record!
id dig-okr-1098635405
record_format koha
spelling dig-okr-10986354052024-12-18T03:35:41Z A Cautionary Tale An Experiment on the Stability of Business Environment Perceptions in a Firm Survey Islam, Asif M. Rodriguez Meza, Jorge BUSINESS ENVIRONMENT FIRM SURVEY PERCEPTION OF CORRUPTION SURVEY BIAS SUBJECTIVE RESPONSE QUESTION ORDER ENTERPRISE SURVEY CONTEXT EFFECTS BUSINESS LICENSE PERMITS Several studies in the literature have adopted attitude or perception-based survey questions to evaluate the business environment and its effect on firms. The Enterprise Surveys of the World Bank are not an exception. In the case of the Enterprise Surveys, these questions involve rating an element of the business environment at the end of each section of the survey instrument. Such questions are often used but sometimes are inconsistent with responses elicited on the experience of the firm over a specific timeframe—experience-based questions. The literature is mixed as to whether perception-based questions are susceptible to anchoring or context effects. In this study, an experiment is set up to explore whether perceptions of the business environment are stable or vulnerable to the ordering of questions in the Enterprise Surveys questionnaire. The experiment entails randomizing the placement order of the perception-based questions at the end of a section or at the beginning of the survey. Significant question-order effects are uncovered only for perceptions of corruption and business licensing and permits but not the other elements, after accounting for a variety of factors. The study recommends that analysis in these two areas should go beyond perception-based questions and verify their findings with experience-based questions. 2021-04-08T16:16:16Z 2021-04-08T16:16:16Z 2021-04 Working Paper Document de travail Documento de trabajo http://documents.worldbank.org/curated/en/791411617632412553/A-Cautionary-Tale-An-Experiment-on-The-Stability-of-Business-Environment-Perceptions-in-a-Firm-Survey https://hdl.handle.net/10986/35405 English Policy Research Working Paper;No. 9610 CC BY 3.0 IGO http://creativecommons.org/licenses/by/3.0/igo World Bank application/pdf text/plain World Bank, Washington, DC
institution Banco Mundial
collection DSpace
country Estados Unidos
countrycode US
component Bibliográfico
access En linea
databasecode dig-okr
tag biblioteca
region America del Norte
libraryname Biblioteca del Banco Mundial
language English
topic BUSINESS ENVIRONMENT
FIRM SURVEY
PERCEPTION OF CORRUPTION
SURVEY BIAS
SUBJECTIVE RESPONSE
QUESTION ORDER
ENTERPRISE SURVEY
CONTEXT EFFECTS
BUSINESS LICENSE
PERMITS
BUSINESS ENVIRONMENT
FIRM SURVEY
PERCEPTION OF CORRUPTION
SURVEY BIAS
SUBJECTIVE RESPONSE
QUESTION ORDER
ENTERPRISE SURVEY
CONTEXT EFFECTS
BUSINESS LICENSE
PERMITS
spellingShingle BUSINESS ENVIRONMENT
FIRM SURVEY
PERCEPTION OF CORRUPTION
SURVEY BIAS
SUBJECTIVE RESPONSE
QUESTION ORDER
ENTERPRISE SURVEY
CONTEXT EFFECTS
BUSINESS LICENSE
PERMITS
BUSINESS ENVIRONMENT
FIRM SURVEY
PERCEPTION OF CORRUPTION
SURVEY BIAS
SUBJECTIVE RESPONSE
QUESTION ORDER
ENTERPRISE SURVEY
CONTEXT EFFECTS
BUSINESS LICENSE
PERMITS
Islam, Asif M.
Rodriguez Meza, Jorge
A Cautionary Tale
description Several studies in the literature have adopted attitude or perception-based survey questions to evaluate the business environment and its effect on firms. The Enterprise Surveys of the World Bank are not an exception. In the case of the Enterprise Surveys, these questions involve rating an element of the business environment at the end of each section of the survey instrument. Such questions are often used but sometimes are inconsistent with responses elicited on the experience of the firm over a specific timeframe—experience-based questions. The literature is mixed as to whether perception-based questions are susceptible to anchoring or context effects. In this study, an experiment is set up to explore whether perceptions of the business environment are stable or vulnerable to the ordering of questions in the Enterprise Surveys questionnaire. The experiment entails randomizing the placement order of the perception-based questions at the end of a section or at the beginning of the survey. Significant question-order effects are uncovered only for perceptions of corruption and business licensing and permits but not the other elements, after accounting for a variety of factors. The study recommends that analysis in these two areas should go beyond perception-based questions and verify their findings with experience-based questions.
format Working Paper
topic_facet BUSINESS ENVIRONMENT
FIRM SURVEY
PERCEPTION OF CORRUPTION
SURVEY BIAS
SUBJECTIVE RESPONSE
QUESTION ORDER
ENTERPRISE SURVEY
CONTEXT EFFECTS
BUSINESS LICENSE
PERMITS
author Islam, Asif M.
Rodriguez Meza, Jorge
author_facet Islam, Asif M.
Rodriguez Meza, Jorge
author_sort Islam, Asif M.
title A Cautionary Tale
title_short A Cautionary Tale
title_full A Cautionary Tale
title_fullStr A Cautionary Tale
title_full_unstemmed A Cautionary Tale
title_sort cautionary tale
publisher World Bank, Washington, DC
publishDate 2021-04
url http://documents.worldbank.org/curated/en/791411617632412553/A-Cautionary-Tale-An-Experiment-on-The-Stability-of-Business-Environment-Perceptions-in-a-Firm-Survey
https://hdl.handle.net/10986/35405
work_keys_str_mv AT islamasifm acautionarytale
AT rodriguezmezajorge acautionarytale
AT islamasifm anexperimentonthestabilityofbusinessenvironmentperceptionsinafirmsurvey
AT rodriguezmezajorge anexperimentonthestabilityofbusinessenvironmentperceptionsinafirmsurvey
AT islamasifm cautionarytale
AT rodriguezmezajorge cautionarytale
_version_ 1819034717391945728