Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical Teachers

Abstract Introduction Although there are instruments in Spanish to evaluate teacher performance during the initial basic science training years or during medical specialization; there are few instruments for the clinical training years, in which the main role of the teacher is to facilitate experiential learning. The MEDUC30 questionnaire is a Spanish instrument developed by the Pontificia Universidad Católica School of Medicine. It was built using the Stanford Faculty Development Program (SFDP) educational framework for evaluation of clinical teachers' effectiveness by students. MEDUC30 has been used since 2004 at Pontificia Uni versidad Católica de Chile and was previously studied with exploratory methods. Objective To provide satisfying evidence of validity and reliability to support MEDUC30's usefulness in Spanish-speaking contexts, using confirmatory analytical methods. Method This is an analytical, longitudinal and retrospective study, in which 24,681 MEDUC30 questionnaires evaluating 579 clinical teachers were analysed. They were completed by medical students from 3rd to 7th year of study, from 2004 throughout 2015. The questionnaire's structure was studied by exploratory (EFA) and confirmatory factor analysis (CFA). Measurement invariance was evaluated with multi-group CFA. Results Four different models were compared; a bi-factor model was the best alternative to explain the data's structure. It was composed of one general and six domain-specific factors: [i] Patient-Based Teaching, [ii] Communication of Goals, [iii] Evaluation and Feedback, [iv] Promotion of Understanding, Retention, and Self-directed Learning, [v] Control of the Session, and [vi] Learning Climate. The overall reliability of MEDUC30 scores was excellent (Cronbach's α = .98, McDonald's ω = .98) and that of the six specific factors was very good (Cronbach's α =.88-.95, McDonald's ω = .78-.94). Measurement invariance extended over teacher gender, date, semester, year of study, clinical teaching setting, and length of clinical rotation; all of these variables were sources of population heterogeneity. Conclusions MEDUC30 is a valid and reliable Spanish instrument to evaluate clinical teachers. It can be used to provide formative feedback to clinical teachers and to provide accurate information to department heads and program directors for resource allocation and promotion purposes.

Saved in:
Bibliographic Details
Main Authors: Bitran,Marcela, Torres-Sahli,Manuel, Padilla,Oslando
Format: Digital revista
Language:English
Published: Universidad Nacional Autónoma de México, Facultad de Medicina 2018
Online Access:http://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S2007-50572018000300014
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:scielo:S2007-50572018000300014
record_format ojs
spelling oai:scielo:S2007-505720180003000142019-01-28Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical TeachersBitran,MarcelaTorres-Sahli,ManuelPadilla,Oslando clinical teacher evaluation effectiveness instrument and validity Abstract Introduction Although there are instruments in Spanish to evaluate teacher performance during the initial basic science training years or during medical specialization; there are few instruments for the clinical training years, in which the main role of the teacher is to facilitate experiential learning. The MEDUC30 questionnaire is a Spanish instrument developed by the Pontificia Universidad Católica School of Medicine. It was built using the Stanford Faculty Development Program (SFDP) educational framework for evaluation of clinical teachers' effectiveness by students. MEDUC30 has been used since 2004 at Pontificia Uni versidad Católica de Chile and was previously studied with exploratory methods. Objective To provide satisfying evidence of validity and reliability to support MEDUC30's usefulness in Spanish-speaking contexts, using confirmatory analytical methods. Method This is an analytical, longitudinal and retrospective study, in which 24,681 MEDUC30 questionnaires evaluating 579 clinical teachers were analysed. They were completed by medical students from 3rd to 7th year of study, from 2004 throughout 2015. The questionnaire's structure was studied by exploratory (EFA) and confirmatory factor analysis (CFA). Measurement invariance was evaluated with multi-group CFA. Results Four different models were compared; a bi-factor model was the best alternative to explain the data's structure. It was composed of one general and six domain-specific factors: [i] Patient-Based Teaching, [ii] Communication of Goals, [iii] Evaluation and Feedback, [iv] Promotion of Understanding, Retention, and Self-directed Learning, [v] Control of the Session, and [vi] Learning Climate. The overall reliability of MEDUC30 scores was excellent (Cronbach's α = .98, McDonald's ω = .98) and that of the six specific factors was very good (Cronbach's α =.88-.95, McDonald's ω = .78-.94). Measurement invariance extended over teacher gender, date, semester, year of study, clinical teaching setting, and length of clinical rotation; all of these variables were sources of population heterogeneity. Conclusions MEDUC30 is a valid and reliable Spanish instrument to evaluate clinical teachers. It can be used to provide formative feedback to clinical teachers and to provide accurate information to department heads and program directors for resource allocation and promotion purposes.info:eu-repo/semantics/openAccessUniversidad Nacional Autónoma de México, Facultad de MedicinaInvestigación en educación médica v.7 n.27 20182018-09-01info:eu-repo/semantics/articletext/htmlhttp://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S2007-50572018000300014en10.1016/j.riem.2017.06.003
institution SCIELO
collection OJS
country México
countrycode MX
component Revista
access En linea
databasecode rev-scielo-mx
tag revista
region America del Norte
libraryname SciELO
language English
format Digital
author Bitran,Marcela
Torres-Sahli,Manuel
Padilla,Oslando
spellingShingle Bitran,Marcela
Torres-Sahli,Manuel
Padilla,Oslando
Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical Teachers
author_facet Bitran,Marcela
Torres-Sahli,Manuel
Padilla,Oslando
author_sort Bitran,Marcela
title Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical Teachers
title_short Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical Teachers
title_full Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical Teachers
title_fullStr Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical Teachers
title_full_unstemmed Validation of a Spanish questionnaire implementing the Stanford Educational Framework for Evaluation of Clinical Teachers
title_sort validation of a spanish questionnaire implementing the stanford educational framework for evaluation of clinical teachers
description Abstract Introduction Although there are instruments in Spanish to evaluate teacher performance during the initial basic science training years or during medical specialization; there are few instruments for the clinical training years, in which the main role of the teacher is to facilitate experiential learning. The MEDUC30 questionnaire is a Spanish instrument developed by the Pontificia Universidad Católica School of Medicine. It was built using the Stanford Faculty Development Program (SFDP) educational framework for evaluation of clinical teachers' effectiveness by students. MEDUC30 has been used since 2004 at Pontificia Uni versidad Católica de Chile and was previously studied with exploratory methods. Objective To provide satisfying evidence of validity and reliability to support MEDUC30's usefulness in Spanish-speaking contexts, using confirmatory analytical methods. Method This is an analytical, longitudinal and retrospective study, in which 24,681 MEDUC30 questionnaires evaluating 579 clinical teachers were analysed. They were completed by medical students from 3rd to 7th year of study, from 2004 throughout 2015. The questionnaire's structure was studied by exploratory (EFA) and confirmatory factor analysis (CFA). Measurement invariance was evaluated with multi-group CFA. Results Four different models were compared; a bi-factor model was the best alternative to explain the data's structure. It was composed of one general and six domain-specific factors: [i] Patient-Based Teaching, [ii] Communication of Goals, [iii] Evaluation and Feedback, [iv] Promotion of Understanding, Retention, and Self-directed Learning, [v] Control of the Session, and [vi] Learning Climate. The overall reliability of MEDUC30 scores was excellent (Cronbach's α = .98, McDonald's ω = .98) and that of the six specific factors was very good (Cronbach's α =.88-.95, McDonald's ω = .78-.94). Measurement invariance extended over teacher gender, date, semester, year of study, clinical teaching setting, and length of clinical rotation; all of these variables were sources of population heterogeneity. Conclusions MEDUC30 is a valid and reliable Spanish instrument to evaluate clinical teachers. It can be used to provide formative feedback to clinical teachers and to provide accurate information to department heads and program directors for resource allocation and promotion purposes.
publisher Universidad Nacional Autónoma de México, Facultad de Medicina
publishDate 2018
url http://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S2007-50572018000300014
work_keys_str_mv AT bitranmarcela validationofaspanishquestionnaireimplementingthestanfordeducationalframeworkforevaluationofclinicalteachers
AT torressahlimanuel validationofaspanishquestionnaireimplementingthestanfordeducationalframeworkforevaluationofclinicalteachers
AT padillaoslando validationofaspanishquestionnaireimplementingthestanfordeducationalframeworkforevaluationofclinicalteachers
_version_ 1756230878209507328