Rubric to assess the promotion of Self- Regulation of Learning: instrument validity and reliability study

Authors

DOI:

https://doi.org/10.55777/rea.v18i35.6783

Keywords:

Learning, Primary Education, Rubric, Socioeducation, Value

Abstract

Self-regulation of learning is linked to better academic results, greater autonomy and motivation in the student. An instrumental study was carried out to design and validate an instrument in the form of a rubric to evaluate teaching practices that promote self-regulation of learning in first, second and third grade students of primary education, through: 1) review of existing instruments to evaluate the self-regulation of learning in students; 2) design of the rubric-type instrument; 3) review and improvement of the instrument by a group of 3 experts; 4) content validation by a group of 15 expert judges in the area; and 5) reliability analysis of the application of the instrument to a pilot group of 24 teachers. In the evaluation by expert judges, all items obtained Aiken V values between 0.71 and 0.91. Cronbach's alpha is 0.80. It is concluded that the rubric is a relevant instrument for its purpose. Complementary studies of validity and reliability are necessary.

Downloads

Download data is not yet available.

Author Biographies

Nora Edith González Robles, Centro Universitario CIFE, México

PhD student in Socio-training and Knowledge Society at Centro Universitario CIFE. Master in Administration of Educational Institutions by ITESM. School director in primary education. Her line of research is self-regulation of learning in primary education students. PhD candidate in Socioformacion and Knowledge Society from CIFE University Center. Master's degree in Educational Institution Administration from ITESM. She is a primary school principal. Her research focuses on self-regulation of learning in primary school students.

Translated with DeepL.com (free version)

Luis Gibran Juarez Hernández, Centro Universitario CIFE, México

PhD in Biological and Health Sciences from the Universidad Autónoma Metropolitana. Professor-researcher at the CIFE University Centre and professor in the Master's Degree in Training and Innovation for Health Professionals at the Autonomous University of Chihuahua. Member of the National System of Researchers of CONAHCyT. Her research interests are ecological diagnosis, development and evaluation of assessment instruments. 

Sergio Raul Herrera Meza, Centro Universitario CIFE, México

Master´s degree in Educational Research and a PhD in Socioformacion and Knowledge Society. He has been a teacher and director in educational institutions. He is a consultant and collaborator with teacher training institutions, specializing in diagnosis and evaluaction of pedagogical practices and processes, and in management of educational institutions. He is autor an co-author of more than 20 scientific publications, including articles and book chapters on leadership, management, and educational evaluation.

References

American Psychological Association. (2017, 1 de enero). Ethical Principles of Psychologists and Code of Conduct. https://www.apa.org/ethics/code

Atmojo, S. E., Muhtarom, T., & Lukitoaji, B. D. (2020). The level of self-regulated learning and self-awareness in science learning in the covid-19 pandemic era. Jurnal Pendidikan IPA Indonesia, 9(4), 512-520. http://dx.doi.org/10.15294/jpii.v9i4.25544

Berger, F., Schreiner, C., Hagleitner, W., Jesacher-Rößler, L., Roßnagl, S., & Kraler, C. (2021). Predicting coping with self-regulated distance learning in times of COVID-19: Evidence from a longitudinal study. Frontiers in Psychology, 12, 701255. http://dx.doi.org/10.3389/fpsyg.2021.701255

Berridi, R. & Martínez, J. (2017). Estrategias de autorregulación en contextos virtuales de aprendizaje. Perfiles Educativos, 39(156). https://bit.ly/2r3vcG5

Blume, F., Schmidt, A., Kramer, A. C., Schmiedek, F., & Neubauer, A. B. (2021). Homeschooling during the SARS-CoV-2 pandemic: The role of students’ trait self-regulation and task attributes of daily learning tasks for students’ daily self-regulation. Zeitschrift für Erziehungswissenschaft, 24(2), 367-391. https://bit.ly/438gJ9F

Bulger, S. M., & Housner L.D. (2009). Modified Delphi investigation of exercise science in physical education teacher education. Journal of Teaching in Physical Education, 26, 57-80. https://doi.org/10.1123/jtpe.26.1.57

Cai, R., Wang, Q., Xu, J., & Zhou, L. (2020). Effectiveness of students’ self-regulated learning during the COVID-19 pandemic. Sci Insigt, 34(1), 175-182. http://dx.doi.org/10.15354/si.20.ar011

Carpenter, S. (2018). Ten steps in scale development and reporting: A guide for researchers. Communication Methods and Measures, 12(1), 25-44. https://doi.org/10.1080/19312458.2017.1396583

Carvajal, A., Centeno, C., Watson, R., Martínez, M., & Sanz Rubiales, A. (2011). ¿Cómo validar un instrumento de medida de la salud?. Anales del sistema sanitario de Navarra, 34(1), 63-72. https://recyt.fecyt.es/index.php/ASSN/article/view/10317

Chávez, G. & Merino, S. (2015). Validez estructural de la escala de autorregulación del aprendizaje para estudiantes universitarios. Revista digital de Investigación en Docencia Universitaria, 9(2). http://dx.doi.org/10.19083/ridu.9.453

CIFE (2018). Cuestionario de satisfacción con el instrumento (plantilla). Centro Universitario CIFE: México. https://bit.ly/4caTFLg

CIFE (2019). Escala Jueces Expertos (plantilla). Centro Universitario CIFE: México. https://bit.ly/4c2yZ8t

Connell, J., Carlton, J., Grundy, A., Taylor Buck, E., Keetharuth, A. D., Ricketts, T., ... & Brazier, J. (2018). The importance of content and face validity in instrument development: lessons learnt from service users when developing the Recovering Quality of Life measure (ReQoL). Quality of life research, 27, 1893-1902. https://doi.org/10.1007/s11136-018-1847-y

Córdoba, R. L. (2017). Recomendaciones sobre los procedimientos de construcción y validación de instrumentos y escalas de medición en la psicología de la salud. Psicología y salud, 27(1), 5-18. https://bit.ly/3P9V2zZ

Díaz, A., Pérez, M., González, J. & Núñez, J. (2017). Impacto de un entrenamiento en aprendizaje autorregulado en estudiantes universitarios. Perfiles Educativos, 39(157), 87-104. https://doi.org/10.22201/iisue.24486167e.2017.157.58442

Dignath, C. (2016). What determines whether teachers enhance self-regulated learning? Predicting teachers’ reported promotion of self-regulated learning by teacher beliefs, knowledge, and self-efficacy. Frontline Learning Research, 4(5), 83-105. https://doi.org/10.14786/flr.v4i5.247

Dignath, C., & Büttner, G. (2018). Teachers’ direct and indirect promotion of self-regulated learning in primary and secondary school mathematics classes–insights from video-based classroom observations and teacher interviews. Metacognition and Learning, 13, 127-157. https://doi.org/10.1007/s11409-018-9181-x

Dignath, C., & Veenman, M. V. (2021). The role of direct strategy instruction and indirect activation of self-regulated learning—Evidence from classroom observation studies. Educational Psychology Review, 33(2), 489-533. https://doi.org/10.1007/s10648-020-09534-0

Escobar-Pérez, J. & Cuervo- Martínez, A. (2008). Validez de contenido y juicio de expertos: una aproximación a su utilización. Avances en Medición, 6, 27-36. https://bit.ly/34Dze6P

Estévez-Méndez, J. L., & Moraleda, A. (2022). Gestión del tiempo en alumnos y docentes según la percepción del profesorado durante la pandemia COVID19. Revista De Estilos De Aprendizaje, 15(Especial), 158-169. https://doi.org/10.55777/rea.v15iEspecial.4414

Flores-Rivas, V. R., & Márquez, G. L. M. (2020). Logros de aprendizaje, herramientas tecnológicas y autorregulación del aprendizaje en tiempos de Covid 19. Journal of business and entrepreneurial studies, 4(3), 102-109. https://bit.ly/4a0LJKI

Ford, C. (2018). Effective practice instructional strategies: Design of an instrument to assess teachers’ perception of implementation. Studies in Educational Evaluation, 56, 154-163. https://doi.org/10.1016/j.stueduc.2017.12.004

Gaeta, M., Gaeta, L., & Rodríguez, M. (2021). Autoeficacia, estado emocional y autorregulación del aprendizaje en el estudiantado universitario durante la pandemia por COVID-19. Revista Actualidades Investigativas en Educación, 21(3), 1-24. http://dx.doi.org/10.15517/aie.v21i3.46280

García M. I., & Bustos C. R. (2021). La autorregulación del aprendizaje en tiempos de pandemia: una alternativa viable en el marco de los procesos educativos actuales. Diálogos sobre educación. Temas actuales en investigación educativa, 12(22). https://doi.org/10.32870/dse.v0i22.914

González, J. & Pazmiño, M. (2015). Cálculo e interpretación del Alfa de Cronbach para el caso de validación de la consistencia interna de un cuestionario, con dos posibles escalas tipo Likert. Revista Publicando, 2 (2), 62-77. https://bit.ly/4a0LX4w

Haynes, S.N., Richard, D.C.S. & Kubany, E.S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3), 238–247. https://doi.org/10.1037/1040-3590.7.3.238

Hermans, R., Van Braak, J. & Van Keer, H. (2008). Development of the beliefs about primary education scale: distinguishing a developmental and transmissive dimension. Teaching and Teacher Education, 21, 127–139. https://doi.org/10.1016/j.tate.2006.11.007

Hernández, A. & Camargo, A. (2017). Adaptación y validación del inventario de estrategias de autorregulación en estudiantes universitarios. Suma Psicológica, 24(1), 9-16. http://dx.doi.org/10.1016/j.sumpsi.2017.02.001

Hernández-Mosqueda, J.; Tobón, S. & Guerrero-Rosas, G. (2016). Hacia una evaluación integral del desempeño: las rúbricas socioformativas. Ra Ximhai, 12 (6), 359-376. https://doi.org/10.35197/rx.12.01.e3.2016.24.mh

Juárez-Hernández, L. G. (2018). Manual práctico de estadística básica para la investigación. Florida: Mount Dora. http://dx.doi.org/10.24944/isbn.978-1-945721-24-3

Juárez-Hernández, L. G., & Tobón, S. (2018). Análisis de los elementos implícitos en la validación de contenido de un instrumento de investigación. Revista espacios, 39(53). https://bit.ly/3wNek81

Juárez-Hernández, L. G., Tobón, S. & Cano-Jerónimo, A. (2017, 6- 7 de octubre). Caracterización y selección de expertos para la evaluación de un instrumento de investigación [Ponencia]. II Congreso Internacional de Evaluación del Desempeño (VALORA), Cuernavaca, México.

Latipah, E., Adi, H. C., & Insani, F. D. (2021). Academic Procrastination of High School Students During the Covid-19 Pandemic: Review from Self-Regulated Learning and the Intensity of Social Media. Dinamika Ilmu, 21(2), 293-308. http://doi.org/10.21093/di.v21i2.3444

Ley Federal de Protección de Datos Personales de Posesión de los Particulares, Diario Oficial de la Federación [DOF] (20 de marzo de 2025). https://bit.ly/4c6mtVo

Lombaerts, K., De Backer, F., Engels, N., Van Braak, J. & Athanasou, J. (2009). Development of the Self- Regulated Learning Teacher Belief Scale. European Journal of Psychology of Education, 24 (1), 79-96. https://bit.ly/43awflb

Madrigal, A. (2022). Estrategias y aprendizaje autónomo. Revista de Estilos de Aprendizaje, 15(Especial), 149-157. https://doi.org/10.55777/rea.v15iEspecial.4594

Montero, I. & León, O. (2005). Sistema de clasificación del método en los informes de investigación en psicología. International Journal of Clinical and Health Psychology, 5 (1), 115-127. https://bit.ly/3Pe3yOE

Nepal, K., & KC, S. K. (2020). Teachers’ Perception of the Students’ Readiness for Self-regulated Learning during the COVID-19 Pandemic. Journal of NELTA, 25(1-2), 167-178. https://doi.org/10.3126/nelta.v25i1-2.49739

Panadero, E. & Alonso-Tapia, J. (2014). Teorías de autorregulación educativa: una comparación y reflexión teórica. Psicología Educativa, 20 (1), 11–22. http://dx.doi.org/10.1016/j.pse.2014.05.002

Pelikan, E. R., Lüftenegger, M., Holzer, J., Korlat, S., Spiel, C., & Schober, B. (2021). Learning during COVID-19: the role of self-regulated learning, motivation, and procrastination for perceived competence. Zeitschrift für Erziehungswissenschaft, 24(2), 393-418. https://doi.org/10.1007/s11618-021-01002-x

Penfield, R.D., & Giacobbi, P.R., Jr. (2004). Applying a score confidence interval to Aiken item contentrelevance index. Measurement in Physical Education and Exercise Science, 8(4), 213-225. https://doi.org/10.1207/s15327841mpee0804_3

Sáez-Delgado, F., López-Angulo, Y., Mella-Norambuena, J., & Casanova, D. (2022). Prácticas docentes para promover la autorregulación del aprendizaje durante la pandemia COVID-19: escalas de medición y modelo predictivo. Formación universitaria, 15(1), 95-104. http://dx.doi.org/10.4067/S0718-50062022000100083

Sanabria, L., Valencia, N. & Ibáñez, J. (2017). Efecto del entrenamiento en autorregulación para el aprendizaje de la matemática. Praxis & Saber, 8 (16), 35-56. https://bit.ly/3PdBY3Y

Seufer, T. (2018). The interplay between self-regulation in learning and cognitive load. Educational Research Review, 24, 116-129. https://doi.org/10.1016/j.edurev.2018.03.004

Sun, Z., Xie, K. & Anderman, L. (2018). The role of self-regulated learning in students success in flipped undergraduate math courses. The internet and higher education, 36, 41-53. https://doi.org/10.1016/j.iheduc.2017.09.003

Tobón, S. (2017). Metodología de elaboración de una rúbrica socioformativa. CIFE. https://issuu.com/cife/docs/metodologia_rubrica_socioformativa_

Tobón, S., Guzmán, C., Hernández, J. & Cardona, S. (2015). Sociedad del Conocimiento: estudio documental desde una perspectiva humanista y compleja. Revista Paradigma, 36(2), 7 – 36. https://www.cife.edu.mx/campus/mod/page/view.php?id=5037

Tobón, S., Pimienta-Prieto, J., Herrera-Meza, S., Juárez-Hernández, L. & Hernández-Mosqueda, J. (2018). Validez y confiabilidad de una rúbrica para evaluar las prácticas pedagógicas en docentes de educación media (SOCME-10). Revista Espacios, 39 (53), 30. http://www.revistaespacios.com/cited2017/cited2017-30.pdf

Torrano, F., Fuentes, J., & Soria, M. (2017). Aprendizaje autorregulado: estado de la cuestión y retos psicopedagógicos. Perfiles Educativos, 39 (156), 160 - 173. https://bit.ly/2R9Xd9I

Uka, A., & Uka, A. (2020). The effect of students’ experience with the transition from primary to secondary school on self-regulated learning and motivation. Sustainability, 12(20), 8519. https://doi.org/10.3390/su12208519

Vandevelde, S., Vandenbussche, L., & Van Keer, H. (2012). Stimulating self-regulated learning in primary education: Encouraging versus hampering factors for teachers. Procedia-Social and Behavioral Sciences, 69, 1562-1571. https://doi.org/10.1016/j.sbspro.2012.12.099

Yusoff, M.S.B. (2019). ABC of content validation and content validity index calculation. Education in medicine journal, 11(2), 49-54. https://doi.org/10.21315/eimj2019.11.2.6.

Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In Handbook of self-regulation (pp. 13-39). Academic press. https://doi.org/10.1016/B978-012109890-2/50031-7

Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into practice, 41(2), 64-70. https://doi.org/10.1207/s15430421tip4102_2

PORTADA_COMITÉ EDITORIAL REA_78-122

Published

2025-04-27

How to Cite

González Robles, N. E., Juarez Hernández, L. G., & Herrera Meza, S. R. (2025). Rubric to assess the promotion of Self- Regulation of Learning: instrument validity and reliability study. Journal of Learning Styles, 18(35), 108–122. https://doi.org/10.55777/rea.v18i35.6783