Adaptation and validation of a rubric for teamwork skills in collaborative learning
DOI:
https://doi.org/10.33010/ie_rie_rediech.v14i0.1870Keywords:
Collaborative learning, assessment instrument, soft skills, team work, TeamUpAbstract
TeamUp is a rubric for evaluating teamwork skills in a collaborative learning context in face-to-face and virtual environments. This work presents the adaptation and validation process of TeamUp for Mexican high school students. First, the TeamUp rubric was translated into Spanish, afterward, a validation was conducted with five expert judges, who evaluated the translated rubric using various criteria. The calculation of the content validity coefficient placed 23 items at a good level of validity and agreement (³ 0.8), while the remaining 10 had an excellent level in the same categories (³ 0.9). The Cronbach’s Alpha coefficient calculated with responses from 309 high school students showed that TeamUp has high reliability (> 0.9). The results reflected by TeamUp in this work present it as a robust proposal for teaching and developing teamwork skills for adolescents in collaborative learning. The Spanish used in this rubric is suitable for Mexican adolescents, and future adaptations suggest modifying the language for the audience of other Spanish-speaking regions.
References
Alaoutinen, S., Heikkinen, K., y Porras, J. (2012). Experiences of learning styles in an intensive collaborative course. International Journal of Technology and Design Education, 22(1), 25-49. https://doi.org/10.1007/s10798-010-9135-3
Child, S., y Shaw, S. (2016). Collaboration in the 21st century: Implications for assessment. A Cambridge Assessment Publication, 22, 17-22. https://www.cambridgeassessment.org.uk/Images/322752-research-matters-22-summer-2016.pdf
Collazos, C. (2006). Cómo aprovechar el “aprendizaje colaborativo” en el aula. Educación y Educadores, 9(4128), 61-76. https://www.redalyc.org/pdf/834/83490204.pdf
Collazos, C., Muñoz, J., y Hernández, Y. (2014). Aprendizaje colaborativo apoyado por computador. Iniciativa Latinoamericana de Libros de Texto Abierto.
Dermody, C., Dusenbury, L., y Duchesneau, N. (2022). State policy bright spots?: Social and emotional learning end equity. https://casel.org/state-policy-bright-spots-equity/
Devedzic, V., Tomic, B., Jovanovic, J., Kelly, M., Milikic, N., Dimitrijevic, S., Djuric, D., y Sevarac, Z. (2018). Metrics for students’ soft skills. Applied Measurement in Education, 31(4), 283-296. https://doi.org/10.1080/08957347.2018.1495212
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., y Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405-432. https://doi.org/10.1111/j.1467-8624.2010.01564.x
Escobar-Pérez, J., y Cuervo-Martínez, Á. (2008). Validez de contenido y juicio de expertos: una aproximación a su utilización. Avances en Medición, 6(1), 27-36.
Espinoza, M. A., y Gallegos, D. (2020). Habilidades blandas en la educación y la empresa: mapeo sistemático. Revista Científica UIsrael, 7(2), 39-56. https://doi.org/10.35290/RCUI.V7N2.2020.245
Freeman, L., y Greenacre, L. (2011). An examination of socially destructive behaviors in group work. Journal of Marketing Education, 33(1), 5-17. https://doi.org/10.1177/0273475310389150
Fu, Q. K., y Hwang, G. J. (2018). Trends in mobile technology-supported collaborative learning: A systematic review of journal publications from 2007 to 2016. Computers and Education, 119, 129-143. https://doi.org/10.1016/j.compedu.2018.01.004
Handayani, N. D., Mantra, I. B. N., y Suwandi, I. N. (2019). Integrating collaborative learning in cyclic learning sessions to promote students’ reading comprehension and critical thinking. International Research Journal of Management, IT and Social Sciences, 6(5), 303-308. https://doi.org/10.21744/irjmis.v6n5.777
Hastie, C. R. (2018). ‘TeamUP’: An approach to developing teamwork skills in undergraduate midwifery students. Midwifery, 58, 93-95. https://doi.org/10.1016/j.midw.2017.12.026
Hastie, C., Fahy, K., y Parratt, J. (2014). The development of a rubric for peer assessment of individual teamwork skills in undergraduate midwifery students. Women and Birth, 27(3), 220-226. https://doi.org/10.1016/j.wombi.2014.06.003
Hernández-Nieto, R. (2002). Contributions to statistical analysis. Universidad de los Andes.
Hyrkäs, K., Appelqvist-Schmidlechner, K., y Oksa, L. (2003). Validating an instrument for clinical supervision using an expert panel. International Journal of Nursing Studies, 40(6), 619-625. https://doi.org/10.1016/S0020-7489(03)00036-1
Johnson, D. W., y Johnson, R. T. (1994). An overview of cooperative learning. En J. Thousand (ed.), Creativity and collaborative learning. Brookes Press.
Johnson, D. W., y Johnson, R. T. (2002). Learning together and alone: Overview and meta-analysis. Asia Pacific Journal of Education, 22(1), 95-105. https://doi.org/10.1080/0218879020220110
Johnson, D. W., Johnson, R. T., y Smith, K. (2007). The state of cooperative learning in postsecondary and professional settings. Educational Psychology Review, 19(1), 15-29. https://doi.org/10.1007/s10648-006-9038-8
Johnson, D. W., Johnson, R. T., y Stanne, M. B. (2000). Cooperative learning methods: A meta-analysis. Methods of cooperative learning: What can we prove works, 1-30. http://www.tablelearning.com/uploads/File/EXHIBIT_B.pdf
Kuhn, D. (2015). Thinking together and alone. Educational Researcher, 44(1), 46-53. https://doi.org/10.3102/0013189X15569530
Kutnick, P., y Berdondini, L. (2009). Can the enhancement of group working in classrooms provide a basis for effective communication in support of school-based cognitive achievement in classrooms of young learners? Cambridge Journal of Education, 39(1), 71-94. https://doi.org/10.1080/03057640902836880
Le, H., Janssen, J., y Wubbels, T. (2018). Collaborative learning practices: Teacher and student perceived obstacles to effective student collaboration. Cambridge Journal of Education, 48(1), 103-122. https://doi.org/10.1080/0305764X.2016.1259389
Mahatma Gandhi Institute of Education for Peace and Sustainable Development (2018). Policy brief: Rethinking schooling for the 21st century. https://unesdoc.unesco.org/ark:/48223/pf0000366297
Meijer, H., Hoekstra, R., Brouwer, J., y Strijbos, J. W. (2020). Unfolding collaborative learning assessment literacy: A reflection on current assessment methods in higher education. Assessment and Evaluation in Higher Education, 45(8), 1222-1240. https://doi.org/10.1080/02602938.2020.1729696
OECD [The Organization for Economic Cooperation and Development] (2017). PISA 2015 collaborative problem solving framework. En PISA 2015 assessment and analytical framework: Science, reading, mathematic, financial literacy and collaborative problem solving (pp. 131-189). https://doi.org/https://doi.org/10.1787/9789264281820-8-en
OECD (2019). OECD skills outlook 2019: Thriving in a digital world. https://doi.org/10.1787/df80bc12-en
OECD (2021). OECD skills outlook 2021: Learning for life. https://doi.org/10.1787/0ae365b4-en
Orellana, P., Gorrochotegui, A., Lagomarsino, R., y Mies, R. (2014). Desarrollo de un instrumento para monitorear la adquisición de habilidades de trabajo en equipo en estudiantes de carreras de educación. Investigación y Postgrado, 29(1), 103-108. https://www.redalyc.org/pdf/658/65848192005.pdf
Oviedo, C. y Campo-Arias, A. (2005). Aproximación al uso coeficiente Alfa de Cronbach. Revista Colombiana de Psquiatría, 34(4), 572-580. https://doi.org/10.1590/S1135-57272002000200001
Parratt, J. A., Fahy, K. M., Hutchinson, M., Lohmann, G., Hastie, C. R., Chaseling, M., y O’Brien, K. (2016). Expert validation of a teamwork assessment rubric: A modified Delphi study. Nurse Education Today, 36, 77-85. https://doi.org/10.1016/j.nedt.2015.07.023
Pedrosa, I., Suárez-Álvarez, J., y García-Cueto, E. (2013). Evidencias sobre la validez de contenido: Avances teóricos y métodos para su estimación. Acción Psicológica, 10(2), 3-18. https://doi.org/10.5944/ap.10.2.11820
Pendergast, D., Main, K., y Bahr, N. (2020). Cooperative and collaborative learning. In Teaching middle years: Rethinking curriculum, pedagogy and assessment (3a. ed., pp. 189-205). Routledge.
Prieto, G., y Delgado, A. R. (2010). Fiabilidad y validez. Papeles del Psicólogo, 31(1), 67-74. http://www.redalyc.org/pdf/778/77812441007.pdf%0Ahttp://www.papelesdelpsicologo.es/pdf/1797.pdf
Ritter, B. A., Small, E. E., Mortimer, J. W., y Doll, J. L. (2018). Designing management curriculum for workplace readiness: Developing students’ soft skills. Journal of Management Education, 42(1), 80-103. https://doi.org/10.1177/1052562917703679
Roberts, R. D., Martin, J. E., y Olaru, G. (2015). A Rosetta stone for noncognitive skills: Understanding, assessing, and enhancing noncognitive skills in primary and secondary education. Asia Society/Professional Examination Services. https://learningportal.iiep.unesco.org/en/library/a-rosetta-stone-for-noncognitive-skills-understanding-assessing-and-enhancing-noncognitive
Rodríguez-Rodríguez, J., y Reguant-Álvarez, M. (2020). Calcular la fiabilidad de un cuestionario o escala mediante el SPSS: el coeficiente alfa de Cronbach. REIRE Revista d’Innovació i Recerca en Educació, 13(2), 1-13. https://doi.org/10.1344/reire2020.13.230048
Sjølie, E., Strømme, A., y Boks-Vlemmix, J. (2021). Team-skills training and real-time facilitation as a means for developing student teachers’ learning of collaboration. Teaching and Teacher Education, 107, 103477. https://doi.org/10.1016/J.TATE.2021.103477
UNESCO (2021). Assessment of socioemotional skills among children and teenagers of Latin America: Framework for the ERCE 2019 module work. Regional Comparative and Explanatory Study (ERCE 2019). https://unesdoc.unesco.org/ark:/48223/pf0000377512_eng?posInSet=1&queryId=08cc4e3f-2bdf-4a6a-b93c-558477f8097b
Yu, M. V. B., Liu, Y., Hsieh, T.-Y., Lee, G., Simpkins, S. D., y Pantano, A. (2022). “Working together as a team really gets them fired up”: Afterschool program mentoring strategies to promote collaborative learning among adolescent participants. Applied Developmental Science, 26(2), 347-361. https://doi.org/10.1080/10888691.2020.1800467
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Liliana Martínez-Venegas, Laura Sanely Gaytán Lugo, Carolyn Ruth Hastie
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
