Online collaborative learning to promote teachers’ evaluative thinking
Article Sidebar
Main Article Content
Abstract
The study focuses on how to strengthen teachers' evaluation skills in a social and collaborative dimension. The introduction of collaborative learning modes was tested within an institutional teacher training programme via LMS. Indeed, Computer Supported Collaborative Learning (CSCL) is considered appropriate for developing reflective skills through peer exchange. The article examines the Valu.Elearn programme, aimed at in-service teachers to strengthen their evaluative competence. The study focuses on two collaborative e-activities. A total of 166 teachers and two tutors participated in these activities during the school year 2021-22. The Community of Inquiry was used as a framework for analysing the content of the forums, while the interactions between participants were examined using sociocultural discourse analysis. The findings highlight the potential and limitations of the online environment for promoting collaborative reflection on evaluation issues.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons CC BY 4.0 Attribution 4.0 International License.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access)
References
Anderson, T., L. Rourke, D.R. Garrison, & W. Archer (2001). Assessing teaching presence in a computer conferencing context. Journal of Asynchronous Learning Networks, 5(2), 1-17. https://doi.org/10.24059/olj.v5i2.1875
Annand, D. (2019). Limitations of the Community of Inquiry Framework. International Journal of E-Learning & Distance Education, 34(2), 1-15.
Baker, M.J., Schwarz, B.B., & Ludvigsen, S.R. (2021). Educational dialogues and computer supported collaborative learning: critical analysis and research perspectives. International Journal of Computer Supported Collaborative Learning, 16, 583–604. https://doi.org/10.1007/s11412-021-09359-1
Barzanò, G. (2002). School Self-evaluation Towards a European Dimension. European Journal of Teacher Education, 25(1), 83-100. https://doi.org/10.1080/0261976022000012886
Booth, T., & Ainscow, M. (2011). Index for Inclusion: Developing Learning and Participation in Schools. Centre for Studies on Inclusive Education.
Brown, J. S., & Duguid, P. (2001). Structure and Spontaneity: Knowledge and organization. in Nonaka, I. & Teece, D. J. (Eds.) Managing Industrial Knowledge. Creation, Transfer and Utilization (pp. 44-67). Sage Publications.
Brown, C., & Malin, J. (Eds.) (2022). The Emerald Handbook of Evidence Informed Practice in Education. Learning from International Contexts. Emerald Publishing Limited.
Brown, C., Poortman, C., Gray, H., Ophoff, J. G., & Wharf., M. M. (2021). Facilitating Collaborative Reflective Inquiry Amongst Teachers: What Do We Currently Know? International Journal of Educational Research, 105, Article 101695. https://doi.org/10.1016/j.ijer.2020.101695
Calvani, A., Fini, A., Molino, M., & Ranieri, M. (2010). Visualizing and monitoring effective interactions in online collaborative groups. British Journal of Educational Technology, 41(2), 213-226. https://doi.org/10.1111/j.1467-8535.2008.00911.x
Chapman, C., & Sammons, P. (2013). School Self-Evaluation for School Improvement: What Works and Why? CfBT Education Trust.
Chapman, C. (2018). School-to-school collaboration: Building collective capacity through collaborative enquiry. In Eddy-Spicer, D. H., Connolly, M., S. D., & James, C. (Eds.) The SAGE handbook of school organization (pp. 540-561). Sage.
Dewey, J. (1933). How we think. Heath.
Dille, K. B., & Røkenes, F. M. (2021). Teachers’ professional development in formal online communities: A scoping review. Teaching and teacher education, 105, 103431. https://doi.org/10.1016/j.tate.2021.103431
European Commission/EACEA/Eurydice (2015). Assuring Quality in Education: Policies and Approaches to School Evaluation in Europe. Eurydice Report. Publications Office of the European Union.
Fu, E.L.F., van Aalst, J., & Chan, C.K.K. (2016). Toward a classification of discourse patterns in asynchronous online discussions. International Journal of Computer-Supported Collaborative Learning, 11, 441-478. https://doi.org/10.1007/s11412-016-9245-3
Garrison, D.R., Anderson, T., & Archer, W. (1999). Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education. The Internet and Higher Education, 2(2-3), 87-105. https://doi.org/10.1016/S1096-7516(00)00016-6
Garrison, D. R. (2007). Online Community of Inquiry Review: Social, Cognitive, and Teaching Presence Issues. Journal of Asynchronous Learning Networks 5(1), 61-72. https://doi.org/10.24059/olj.v11i1.1737
Garrison, D. R. (2009). Communities of Inquiry in Online Learning. In P. Rogers, G. Berg, J. Boettcher, C. Howard, L. Justice, & K. Schenk (Eds.), Encyclopedia of Distance Learning, Second Edition (pp. 352-355). IGI Global. https://doi.org/10.4018/978-1-60566-198-8.ch052
Giampietro, L., Pillera, G. C., & Poliandri, D. (2023). Pratiche di apprendimento collaborativo tra scuole: peer review e visiting a supporto dell’autovalutazione delle scuole. Annali online della Didattica e della Formazione Docente, 15(26), 206-225. https://doi.org/10.15160/2038-1034/2768
Godfrey, D., & Brown, C. (2019). Innovative models that bridge the research–practice divide: Research learning communities and research-informed peer review. In An ecosystem for research-engaged schools (pp. 91-107). Routledge.
Godfrey, D. (2020). From peer review to collaborative peer enquiry: Action research for school improvement and leadership development. London Review of Education, 18(3), 373–89. https://doi.org/10.14324/LRE.18.3.04
Haythornthwaite, C. (2009). Crowds, and Communities: Light and Heavyweight Models of Peer Production. In Proceedings of the 42nd Annual Hawaii International Conference on System Sciences, Waikoloa, HI, USA, 2009 (pp. 1-10). doi: 10.1109/HICSS.2009.137
Johnson, M., & Mercer, N. (2019). Using sociocultural discourse analysis to analyse professional discourse. Learning, Culture and Social Interaction, 21, 267-277. https://doi.org/10.1016/j.lcsi.2019.04.003
Kaczkó, É. Ostendorf, A. (2023). Critical thinking in the community of inquiry framework: An analysis of the theoretical model and cognitive presence coding schemes. Computers & Education, 193, 104662, https://doi.org/10.1016/j.compedu.2022.104662
Khodabandelou, R., Vahdani Asadi, M. R., Ghasemi, M., & Amerian, M. (2024). More than two decades of community of inquiry research: A comprehensive bibliometric analysis. E-Learning and Digital Media, 0(0). https://doi.org/10.1177/20427530241239418
Kollar, I., Fischer, F., & Hesse, F. W. (2006). Collaboration scripts: A conceptual analysis. Educational Psychology Review, 18(2), 159-185. https://doi.org/10.1007/s10648-006-9007-2
Kippers, W. B., Poortman, C. L., Schildkamp, K., & Visscher, A. J. (2018). Data literacy: What do educators learn and struggle with during a data use intervention? Studies in educational evaluation, 56, 21-31. https://doi.org/10.1016/j.stueduc.2017.11.001
Krippendorf, K. (2004). Content analysis: An introduction to its methodology (2nd ed.). Sage.
Lai, M. K., & McNaughton, S. (2013). Analysis and discussion of classroom and achievement data to raise student achievement. In Schildkamp, K., Lai, M.K., & Earl, L. (Eds.), Data-based decision making in education: Challenges and opportunities (pp. 23-47). Springer. https://doi.org/10.1007/978-94-007-4816-3_3
Lantz-Andersson, A., Lundin, M., & Selwyn, N. (2018). Twenty years of online teacher communities: A systematic review of formally-organized and informally-developed professional learning groups. Teaching and Teacher Education: An International Journal of Research and Studies, 75(1), 302-315. https://doi.org/10.1016/j.tate.2018.07.008
Lave, J., & Wenger, E. (1991). Situated Learning: Legitimate Peripheral Participation. Cambridge University Press.
Lincon, Y.S., Guba, E.G. (1985). Naturalistic inquiry. Sage.
Littleton, K., & Mercer, N. (2013). Interthinking: Putting Talk to Work. Routledge.
Ludvigsen, S., & Mørch, A. (2010). Computer-supported collaborative learning: Basic concepts, multiple perspectives, and emerging trends. The international Encyclopedia of Education, 5, 290-296.
MacBeath, J. (1999). Schools must speak for themselves. The case for school self-evaluation. Routledge.
Mandinach, E.B, & Gummer, E.S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366-376. https://doi.org/10.1016/j.tate.2016.07.011
McNamara, G., & O’Hara, J. (2008). The importance of the concept of self-evaluation in the changing landscape of education policy. Studies in Educational Evaluation, 34(3), 173-179. https://doi.org/10.1016/j.stueduc.2008.08.001
McNamara, G., Skerritt, C., O’Hara, J., O’Brien, S., & Brown, M. (2022). For improvement, accountability, or the economy? Reflecting on the purpose (s) of school self-evaluation in Ireland. Journal of Educational Administration and History, 54(2), 158-173. https://doi.org/10.1080/00220620.2021.1985439
Mentini, L., & Levatino, A. (2024). A “three-legged model”: (De) constructing school autonomy, accountability, and innovation in the Italian National Evaluation System. European Educational Research Journal, 23(3), 321-346. https://doi.org/10.1177/147490412211482
Mercer, N. (2000). Words & Minds: How We Use Language to Think Together. Routledge.
Mercer, N. (2004). Sociocultural discourse analysis: analysing classroom talk as a social mode of thinking. Journal of Applied Linguistics, 1(2), 137-168. https://doi.org/10.1558/japl.v1.i2.137
O’Connor, C., & Joffe, H. (2020). Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines. International Journal of Qualitative Methods, 19. https://doi.org/10.1177/1609406919899220
Poliandri D., Perazzolo M., Pillera, G. C., & Giampietro, L. (2022). Un’opportunità di formazione sull’autovalutazione delle scuole. Annali online della didattica e della formazione docente, 14(23), 169 - 184. https://doi.org/10.15160/2038-1034/2413
Poliandri D., Perazzolo M., Pillera, G. C., & Giampietro, L. (2023) Dematerialized participation challenges: Methods and practices for online focus groups. Frontiers in Sociology, 8, Article 1145264. https://doi.org/10.3389/fsoc.2023.1145264
Romiti, S., Fabbro, F., & Mattarelli, E. (2023a). Valu.Elearn. Un programma di formazione online per accrescere la competenza valutativa del personale scolastico. Lifelong Lifewide Learning, 19(42), 135-145. https://doi.org/10.19241/lll.v19i42.725
Romiti, S., Fabbro, F., & Mattarelli, E. (2023b). Collective feedback as a formative assessment practice in an e-learning platform for teachers’ professional development. Q-Times Webmagazine, 2(1), 563-576. doi: 10.14668/QTimes_15176
Ryan, K. E., Chandler, M., & Samuels, M. (2007). What should school-based evaluation look like? Studies in Educational Evaluation, 33(3-4), 197-212. https://doi.org/10.1016/j.stueduc.2007.07.001
Savery, J. R. (2006). Overview of Problem-based Learning: Definitions and Distinctions. Interdisciplinary Journal of Problem-Based Learning, 1(1), 9-20. :https://doi.org/10.7771/1541-5015.1002
Sannicandro, K., Santis, A. D., Bellini, C., & Minerva, T. (2019). Analysis of completion and dropout rates in EduOpen MOOCs. Italian Journal of Educational Research, 12, 27–42. https://dx.doi.org/10.7346/SIRD-2S2019-P27
Scardamalia, M., & Bereiter, C. (2014). Knowledge building and knowledge creation: Theory, pedagogy, and technology. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 397–417). Cambridge University Press.
Scheerens, J., Glas, C., & Thomas, S.M. (2003). Educational Evaluation, Assessment, and Monitoring. A Systemic approach. Swetz & Zeitlinger Publishers.
Schildkamp, K., Poortman, C.L., Ebbeler, J., & Pieters, J.M. (2019). How school leaders can build effective data teams: Five building blocks for a new wave of data-informed decision making. Journal of Educational Change, 20, 283–325. https://doi.org/10.1007/s10833-019-09345-3
van Aalst, J. (2009). Distinguishing knowledge-sharing, knowledge-construction, and knowledge-creation discourses. International Journal of Computer-Supported Collaborative Learning, 4, 259–287. https://doi.org/10.1007/s11412-009-9069-5
van der Scheer, E. A., Glas, C. A., & Visscher, A. J. (2017). Changes in teachers’ instructional skills during an intensive data-based decision making intervention. Teaching and teacher education, 65, 171-182. https://doi.org/10.1016/j.tate.2017.02.018
Wise, A.F., & Schwarz, B.B. (2017). Visions of CSCL: eight provocations for the future of the field. International Journal of Computer Supported Collaborative Learning, 12, 423–467. https://doi.org/10.1007/s11412-017-9267-5
Young, C., McNamara, G., Brown, M., & O’Hara, J. (2018). Adopting and adapting: school leaders in the age of data-informed decision making. Educational Assessment, Evaluation and Accountability, 30, 133–158 (2018). https://doi.org/10.1007/s11092-018-9278-4