Effectiveness of Collaboration Skills Assessment Instrument in Physics Practicum: A Case Study with the Rasch Model
DOI:
https://doi.org/10.38035/dijemss.v6i2.3661Keywords:
Collaboration Skills, Rasch model, reliability, suitabilityAbstract
Collaboration skills in the 21st century are becoming an important aspect in education and the professional world. This study aims to analyse the validity and reliability of collaboration skills instruments using the Rasch Model. Quantitative method with survey design was applied to 100 students of Physics Education Study Programme at Universitas Lambung Mangkurat. Data was collected through a questionnaire consisting of 20 items, and analysis was conducted to measure item difficulty as well as individual ability using Rasch Model. The analysis results showed that after data cleaning, the assessment instrument had good reliability, with Person Reliability reaching 0.80 and Item Reliability 0.90. Results also identified that the most difficult collaboration skills to achieve were individual accountability and personal responsibility, whereas positive interdependence was relatively easier to achieve. This research provides important insights for collaboration skills assessment instruments in the context of physics education practicum, as well as recommendations for improving collaboration skills.
References
Aguado, V., Sorrel, M. A., Corral, S., & Martínez-Pampliega, A. (2024). Levels of Expressed Emotion Scale: Spanish validation for the general adolescent population and development of a short version.
Almubarak, A. (2023). Assessing students understanding of chemical bonds material by rasch modelling. Indonesian Journal on Learning and Advanced Education (Ijolae), 5(3), 217-232. https://doi.org/10.23917/ijolae.v5i3.22242
Anggita, G., Fatmaryanti, S. D., Ashari, A., & Kurniawan, E. S. (2023). Designing interactive electronic module with collaborative team work in physics learning. Radiation: Journal of Physics Education Periodical, 16(2), 80-89. https://doi.org/10.37729/radiasi.v16i2.3556
Aslano?lu, A. and ?ata, M. (2023). Examining the rater drift in the assessment of presentation skills in secondary school context. E?itimde Ve Psycholojide Ölçme Ve De?erlendirme Dergisi, 14(1), 62-75. https://doi.org/10.21031/epod.1213969
Bennett, R. (2023). Refinement and validation of the empowerment audiology questionnaire: rasch analysis and traditional psychometric evaluation. Ear & Hearing. https://doi.org/10.1097/aud.0000000000001449
Belli, S. and Nenoff, J. (2022). Cooperation in science and innovation between latin america and the european union. Journal of Open Innovation Technology Market and Complexity, 8(2), 94. https://doi.org/10.3390/joitmc8020094
Bryan, R. R., Glynn, S. M., & Kittleson, J. M. (2011). Motivation, achievement, and advanced placement intentions of high school students learning science. Science education, 95(6), 1049-1065.
Bueno-Sánchez, L., Alhambra-Borrás, T., Bonilla-Campos, A., & Durá-Ferrandis, E. (2024). Psychometric characteristics of the core FertiQoL questionnaire in a Spanish sample of infertile women. Anales de Psicología/Annals of Psychology, 40(3), 364-372.
Cavaco, S., Gonçalves, A., Pinto, C., Almeida, E., Gomes, F., Moreira, I., ... & Teixeira-Pinto, A. (2013). Trail Making Test: Regression-based norms for the Portuguese population. Archives of clinical neuropsychology, 28(2), 189-198.
Chang, C., Chang, M., Liu, C., Chiu, B., Chiang, S., Chen, W., ... & Chai, C. (2017). An analysis of collaborative problem-solving activities mediated by individual-based and collaborative computer simulations. Journal of Computer Assisted Learning, 33(6), 649-662. https://doi.org/10.1111/jcal.12208
Hall, K., Vogel, A., Huang, G., Serrano, K., Rice, E., Tsakraklides, S., ... & Fiore, S. (2018). The science of team science: a review of the empirical evidence and research gaps on collaboration in science. American Psychologist, 73(4), 532-548. https://doi.org/10.1037/amp0000319
Dhina, M., Hadisoebroto, G., Mubaroq, S., & Gustiana, I. (2021). Implementation of digital performance assessment to measure pharmacy physics laboratory skills. Momentum Physics Education Journal, 65-72. https://doi.org/10.21067/mpej.v5i1.5146
Firmansyah, J., Suhandi, A., Setiawan, A., & Permanasari, A. (2022). Evaluation of virtual workspace laboratory: cloud communication and collaborative work on project-based laboratory. Journal on Efficiency and Responsibility in Education and Science, 15(3), 131-141. https://doi.org/10.7160/eriesj.2022.150301
Futri, V. I., Rosnawati, R., & Rahim, A. (2022). Rasch Model Study on Mathematics Examination Test Using Item Response Theory Approach. International Journal on Emerging Mathematics Education (IJEME), 6(1).
Garrison, D. R., Anderson, T., & Archer, W. (2020). Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of Distance Education, 15(1), 7-23.
Hall, K., Vogel, A., Huang, G., Serrano, K., Rice, E., Tsakraklides, S., ... & Fiore, S. (2018). The science of team science: a review of the empirical evidence and research gaps on collaboration in science... American Psychologist, 73(4), 532-548. https://doi.org/10.1037/amp0000319
Hattie, J., & Timperley, H. (2019). The power of feedback. Review of Educational Research, 89(3), 248-272.
Hedlund, J., Bodin, Ö., & Nohrstedt, D. (2020). Policy issue interdependency and the formation of collaborative networks. People and Nature, 3(1), 236-250. https://doi.org/10.1002/pan3.10170
Hendarwati, E., Nurlaela, L., & Bachri, B. (2021). Collaborative problem-solving based on mobile multimedia. International Journal of Interactive Mobile Technologies (Ijim), 15(13), 16. https://doi.org/10.3991/ijim.v15i13.23765
Hidayat, M. L., Astuti, D. S., Sumintono, B., Meccawy, M., & Khanzada, T. J. (2023). Digital competency mapping dataset of pre-service teachers in Indonesia. Data in Brief, 49, 109310.
Khairani, M., Jasruddin, J., & Arsyad, M. (2024). The effect of stem approach and student's collaboration ability on physics problem solving skill. International Journal of Social Science and Human Research, 07(03). https://doi.org/10.47191/ijsshr/v7-i03-22
Kurniawan, D., Kurniawan, D., & Irdianti, I. (2019). Physics education students' science process skills. International Journal of Evaluation and Research in Education (Ijere), 8(2), 293. https://doi.org/10.11591/ijere.v8i2.16401
Kustijono, R. (2018). The effect of scientific attitudes toward science process skills in basic physics practicum by using peer model. International Journal of GEOMATE, 15(50). https://doi.org/10.21660/2018.50.ijcst50
Leske, D., Holmes, J., Melia, B., Miller, A., Jackson, J., Suh, D., ... & Kieser, T. (2015). Evaluation of the intermittent exotropia questionnaire using rasch analysis. Jama Ophthalmology, 133(4), 461. https://doi.org/10.1001/jamaophthalmol.2014.5622
Milton, J., Andersson, A., Åberg, N. D., Gillespie, B. M., & Oxelmark, L. (2022). Healthcare professionals' perceptions of interprofessional teamwork in the emergency department: a critical incident study. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 30(1). https://doi.org/10.1186/s13049-022-01034-0
Pilowsky, J. K., Elliott, R., & Roche, M. A. (2024). Data cleaning for clinician researchers: Application and explanation of a data-quality framework. Australian Critical Care.
Planini?, M., Boone, W., Sušac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: why measurement matters. Physical Review Physics Education Research, 15(2). https://doi.org/10.1103/physrevphyseducres.15.020111
Rosidin, U., Sesunan, F., & Fitria, D. (2022). Development of assessment instruments to measure collaboration and responsibility skills of students in physics learning on cased method-based. AMPLITUDO: Journal of Science and Technology Innovation, 1(2), 29-35. https://doi.org/10.56566/amplitudo.v1i2.7
Schnaubert, L. and Bodemer, D. (2018). What interdependence can tell us about collaborative learning: a statistical and psychological perspective. Research and Practice in Technology Enhanced Learning, 13(1). https://doi.org/10.1186/s41039-018-0084-x
Sebok-Syer, S., Chahine, S., Watling, C., Goldszmidt, M., Cristancho, S., & Lingard, L. (2018). Considering the interdependence of clinical performance: implications for assessment and entrustment. Medical Education, 52(9), 970-980. https://doi.org/10.1111/medu.13588
Shimizu, I., Kikukawa, M., Tada, T., Kimura, T., Duvivier, R., & Vleuten, C. (2020). Measuring social interdependence in collaborative learning: instrument development and validation. BMC Medical Education, 20(1). https://doi.org/10.1186/s12909-020-02088-3
Siswanto, S., Trisnowati, E., Firmadani, F., Haryati, S., Aryanti, D., & Andrianto, H. (2020). Workshop on inquiry learning based on virtual laboratory in Magelang for preparing natural sciences teachers in 21st century: an evaluation of implementation's programme. Indonesian Journal of Education and Learning, 3(2), 367. https://doi.org/10.31002/ijel.v3i2.3036
Smith, J., Johnson, L., & Lee, R. (2022). Collaborative skills in education: A comprehensive guide. Educational Psychology Review, 34(4), 567-589.
Sung, Y., Kim, H., Joo, S., Kim, S., Ndosi, M., & Cho, S. (2020). Developing the korean educational needs assessment tool (korean enat) in rheumatoid arthritis: cross-cultural validation using rasch analysis. The Korean Journal of Internal Medicine. https://doi.org/10.3904/kjim.2019.422
Torrado, M., Blanca, M. J., & García-Castro, F. J. (2024). Future anxiety in young Spanish adults: Psychometric properties of the Dark Future Scale. Anales de Psicología/Annals of Psychology, 40(1), 31-37.
Widoretno, S. and Hidayati, N. (2022). Reflection on student collaboration skills assessment by biology teachers. Journal of Science Education Research, 8(3), 1102-1107. https://doi.org/10.29303/jppipa.v8i3.1258
Yang, S., Tsou, M., Chen, E., Chan, K., & Chang, K. (2011). Statistical item analysis of the examination in anaesthesiology for medical students using the rasch model. Journal of the Chinese Medical Association, 74(3), 125-129. https://doi.org/10.1016/j.jcma.2011.01.027
Zhong, Q. (2021). Fostering group autonomy through collaborative learning in an online environment. Studies in Self-Access Learning Journal, 79-91. https://doi.org/10.37237/120106
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Saiyidah Mahtari, Syihabuddin Syihabuddin, Agus Setiawan, Mustika Wati
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish their manuscripts in this journal agree to the following conditions:
- The copyright on each article belongs to the author(s).
- The author acknowledges that the Dinasti International Journal of Education Management and Social Science (DIJEMSS) has the right to be the first to publish with a Creative Commons Attribution 4.0 International license (Attribution 4.0 International (CC BY 4.0).
- Authors can submit articles separately, arrange for the non-exclusive distribution of manuscripts that have been published in this journal into other versions (e.g., sent to the author's institutional repository, publication into books, etc.), by acknowledging that the manuscript has been published for the first time in the Dinasti International Journal of Education Management and Social Science (DIJEMSS).
