Detecting Differential Item Functioning in the Measurement of Ethnomathematical Knowledge among Preservice Teachers: A Rasch Analysis
Abstract
This study examines Differential Item Functioning (DIF) in an instrument developed to measure preservice mathematics teachers’ ethnomathematical knowledge in Jambi. Anchored in the Rasch measurement framework, this study employs a quantitative ex post facto design to evaluate item‑level measurement invariance of an ethnomathematics assessment instrument. Rasch‑based procedures: item and person parameter estimation, fit statistics, and DIF analyses were employed to assess item equivalence across gender, educational background, and teaching experience, and to quantify the magnitude of any detected DIF. Data from 150 preservice teachers were analyzed using Rasch estimation and Mantel–Haenszel DIF on a culturally contextualized ethnomathematics instrument. Descriptive analyses indicated strong psychometric properties of the instrument, with person reliability = 0.81, item reliability = 0.97, and fit statistics falling within acceptable ranges. DIF analyses revealed several items with statistically significant DIF predominantly across gender, while the majority of items demonstrated stable functioning across the examined participant subgroups. Graphical DIF plots revealed heterogeneous item‑response patterns in the ethnomathematics instrument, highlighting the need for culturally responsive item revision to reduce bias. Findings demonstrate the Rasch model’s effectiveness in detecting item‑level bias in instruments measuring preservice teachers’ ethnomathematical knowledge and substantiate targeted refinement of measurement instruments.
Keywords
Full Text:
PDFReferences
Andrich, D. (2009). Rasch Model for Measurement. Sage University.
Atmaja, T. S. (2023). The Urgency Of Character Education In Educational Units In Indonesia In Facing Global Challenges And 21st Century Competencies. Jurnal Scientia, 12(04), 2014–2019.
Bahar, M., Wahyuni, A., & Saputra, M. A. (2023). Educational Values in Lubuk Larangan Local Wisdom in Rantau Pandan Village, Bungo Regency, Jambi Province. QALAMUNA: Jurnal Pendidikan, Sosial, Dan Agama, 15(2), 999–1006.
Biddix, P. (2017). Instrument, Validity, Reliability | Research Rundowns. In University of Missouri - St. Louis (p. 3). https://researchrundowns.com/quantitative-methods/instrument-validity-reliability/
Cohen, A. S., Kim, S., & Baker, F. B. (1993). Detection of Differential Item Functioning in the Graded Response Model. Applied Psychological Measurement, 17(4), 335–350.
Dorans, N. J., Carlson, J., Bridgeman, B., Golub-smith, M., & Greenwood, R. (2013). Constructed-Response DIF Evaluations for Mixed-Format Tests. December.
Ergene, Ö., Ergene, B. Ç., & YAZICI, E. (2020). Ethnomathematics activities: reflections from the design and implementation process. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 11(2), 402–437.
Falani, I., Iriyadi, D., Wardani, I. Y., Susanti, H., & Nasution, R. A. (2022). A Rasch Analysis of Perceived Stigma of Covid-19 among Nurses in Indonesia Questionnaire. Psychological Thought, 15(1), 12–28. https://doi.org/10.37708/psyct.v15i1.530
Fischer, G. H., Molenaar, I. W., & Ivo W, M. (1999). Rasch Models Foundations, Recent Developments, and Applications. Springer. https://doi.org/10.1007/978-1-4612-4230-7
Herdoost, H. (2016). Validity and Reliability of the Research Instrument ; How to Test the Validation of a Questionnaire / Survey in a Research Hamed Taherdoost To cite this version : HAL Id : hal-02546799 Validity and Reliability of the Research Instrument ; How to Test the. International Journal of Academic Research in Management, 5(3), 28–36.
Irwing, P., Booth, T., & Hughes, D. J. (2018). The Wiley Handbook of Psychometric Testing. John Wiley & Sons Ltd.
Keliat, B. A., Nasution, R. A., Handini, I. T., & Falani, I. (2023). Psychometric properties evaluation of the Indonesian version of the Beck Scale for Suicide Ideation (BSSI) questionnaire using a Rasch model. European Review for Medical & Pharmacological Sciences, 27(21).
Kline, P. (2015). A Handbook of Test Construction: Introduction to psychometric design.
Linacre, J. M. (2011). Winsteps Help for Rasch Analysis. http://homes.jcu.edu.au/~edtgb/%5Cnpapers3://publication/uuid/D56B724A-62FF-4D00-84E1-ECC888298B70
Mania, S., & Alam, S. (2021). Teachers’ perception toward the use of ethnomathematics approach in teaching math. International Journal of Education in Mathematics, Science and Technology, 9(2), 282–298.
Mosimege, M., & Egara, F. (2023). Students’ perceptions of mathematics teachers’ usage of ethnomathematics materials in the teaching and learning of mathematics. International Journal of Multicultural Education, 25(2), 443–459.
Naga, D. S. (2012). Teori Sekor pada Pengukuran Mental. PT Nagarani Citrayasa.
Nicol, C., (Gels), C. N., & Peng, A. (2024). Ethnomathematics and Mathematics Education. Springer.
Nur, A. S., Waluya, S. B., Rochmad, R., & Wardono, W. (2020). Contextual Learning with Ethnomathematics in Enhancing the Problem Solving Based on Thinking Levels. Journal of Research and Advances in Mathematics Education, 5(3), 331–344.
Oriondo, L. L., & Dallo-Antonio, E. M. (1984). Evaluating educational outcomes: Tests, measurement and evaluation. Rex Book Store.
Prahmana, R. C. I. (2022). Ethno-realistic mathematics education: The promising learning approach in the city of culture. SN Social Sciences, 2(12), 257.
Putra, E. C. S., & Mahmudah, F. N. (2021). The implementation of ethnomathematics based-learning for students. SJME (Supremum Journal of Mathematics Education), 5(2).
Ramalisa, Y., Falani, I., & Pasaribu, F. T. (2023). Rasch analysis in developing Jambi culture-based ethnomathematics test for prospective mathematics teachers. JRAMathEdu (Journal of Research and Advances in Mathematics Education).
Rosa, M., & Orey, D. C. (2021). An ethnomathematical perspective of stem education in a glocalized world. Bolema - Mathematics Education Bulletin, 35(70), 840–876. https://doi.org/10.1590/1980-4415v35n70a14
Rosa, M., Shirley, L., Gavarrete, M. E., & Alangui, W. V. (2016). Ethnomathematics and its diverse approaches for mathematics education. Springer.
Rust, J., & Golombok, S. (2018). Modern Psychometrics. In Modern Psychometrics. https://doi.org/10.4324/9781315787848
Rustam, A., Santun Naga, D., & Supriyati, Y. (2019). Sensitivity and Accuracy of the Mantel-Haenszel Method and Standardization Method: Detection of Item Functioning Differential. International Journal of Education and Literacy Studies, 7(3), 28. https://doi.org/10.7575/aiac.ijels.v.7n.3p.28
Salam, M., Wahyuni, A., & Hajri, P. (2022). The Traditional Values of Maanta in Jambi Seberang Community. Al. Hayat, 6(2).
Skaggs, G., & Williams, T. (2023). Comparison of The Item Response Theory with Covariates Model and Explanatory Cognitive Diagnostic Model for Detecting and Explaining Differential Item Functioning.
Soesana, A., Subakti, H., Karwanto, K., Fitri, A., Kuswandi, S., Sastri, L., Falani, I., Aswan, N., Hasibuan, F. A., & Lestari, H. (2023). Metodologi Penelitian Kuantitatif.
Sumintono, B., & Widhiarso, W. (2014). Aplikasi Model Rasch untuk Penelitian Ilmu-ilmu Sosial. Trim Komunikata Publishing House.
Sunzuma, G., & Maharaj, A. (2019). Teacher-related challenges affecting the integration of ethnomathematics approaches into the teaching of geometry. Eurasia Journal of Mathematics, Science and Technology Education, 15(9). https://doi.org/10.29333/ejmste/108457
Taherdoost, H. (2016). Validity and Reliability of the Research Instrument. In SSRN Electronic Journal (Vol. 5, Issue 3, pp. 28–36).
Van Der Linden, W. J. (2010). Item response theory. International Encyclopedia of Education, 4, 81–88. https://doi.org/10.1016/B978-0-08-044894-7.00250-5
DOI: https://doi.org/10.30596/ijems.v7i2.29464
Refbacks
- There are currently no refbacks.
Indonesian Journal of Education and Mathematics Science
Universitas Muhammadiyah Sumatera Utara
Kampus Utama
Jl. Kapten Muchtar Basri No.3, Glugur Darat II,Medan
Sumatera Utara-20238
Kontak: 0819-4593-7110
E-mail: ijems@umsu.ac.id
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.




