Developing Assessment Instrument Using Polytomous Response in Mathematics
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and m.
- Pub. date: July 15, 2022
- Pages: 1441-1462
- 352 Downloads
- 521 Views
- 0 Citations
This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation (testing). The study was conducted in three vocational schools in Lampung Province, Indonesia. The study involved 413 students, consisting of 191 male and 222 female students. The data were collected through questionnaire and test. The questionnaire was used to identify the assessment instruments currently employed by teachers and to be validated by the experts of mathematics and educational evaluation. The test used an open polytomous response test numbering of 40 items. The data were analyzed using both classical and modern theories. The results show that (1) the open polytomous response test has a good category according to classical and modern theory. However, the discrimination power of test items in classical theory needs several revisions, (2) the assessment instrument using the polytomous response of open multiple choice can guarantee information on the actual competence of students. This is proven by the fact that there is a harmony between the analysis result obtained from classical and modern theory from the students' arguments when giving reasons for their choices. Therefore, the open polytomous response test can be used as an alternative to learning assessment.
Keywords: Assessment instrument, classical and modern theory, vocational school, polytomous responses.
References
Alagumalai, S., Curtis, D., & Hungi, N. (2005). Applied Rasch measurement: A book of exemplars. Springer-Kluwer Academic Publishers.
Anisa. (2013). Perbandingan penskoran dikotomi dan politomi dalam teori respon butir untuk pengembangan bank soal mata kuliah matematika dasar [Comparison of scoring dichotomies and polytomies in item response theory for the development of a question bank for basic mathematics courses]. Jurnal Matematika, Statistika, & Komputasi, 9(2), 95-113. https://bit.ly/39wv73P
Antara, A. A., Yasna, I. M., Dewi, N. W., & Maduriana, I. M. (2019). Karakteristik tes prestasi belajar model campuran dikotomus dan politomus generalized partial credit model [Characteristics of learning achievement test mixed dichotomous and polytomous generalized partial credit model]. Jurnal Suluh Pendidikan, 17(1), 32-37. https://bit.ly/3yFQ6eO
Arikunto, S. (2012). Dasar-dasar evaluasi pendidikan [Educational evaluation basics]. Bumi Aksara.
Ayanwale, M. A. (2021). Calibration of polytomous response mathematics achievement test using generalized partial credit model of item response theory. Educatum: Journal of Science, Mathematics and Technology, 8(1), 57-69. https://bit.ly/3Nob4mN
Bloom, B. S. (1956). Taxonomy of educational objectives, handbook: The cognitive domain. David McKay.
Chandrasegaran, A. L., Treagust, D., & Mocerino, M. (2007). The development of a two-tier multiple-choice diagnostic instrument for evaluating secondary school students’ ability to describe and explain chemical reactions using multiple levels of representation. Chemistry Education Research and Practice, 8(3), 293-307. https://doi.org/10.1039/B7RP90006F
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Harcourt.
DeMars, C. (2010). Item response theory. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195377033.001.0001
Diani, R., Alfin, J., Anggraeni, Y. M., Mustari, M., & Fujiani, D. (2019). Four-tier diagnostic test with certainty of response index on the concepts of fluid. In C. Anwar (Ed.), Young scholar symposium on transdisciplinary in education and environment (YSSTEE) (pp. 641-650). UIN Raden Intan. https://bit.ly/3lfARkW
Dong, A., Jong, M. S., & King, R. B. (2020). How does prior knowledge influence learning engagement? The mediating roles of cognitive load and help-seeking. Frontier Psychology Journal, 11(1), 1-10. https://doi.org/10.3389/fpsyg.2020.591203
Earl, L. M. (2013). Assessment for learning; Assessment as learning: Changing practices means changing beliefs. Assessment & Support Team. https://bit.ly/3MnA9hw
Falani, I., Akbar, M., & Naga, D. S. (2020). The Precision of students’ ability estimation on combinations of item response theory models. International Journal of Instruction, 13(4), 545-558. https://doi.org/10.29333/iji.2020.13434a
Geofrey, M. (2021). Children's prior knowledge is very important in teaching and learning in this era of constructivism. Researh Gate. https://doi.org/10.13140/RG.2.2.28470.22083
Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2017). Developing, analyzing, and using distractors for multiple-choice test in education: A comprehensive review. Review of Educational Research, 87(6), 1082–1116. https://doi.org/10.3102/0034654317726529
Gonzalez, G. (2018). Understanding teacher noticing of students’ prior knowledge: Challenges and possibilities. The Mathematics Enthusiast, 15(3), 483-528. https://doi.org/10.54870/1551-3440.1442
Gregory, R. J. (2015). Psychological testing: History, principles, and applications. Pearson.
Hambleton, R. K., & Jones, R. W. (1993). Comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice, 12(3), 38–47. https://doi.org/10.1111/j.1745-3992.1993.tb00543.x
Hambleton, R. K., & Linden, W. J. (1982). Advances in item response theory and applications: An introduction. Applied Psychological Measurement, 6(4), 373-378. https://doi.org/10.1177/014662168200600401
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Kluwer. https://doi.org/10.1007/978-94-017-1988-9
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Sage Publications.
Hilton, A., Hilton, G., Dole, S., & Goos, M. (2013). Development and application of a two-tier diagnostic instrument to assess middle-years students’ proportional reasoning. Mathematics Education Research Journal, 25(1), 523–545. https://doi.org/10.1007/s13394-013-0083-6
Ikmawati. (2020). Pengaruh disiplin dan kreativitas belajar terhadap hasil belajar matematika di SMK negeri dan swasta [The effect of discipline and creativity in learning on math learning outcomes in public and private vocational schools]. Primatika: Jurnal Pendidikan Matematika, 9(1), 35-42. https://doi.org/10.30872/primatika.v9i1.250
Kartono. (2008). Penyetaraan tes model campuran butir dikotomus dan politomus pada tes prestasi belajar [Equalization of the dichotomous and polytomous mixed item model tests on the learning achievement test]. Jurnal Penelitian dan Evaluasi Pendidikan, 12(2), 302-320. https://doi.org/10.21831/pep.v12i2.1433
Khiyarunnisa, A., & Retnawati, H. (2018). A two-tier diagnostic test instrument on calculus material: What, why, and how? In A. W. Subiantoro (Ed.), 5th ICRIEMS Proceedings (pp. 479-485). Faculty of Mathematics and Natural Sciences. https://bit.ly/3liFMS8
Khusnah, M. (2019). The development of two-tiers diagnostic test for identifying tenth-grade student's misconception about the categorization of hadith. [Master’s thesis, Malang State Islamic University]. UIN Malang Digital Archive. https://bit.ly/3sEcNMA
Lestari, S. A., Zawawi, I., Khikmiyah, F., & Fauziyah, N. (2021). Development evaluation tool two-tier multiple choice using wondershare quiz creator to identify mathematical connection. Journal of Mathematics Education, 6(2), 133-148. https://bit.ly/3Psrc8s
Linacre, J. M. (2012). Winstep: Rasch-model computer programs. Winsteps.Com. https://bit.ly/3wljq95
Malhotra, N. K. (2006). Riset pemasaran [Marketing research]. Erlangga.
Mason, J., Burton, L., & Stacey, K. (2010). Thinking mathematically (2nd ed.). Pearson Educational Limited.
Muhson, A., Lestari, B., Supriyanto, & Baroroh, K. (2017). The development of practical item analysis program for Indonesian. International Journal of Instruction, 10(2), 199-210. https://doi.org/10.12973/iji.2017.10213a
Myanda, A. A., Riezky, M. P., & Maridi. (2020). Development of two-tier multiple-choice test to assess students’ conceptual understanding on respiratory system material of 11th high school.InternationalJournal of Science and Applied Science: Conference Series, 4(1), 44-55. Sebelas Maret University. https://bit.ly/3yIePzb
Oktaria. (2016). Development of mathematics teaching materials with ICT for students in vocational schools [Unpublished master's thesis]. University of Lampung.
Permendikbud. (2016). Standar isi pendidikan dasar dan menengah [Standards of content for primary and secondary education]. Indonesian Government publication service. https://bit.ly/3FZHlhp
Plomp, J. (2013). Educational design research: An introduction. Institute for Curriculum Development (SLO). https://bit.ly/3MzqkNm
Putri, B. S., Kartono, & Supriyadi. (2020). Analysis of essay test instruments using higher order thinking skill (HOTS) at high school mathematics students using the Rasch model. Journal of Research and Educational Research Evaluation, 9(2), 58-69. https://bit.ly/37QCtyu
Putri, E. L., Dwijanto, D., & Sugiman. (2017). Analysis of mathematical communication skills and confidence of 10th grade of SMK in geometry material viewed from cognitive style. Unnes Journal of Mathematics Education, 6(1), 97-107. https://bit.ly/3yF4iF5
Retnawati, H. (2014). Teori respons butir dan penerapannya [Item response theory and its application]. Nuha Medika. https://bit.ly/39TFDlF
Rosidin, U. (2017). Evaluasi dan asesmen pembelajaran [Learning evaluation and assessment]. Media Akademi.
Rovita, C. A., Zawawi, I., & Huda, S. (2020). Pengembangan alat evaluasi pembelajaran matematika berbasis two-tier multiple choice menggunakan Ispring Suite 9 [Development of an evaluation tool for learning mathematics based on two-tier multiple choice using Ispring Suite 9]. Postulat: Jurnal Inovasi Pendidikan Matematika, 1(2), 150-163. https://doi.org/10.30587/postulat.v1i2.2094
Saepuzaman, D., Istiyono, E., Haryanto, Retnawati, H., & Yustiandi. (2021). Analisis estimasi kemampuan siswa menjawab soal fisik dengan pendekatan item response theory [Analysis of the estimation of students' ability to answer physical questions with an item response theory approach]. Karst: Journal of Physics Education and Its Application/Karst: Jurnal Pendidikan Fisika dan Terapannya, 4(1), 8-13. https://doi.org/10.46918/karst.v4i1.948
Sarea, M. S. (2018). Karakteristik soal ujian akhir semester pendidikan agama islam dan budi pekerti tingkat sekolah dasar [Characteristics of the final exam for Islamic religious education and character at the elementary school level]. An-Nahdhah, 11(2), 303-318. https://bit.ly/3FToOU7
Sarea, M. S., & Ruslan, R. (2019). Karakteristik butir soal: Teori tes klasik and respon [Characteristics of items: Classical and response test theory]. Didaktika: Jurnal Kependidikan, 13(1), 1-16. https://doi.org/10.30863/didaktika.v13i1.296
Suhaini, M., Ahmad, A., & Bohari, N. M. (2021). Assessments on vocational knowledge and skills: A content validity analysis. European Journal of Educational Research, 10(3), 1529-1540. https://doi.org/10.12973/eu-jer.10.3.1529
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan [Rasch modeling applications in educational assessment]. Trim Komunikata.
Sundari, Kahar, M. S., & Erwinda, E. (2021). Analisis kemampuan berpikir tingkat tinggi menggunakan instrumen HOTS berbasis two-tier diagnostic test [Analysis of higher order thinking skills using the HOTS instrument based on a two-tier diagnostic test]. Aksioma: Jurnal Program Studi Pendidikan Matematika, 10(4), 2726-2735. https://doi.org/10.24127/ajpm.v10i4.4260
Suwarto. (2012). Pengembangan tes diagnostik dalam pembelajaran [Development of diagnostic test in learning]. Graha Ilmu.
Syahlan. (2017). Sepuluh strategi dalam pemecahan masalah matematika [Ten strategies for solving math problems]. Indonesian Digital Journal of Mathematics and Education, 4(6), 358-369. https://doi.org/10.31227/osf.io/6qfpm
Syaifuddin, M. (2020). Implementation of authentic assessment on mathematics teaching: Study on junior high school teachers. European Journal of Educational Research, 9(4), 1491-1502. https://doi.org/10.12973/eu-jer.9.4.1491
Treagust, D. (1988). Development and use of diagnostic test to evaluate student’s misconceptions in science. International Journal of Science Education, 10(2), 159-169. https://doi.org/10.1080/0950069880100204
Untary, H., Risdianto, E., & Kusen. (2020). Analisis data penelitian dengan model rash dan Winstep[Analysis of research data with rash and Winstep models]. Halaman Moeka Publishing. https://bit.ly/3NlnGLe
Vani, I. K., Paloloang, B., & Idris, M. (2019). Pengaruh persepsi dan minat belajar terhadap hasil belajar matematika siswa kelas X SMKN 6 Palu [The influence of perception and interest in learning on mathematics learning outcomes for students of class X Vocational School 6 Palu]. Jurnal Elektronik Pendidikan MatematikaTadulako, 6(4), 455-468. https://bit.ly/3wjuXp9
Wulan, A. (2018). Menggunakan asesmen kinerja untuk pembelajaran sain dan penelitian [Using performance assessment for science learning and research]. UPI Press.
Wulanningtyas, M. E., Suswanti, & Marhaeni, N. H. (2020). The student of error analysis and remedial program in working on the story of comparative material and turning value. Jurnal Daya Matematis/Journal of Mathematical Power, 8(2), 161-166. https://doi.org/10.26858/jdm.v8i2.14344
Yang, T. C., Fu, H. T., Hwang, G. J., & Yang, S. J. (2017). Development of an interactive mathematics learning system based on a two-tier test diagnostic and guiding strategy. Australasian Journal of Educational Technology, 3(1), 60-80. https://doi.org/10.14742/ajet.2154