Science Interest Detection Using Computerized Adaptive Testing Based on Fuzzy Item Response Theory

Fitri Wulandari

Abstract


Choosing a major or interest at the beginning of High School is a very important process for the future development of students.  A test  may be performed to determine the learner's ability in a particular field In this research, an interest test was developed to determine the students' ability in science. Students will be measured for their cognitive ability in Mathematics and Science subjects for junior high school level. The research was developed using an adaptive test system called Computerized Adaptive Testing (CAT). CAT is an adaptive media based model,  test participants will receive the test according to their ability. The test item selection procedure uses the fuzzy algorithm using item difficulty parameters, item strengths and participants' response data as input data. While the rule or procedure for terminating the test is done with the maximum likelihood estimation method, MLE. Based on the test results, each student received different test items according to their ability level and the difficulty indexs that received by the students according to the characteristics of the item information. Therefore, the CAT program with the fuzzy item response theory can be used as a support for measuring the students' ability and interest in a major.


Full Text:

PDF

References


Gultom, Syawal, Pedoman peminatan peserta didik Jakarta, Kementerian Pendidikan dan Kebudayaan, 2013.

Zainul, A. and Nasution, N. (2001). Penilaian hasil belajar. PAU untuk peningkatan dan Pengembangan Aktivitas Instruksional Ditjen Dikti, DepDiknas, Jakarta,

Mardapi, Djemari., Teknik penyusunan instrumen tes dan non-tes. Yogyakarta: Mitra Cendikia Press, 2008.

Anderson, L. W., & Krathwohl, D. R. A taxonomy for learning, teaching, and assessing. New York: Addison Wesley Longman. Inc, 28-32, 2011.

Khoshsima, H. and Toroujeni, S. M. H. (2017). Computer-Based Testing: Score Equivalence and Testing Administration Mode Preference in a Comparative Evaluation Study. International Journal of Emerging Technologies in Learning (iJET), 12(10): 35-55.

https://doi.org/10.3991/ijet.v12i10.6875

Georgiadou, E., Triantafillou, E., and Economides, A. A. (2006). Evaluation parameters for computer-adaptive testing. British Journal of Educational Technology, 37(2): 261-278.

https://doi.org/10.1111/j.1467-8535.2005.00525.x

Chee, T.S., & Wong, A.F.L. Teaching and learning with technology. Singapore: Prentice Hall, 96, 2003.

Towndrow, P.A., & Vallence, M., Using IT in the language classroom: A guide for teachers and students in Asia (3rd ed.), Singapore: Longman Pearson Education South Asia Pte. Ltd, 2004.

Thompson, A. N.,& Weiss, D. J, “A framework for the development of computerized Adaptive Tests,” Practical Assesment, Research & Evaluation, vol 16, pp. 49-65, 2011.

Trianfillou, E., Georgiadou,E., & Economides, A.A., “CAT-MD : computer adaptive test on mobile devides. Current Development in Technology-Assisted Education, No 2, pp. 773-777, 2006

Haryanto, “Optimasi Pengukuran Hasil Belajar melalui computerized intelligent measurement model fuzzy”, in Seminar Nasional Psikologi UMS, Solo, 2014, p 316-331.

Retnawati, Teori Respon Butir dan Penerapannya, Yogyakarta, Parama Publishing, 2014.

Awopeju, O.A.,& Afolabi, E.R.I, “Comparative analysis of classical test theory and item response theory based item parameter estimates of senior school certificate mathematics examination”, European Scientific Journal, Vol. 12, No. 28 pp. 263-284, 2016.

https://dx.doi.org/10.19044/esj.2016.v12n28p263

Zoghi, M.,& Valipour, V, “A comparative study of classical test theory and item response theory in estimating test item parameters in a linguistics test”, Indian Journal of Fundamental and Applied Life Science, Vol 4, pp. 424-435, 2014.

Guler, N., Uyanik, G.K., & Teker, G.T., “Comparison of classical test theory and item response theory in terms of item parameters”, European Journal of Research on Education, Vol 2, No 1, pp. 1-6, 2014

Ratnaningsih, D.J. and Isfarudi, I., “Analisis butir tes objektif ujian akhir semester mahasiswa universitas terbuka berdasarkan teori tes modern”, Jurnal Pendidikan Terbuka Dan Jarak Jauh. Vol 14, no 2 , pp. 98-109, Aug 2013

Abedalaziz, N.,& Leng, C.H., “The relationship between CTT and IRT approaches in analyzing item characteristics”, The Malaysian Online Journal of Education Science, Vol 1, no 1, pp. 64-70, 2013.

Thorpe, G.L.,& Favia, A., “Data analysis using item response theory methodology: an instroduction to selected programs and applications”, Psychology Faculty Scholarship, July 2012, pp. 1-33.

DeMars, C., Item response theory: Understanding statistics measurement. New York: Oxford University Press, Inc, 2010.

Adedoyin, O.O.,& Mokobi, T., “Using IRTpsychometric analysis in examining the quality of junior certificate mathematics multiple choice examination test items”, International Journal of Asian Social Science, Vol 3, no 4, pp. 992-1011, 2013.

Crocker, L.,& Algina, J, Introduction to classical and modern test theory, New York: Holt, Reinhart, and Winston, Inc, 2008.

Hambleton, R.K., Swaminathan, H., Rogers, H.J., Fundamental of Item Response Theory, Newbury Park, CA: Sage Publication Inc, 1991.

Hambleton, R.K., & Swaminathan, H., Items response theory:principles and application, Boston: Kluwer-Nijjhoff Publish, 1985.

Wainer, H., et al., Computerized adaptive testing: Aprimer, Hillsdale, New Jersey: Lawrence Erlbaum Associates, 1990.

Wainer H., Bradlow, E.T., & Xiaohui Wang, Testlet response theory and its applications. Cambridge: Cambridge University Press, 2007.

Weiss, D.J, “Computerized Adaptive testing for Effective and Efficient Measurement in Counseling and Education”, Measurement and Evaluation in Conseling and Development, Department of Psichology, University of Minnesota, Minneapolis, Vol. 37, pp. 70-84, 2004.

Yan J., Ryan M., & Power J., Using fuzzy logic, Englewood Cliffs: Prentice Hall Inc, 1994.

van der Linden, W.J., & Hambleton, R.K., Handbook of modern item response theory. New York: Springer Verlag, 1997.

Lord, F.M., Applications of item response theory to practical testing problems, Hillsdale, NJ : Lawrence Erlbaum Associates, Publishers, 1980.

Afifi, A.A. And V. Clark, Computer-Aided Multivariate Analysis. 3 rd Edition. Chapman And Hall/CRC, New York. 1996.

Dillon W.R dan Goldstein, Mathew, Multivariate Analysis Method and Application, John Wiley and Sons, New York, 1984.

Olson, J.B., & Bunderson, C.V., “Validity and decision issues in selecting a CAT measurement model Paper presented at the CAT model and monitoring paper session”, Juni 2007. http://www.psych.umn.edu/psylabs/catcentral/pdf%20files/cat07 olsen.pdf

Cella, D., Gershon, R., Lai, J. S., & Choi, S. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research, 16(SUPPL. 1), 133–141.

https://doi.org/10.1007/s11136-007-9204-6

Haley, S. M., Coster, W. J., Dumas, H. M., Fragala-Pinkham, M. A., Kramer, J., Ni, P., … Ludlow, L. H. (2011). Accuracy and precision of the Pediatric Evaluation of Disability Inventory computer-adaptive tests (PEDI-CAT). Developmental Medicine and Child Neurology, 53(12), 1100–1106.




DOI: http://dx.doi.org/10.24014/coreit.v9i2.27258

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Creative Commons License  site stats  
Jurnal CoreIT by http://ejournal.uin-suska.ac.id/index.php/coreit/ is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.