DEVELOPING READING ASSESSMENT INSTRUMENT FOR INTERMEDIATE EFL LEARNERS: AZWAR MODEL

Fitriatul Masitoh, Ima Fitriyah, Nur Mukminatien

Abstract


The study was inspired by the fact that teachers of an intermediate English reading course employed a pre-made reading instrument particularly tests obtained from the internet, the TOEFL, or a textbook without consulting the learning objectives. Therefore, they cannot meet the demand of the teaching and learning objectives and the classroom-based assessment that should be tailored to the unique circumstances of the course. The objective of this study is to create intermediate reading comprehension test items for EFL students that adhere to the "good test" criterion generated utilizing the Azwar Model (1996). Second-semester students of English Language department in one of institutions in Kediri, Indonesia were meant to take a reading test using this instrument. The results of the try-out from 75 EFL students from the same level demonstrates that the test met the requirements of being valid, reliable, and practical, had moderate difficulty level, good discrimination levels as the most, and 73 functional distractors of the total. Meanwhile, five-invalid test items are not going to be included to be utilized in assessing EFL students’ reading comprehension. Intermediate reading course lecturers could then utilize the 35 items which are considered as valid, reliable, and moderately difficult to measure their students’ reading achievement.


Keywords


Item analysis; reading test development; reliability; validity

Full Text:

PDF

References


Afflerbach, P. (2016). Reading Assessment: Looking Ahead. Reading Teacher, 69(4), 413–419.

Anastasiou, D. & Griva, E. (2009). Awareness of reading strategy use and reading comprehension among poor and good readers. Elementary Education Online, 8, 283-297

Azmi, U. (2020). Developing web-based reading tests for the students of English language education. Journal of Applied Linguistics, Translation, and Literature, 1(2), 92-104.

Azwar, S. (1996). Tes Prestasi: Fungsi dan Pengembangan Pengukuran Prestasi Belajar (2nd edition). Pustaka Pelajar

Borg, W.R. & Gall, J.P. (2003). Educational Research: An Introduction, 7th Edition. New Jersey: New Jersey Pearson Education

Brown, H. D., & Lee, H. (2001). Teaching by principles: An interactive approach to language pedagogy. Prentice Hall Regents Englewood Cliffs, NJ.

Brown, H. D. (2004). Language assessment: Principles and classroom practices. Pearson Education, Inc.

Burns P.C., Betty, D. & Ross, E. P. 1996. Teaching Reading in Today’s Elementary Schools. Houghton Mifflin Company.

Daryanto. (2005). Evaluasi Pendidikan. Rineka Cipta

Danuwijaya, A. A. (2018). Item analysis of reading comprehension test for post-graduate students. English Review: Journal of English Education, 7(1), 29. https://doi.org/10.25134/erjee.v7i1.1493

Day, R. R., & Park, J. S. (2005). Developing Reading Comprehension Questions. Reading in a foreign language, 17(1), 60-73.

Djiwandono, M.S. (1996). (1996). Test Bahasa dalam Pengajaran. Institut Teknologi Bandung.

Ellis, A. P., & Ryan, A. M. (2003). Race and cognitive‐ability test performance: The mediating effects of test preparation, test‐taking strategy use and self‐ efficacy. Journal of Applied Social Psychology, 33(12), 2607-2629

Fitriyah, I., & Jannah, M. (2021). Online Assessment Effect in EFL Classroom: An Investigation on Students and Teachers' Perceptions. Indonesian Journal of English Language Teaching and Applied Linguistics, 5(2), 265-284.

Gellert, A. S., & Elbro, C. (2013). Cloze tests may be quick, but are they dirty? Development and preliminary validation of a cloze test of reading comprehension. Journal of Psychoeducational Assessment, 31(1), 16-28.

Grabe, W. 2009. Reading in a Second Language: Moving From Theory to Practice. Cambridge University Press.

Hanafi, H. (2016). Developing Reading Comprehension Test for The First Semester Students of English Department. ELLITE: Journal of English Language, Literature, and Teaching, 1(1). https://doi.org/10.32528/ellite.v1i1.164

Heaton, J.B. (1990). Writing English Language Tests. Longman

Huang, T. W., & Wu, P. C. (2013). Classroom-based cognitive diagnostic model for a teacher-made fraction- decimal test. Educational Technology & Society, 16(3), 347–361

Hughes, A. (2003). Testing for Language Teachers. 2nd Edition. Cambridge University Press

Karim, S., & Haq, N. (2014). The process of developing an academic reading test and evaluating its authenticity. Journal of Language Teaching and Research, 5(2), 471–475.

Lee, I. (2017). Classroom Writing Assessment and Feedback in L2 School Contexts. Springer. https://utpjournals.press/doi/10.3138/cmlr.599

Manfaat, B., Nurazizah, A., & Misri, M. A. (2021). Analysis of mathematics test items quality for high school. Jurnal Penelitian dan Evaluasi Pendidikan, 25(1), http://dx.doi.org/10.21831/pep.v25i1.39174

Ningrum, A. S. B. ., & Sudarwati, E. . (2022). Is the test sensible? Developing a critical reading test for Indonesian EFL learners. JEELS (Journal of English Education and Linguistics Studies), 9(1), 209–227. https://doi.org/10.30762/jeels.v9i1.4005

Nuttal, C. (2005). Teaching Reading Skill in Foreign Language. Macmillan.

Oakley, G. (2011). The assessment of reading comprehension cognitive strategies: Practices and perceptions of Western Australian teachers. Australian Journal of Language and Literacy, 34, 279-292.

Ozguven, İ. E. (2007). Psikolojik testler. PDREM Yayınları.

Ozdemir, E. C., & Akyol, H. (2019). The Development of a Reading Comprehension Test. Universal Journal of Educational Research, 7(2), 563–570. https://doi.org/10.13189/ujer.2019.070229

Perkasa, A. N. (2021). Developing and validating EFL reading test. Education of English as Foreign Language Journal (EDUCAFL), 4 (1), 9-18. Doi: 10.21776/ub.educafl.2021.004.01.02

Royer, J. M. (2001). Developing reading and listening comprehension tests based on the Sentence Verification Technique (SVT). Journal of Adolescent & Adult Literacy, 45(1), 30-41.

Ranjbaran, F., & Alavi, S. M. (2017). Developing a reading comprehension test for cognitive diagnostic assessment: A RUM analysis. Studies in Educational Evaluation, 55, 167-179.

Snyder, L., Caccamise, D., & Wise, B. (2005). The Assessment of Reading Comprehension: Considerations and Cautions. Topics in Language Disorders, 25(1), 33–50. https://doi.org/10.1097/00011363-200501000-00005

Sudarwati, E., Fatimah, F., Astuti, Y., & Ubaidillah, M. F. (2021). Developing Online Learning Assessment Instrument for English Sentence Structure Course during Covid-19 Pandemic. Langkawi: Journal of The Association for Arabic and English, 7(2), 170. https://doi.org/10.31332/lkw.v7i2.3122

Sudijono, A. (2009). Pengantar Evaluasi Pendidikan. Rajawali Pers

Wijayanti, P. S. (2020). Item quality analysis for measuring mathematical problem-solving skills. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 9(4), 1223–1234. https://doi.org/https://doi.org/10.24127/ajpm.v9i4.3 036

Yao, M., & Souza, T. (1992). Developing and Validating an Intermediate English Reading Test for English as a Second Language Learners. Report research technical 143. Retrieved from https://files.eric.ed.gov/fulltext/ED354034.pdf




DOI: https://doi.org/10.25134/erjee.v11i3.7461

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 English Review: Journal of English Education