HOW LITERATE AM I ABOUT ASSESSMENT: EVIDENCE FROM INDONESIAN EFL PRE-SERVICE AND IN-SERVICE TEACHERS
Abstract
Language Assessment Literacy (LAL) for teachers is a pivotal content area which teachers must have for their prefessional development. Despite increasing interest in language assessment, research focusing on LAL of pre-service and in-service teachers, especially in Indonesian EFL context, has yet to receive due attention. Nevertheless, understanding pre-service and in-service teachers’ literacy of classroom assessment is essential for the quality of classroom assessment practice, hence the improvement of language learning and teaching. This study aimed to investigate Indonesian EFL pre-service and in-service teachers’ literacy of classroom assessment. Using a quantitative approach with ex-post facto research design, this study examined the extent of assessment literacy among EFL pre-service and in-service teachers. Participants were 60 English department students who have done teaching practicum courses and 41 in-service teachers in the Indonesian province of East Java. The finding revealed that the pre-service and in-service teachers perceived a moderate level of assessment literacy. Further, the two groups of participants demonstrated a statistically significant difference in overall assessment literacy, as well as in two of its dimensions, namely administering and scoring assessment results and alternative assessment. The findings of this study could shed light to the understanding of EFL pre-service and in-service teachers’ literacy of classroom assessment.
Keywords
Full Text:
PDFReferences
Abell, S. K., & Siegel, M. A. (2011). Assessment literacy: What science teachers need to know and be able to do. In The professional knowledge base of science teaching (pp. 205–221). Springer.
Ashraf, H., & Zolfaghari, S. (2018). EFL teachers’ assessment literacy and their reflective teaching. International Journal of Instruction, 11(1), 425–436. https://doi.org/10.12973/iji.2018.11129a
Bijsterbosch, E., Béneker, T., Kuiper, W., & van der Schee, J. (2019). Teacher Professional Growth on Assessment Literacy: A Case Study of Prevocational Geography Education in the Netherlands. Teacher Educator, 54(4), 420–445. https://doi.org/10.1080/08878730.2019.1606373
Bonner, S. M. (2013). Validity in classroom assessment: Purposes, properties, and principles. In J. H. McMillan (Ed.), SAGE Handbook of Research on Classroom Assessment (pp. 87–106). London: Sage. https://doi.org/10.4135/9781452218649.n6
Brookhart, S. M. (2001). The Standards and Classroom Assessment Research. In Paper presented at the annual meeting of the American Association of Colleges for Teacher Education (p. 15). Dallas, TX.: ERIC Document Reproduction Service No. ED451189.
Brown, H. D. (2018). Language Assessment Principles and Classroom Practice (Third). New York: Pearson Education.
Campbell, C. (2013). Research on teacher competency in classroom assessment. In J. H. McMillan (Ed.), SAGE Handbook of Research on Classroom Assessment (pp. 71–84). https://doi.org/10.4135/9781452218649.n5
Cheng, L., & Fox, J. (2017). Assessment in the Language Classroom. Assessment in the Language Classroom. https://doi.org/10.1057/978-1-137-46484-2
Cirocki, A., & Anam, S. (2021). “How much freedom do we have?” The perceived autonomy of secondary school EFL teachers in Indonesia. Language Teaching Research. . https://doi.org/10.1177/13621688211007472
Coombe, C., Vafadar, H., & Mohebbi, H. (2020). Correction to: Language assessment literacy: what do we need to learn, unlearn, and relearn? (Language Testing in Asia, (2020), 10, 1, (3), 10.1186/s40468-020-00101-6). Language Testing in Asia, 10(1), https://doi.org/10.1186/s40468-020-00114-1
Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying second language teachers’ knowledge, beliefs, and practices. Assessing Writing, 28, 43–56. https://doi.org/10.1016/j.asw.2016.03.001
Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347. https://doi.org/10.1177/0265532208090156
Deygers, B., & Malone, M. E. (2019). Language assessment literacy in university admission policies, or the dialogue that isn’t. Language Testing, 36(3), 347–368. https://doi.org/10.1177/0265532219826390
Earl, L. M. (2013). Using Assessment to Motivate Learning. In Assessment as learning: Using classroom assessment to maximize student learning (pp. 77–86). Corwin Press.
Edwards, F. (2017). The development of summative assessment literacy: An exploration of the experiences of beginner secondary science teachers in New Zealand. The University of Waikato.
Engelsen, K. S., & Smith, K. (2014). Assessment literacy. In Designing assessment for quality learning (pp. 91–107). Springer.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041
Harding, L., & Kremmel, B. (2016). Teacher assessment literacy and professional development. In Handbook of Second Language Assessment (pp. 413–427). Germany: De Gruyter Mouton. https://doi.org/10.1515/9781614513827-027
Herrera, L., & Macías, D. F. (2015). A call for language assessment literacy in the education and development of teachers of English as a foreign language. Colomb. Appl. Linguist. J, 17(2), 302–312. https://doi.org/10.14483/udistrital.jour.calj.2015.2.a09
Hoaglin, D. C., Iglewicz, B., & Tukey, J. W. (1986). Performance of some resistant rules for outlier labeling. Journal of the American Statistical Association, 81(396), 991–999. https://doi.org/10.1080/01621459.1986.10478363
Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158
Inbar-Lourie, O. (2013). Guest Editorial to the special issue on language assessment literacy. Language Testing, 30(3), 301–307. https://doi.org/10.1177/0265532213480126
Jarr, K. A. (2012). Education Practitioners’ Interpretation and Use of Assessment Results. Iowa Research Online. Theses and Dissertations, University of Iowa. https://doi.org/10.17077/etd.35vh2oc1
Jeong, H. (2013). Defining assessment literacy: Is it different for language testers and non-language testers? Language Testing, 30(3), 345–362. https://doi.org/10.1177/0265532213480334
Koh, K., Burke, L. E. C. A., Luke, A., Gong, W., & Tan, C. (2018). Developing the assessment literacy of teachers in Chinese language classrooms: A focus on assessment task design. Language Teaching Research, 22(3), 264–288. https://doi.org/10.1177/1362168816684366
Lam, R. (2019). Teacher assessment literacy: Surveying knowledge, conceptions and practices of classroom-based writing assessment in Hong Kong. System, 81(Issue/nomor bentuk tanah), 78 –89. https://doi.org/10.1016/j.system.2019.01.006
Lazaraton, A. (2017). Qaulitative methods of validation. In E. Shohamy, I. G. Or, & S. May (Eds.), Encyclopedia of language and education: Language testing and assessment (pp. 211–224). Cham, Switzerland: Springer.
Lopez, A., & Bernal, R. (2009). Language testing in Colombia: A call for more teacher education and teacher training in language assessment. Profile Issues in Teachers Professional Development, 11(2), 55–70. Retrieved from http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S1657-07902009000200005
Luthfiyyah, R., & Basyari, I. W. (2020). EFL secondary teachers ’ assessment literacy : Assessment conceptions and practices. Journal on English as a Foreign Language, 10(2), 402–421. https://doi.org/10.23971/jefl.v10i2.2101
Mertler, C. A. (2003). Pre-service versus in-services teachers’ assessment literacy: Does classroom experience make a difference? Annual Meeting of the Mid-Western Educational Research Association, Columbus, OH, 2–27. https://doi.org/10.1.1.556.4217&rep=rep1&type=pdf
Ministry of Education and Culture. (2020). Freedom of Learning in determination of student graduation and student admission (Circular of No. 1, 2020). Ministry of Education and Culture.
National Council on Measurement in Education (NCME), American Federation of Teachers (AFT), National Education Association (NEA). (1990). Standards for Teacher Competence in Educational Assessment of Students. Educational Measurement: Issues and Practice, 9(4), 30–30. https://doi.org/10.1111/j.1745-3992.1990.tb00391.x
Nemati, M., Alavi, S. M., Mohebbi, H., & Masjedlou, A. P. (2017). Teachers’ writing proficiency and assessment ability: the missing link in teachers’ written corrective feedback practice in an Iranian EFL context. Language Testing in Asia, 7(1). https://doi.org/10.1186/s40468-017-0053-0
Pallant, J. (2016). Survival manual: A step by step guide to data analysis using SPSS program. Crows Nest: NSW: Allen & Unwin.
Phillips, M. (2002). Is “same” treatment “fair” treatment? In J. Shulman, A. K. Whittaker, & M. Lew (Eds.), Using assessments to teach for understanding: A casebook for educators. New York: Teachers College Press.
Plake, B. S., Impara, J. C., & Fager, J. J. (1993). Assessment competencies of teachers: A national survey. Educational Measurement: Issues and Practice, 12(4), 10–12.
Popham, W. J. (2001). The truth about testing: An educator’s call to action. ASCD (Association for Supervision and Curriculum Development).
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into Practice, 48(1), 4–11. https://doi.org/10.1080/00405840802577536.
Qian, D. D. (2014). School-based English language assessment as a high-stakes examination component in Hong Kong: Insights of frontline assessors. Assessment in Education: Principles, Policy & Practice, 21(3), 251–270. https://doi.org/10.1080/0969594X.2014.915207
Stiggins, R. J. (1999). Assessment, student confidence, and school success. Phi Delta Kappan, 81(3), 191–198.
Tabachnick, B. G., & Fidell, L. S. (2001). Using Multivariate Statistics, ed. NH. Boston: Allyn & Bacon, MA.
Tierney, R. D. (2010). Insights into fairness in classroom assessment: Experienced English teachers share their practical wisdom. Doctoral Dissertation University of Ottawa (Canada).
Tierney, R. D. (2013). Fairness in classroom assessment. In J. H. McMillan (Ed.), SAGE handbook of research on classroom assessment (pp. 125–144). London: Sage.
Tsagari, D., & Vogt, K. (2017). Assessment literacy of Foreign Language teachers around Europe: Research, challenges and future prospects. Language Testing and Assessment, 6(1), 41–61.
Umam, A., & Indah, Y. A. (2020). Exploring In-Service TEYL Teachers’ Assessment Literacy : Implication for Continuing Professional Development. Journal of English Educators Society, 5(1), 47–51. https://doi.org/10.21070/jees.v5i1.364
Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374–402. https://doi.org/10.1080/15434303.2014.960046
Weathington, B. L., Cunningham, C. J. L., & Pittenger, D. J. (2010). Research methods for the behavioral and social sciences. John Wiley & Sons.
Willis, J., Adie, L., & Klenowski, V. (2013). Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform. Australian Educational Researcher, 40(2), 241–256. https://doi.org/10.1007/s13384-013-0089-9
Wise, S. L., Lukin, L. E., & Roos, L. L. (1991). Teacher Beliefs About Training in Testing and Measurement. Journal of Teacher Education, 42(1), 37–42. https://doi.org/10.1177/002248719104200106
Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162. https://doi.org/10.1016/j.tate.2016.05.010
Yan, X., Zhang, C., & Fan, J. J. (2018). “Assessment knowledge is important, but …”: How contextual and experiential factors mediate assessment practice and training needs of language teachers. System, 74, 158–168. https://doi.org/10.1016/j.system.2018.03.003
Zhang, Z., & Burry-Stock, J. (1997). Assessment Practices Inventory: A Multivariate Analysis of Teachers’ Perceived Assessment Competency. Paper presented at the Annual Meeting of the National Council on Measurement in Education. Chicago, Illinois: ERIC. Retrieved from https://files.eric.ed.gov/fulltext/ED408333.pdf
Zolfaghari, F., & Ahmadi, A. (2016). Assessment literacy components across subject matters. Cogent Education, 3(1). https://doi.org/10.1080/2331186X.2016.1252561
Zulaiha, S., & Mulyono, H. (2020). Exploring junior high school EFL teachers ’ training needs of assessment literacy Exploring junior high school EFL teachers ’ training needs of assessment literacy. Cogent Education, 7(1). https://doi.org/10.1080/2331186X.2020.1772943
Zulaiha, S., Mulyono, H., & Ambarsari, L. (2020). An investigation into EFL teachers’ assessment literacy: Indonesian teachers’ perceptions and classroom practice. European Journal of Contemporary Education, 9(1), 189–201. https://doi.org/10.13187/ejced.2020.1.189
DOI: https://doi.org/10.25134/erjee.v9i2.4374
Refbacks
- There are currently no refbacks.
Copyright (c) 2021 English Review: Journal of English Education