Original article    |    Open Access
Innovational Research in ELT 2024, Vol. 5(1) 1-19

Washback Effect of a National English Language Teacher Field Knowledge Test for Teacher Recruitment in Türkiye: A Scale Development Study

Demet Ünal Aydın & Sevgi Şahin

pp. 1 - 19   |  DOI: https://doi.org/10.29329/irelt.2024.1045.1

Publish Date: June 30, 2024  |   Number of Views: 407  |  Number of Download: 443


Abstract

This study investigates Turkish pre-service EFL teachers' awareness and perception of a high-stakes test, a national English Language Teacher Field Knowledge Test (TFKT) for EFL teacher recruitment in Türkiye. It also seeks to examine the washback effect of TFKT on pre-service EFL teachers’ professional development and EFL teacher education programs. To this end, after a thorough literature analysis, researchers created and validated a new scale. Data were obtained from pre-service EFL teachers who were preparing for TFKT in two phases. First, data were collected from 195 participants for the pilot study, and the scale's reliability and validiy were tested by Cronbach’s Alpha Analysis and Exploratory Factor Analysis. After the necessary revisions, the scale was administered to another group of informants (n.300), and the reliability was checked a second time. The findings emphasized the scale was indeed reliable and valid, preparing the groundwork for further research. As a result, this research provides a reliable assessment tool for evaluating the impact of TFKT on pre-service EFL teachers and EFL teacher education. The established scale shows potential for guiding educational policies and practices, guaranteeing the ongoing enhancement of EFL teacher education programs.

Keywords: EFL teacher education, Teacher Field Knowledge Test, Washback Effect, High-Stakes Tests, Scale Development, Language Assessment, Pre-service EFL Teachers


How to Cite this Article?

APA 7th edition
Aydin, D.U., & Sahin, S. (2024). Washback Effect of a National English Language Teacher Field Knowledge Test for Teacher Recruitment in Türkiye: A Scale Development Study. Innovational Research in ELT, 5(1), 1-19. https://doi.org/10.29329/irelt.2024.1045.1

Harvard
Aydin, D. and Sahin, S. (2024). Washback Effect of a National English Language Teacher Field Knowledge Test for Teacher Recruitment in Türkiye: A Scale Development Study. Innovational Research in ELT, 5(1), pp. 1-19.

Chicago 16th edition
Aydin, Demet Unal and Sevgi Sahin (2024). "Washback Effect of a National English Language Teacher Field Knowledge Test for Teacher Recruitment in Türkiye: A Scale Development Study". Innovational Research in ELT 5 (1):1-19. https://doi.org/10.29329/irelt.2024.1045.1

References

    Akpınar, K. D., & Çakıldere, B. (2013). Washback effects of high-stakes language tests of Turkey (KPDS and ÜDS) on productive and receptive skills of academic personnel. Journal of Language and Linguistic Studies, 9(2), 81-94.

    Alderson, J. C. (2004). ‘Foreword’ in L. Cheng, Y. Watanabe, and A. Curtis (eds.). Washback in language testing: Research contexts and methods. London: Lawrence Erlbaum.

    Alderson, J. C., & Hamp-Lyons, L. (1996). TOEFL preparation courses: A study of washback. Language testing, 13(3), 280-297.

    Alla Khan & Norhaslinda Hassan (2024). Washback into an Ecosystem of Teaching, Learning and Testing within Asia and Beyond: An Interview with Liying Cheng, Language Assessment Quarterly, 21(1), 100-112. https://doi.org/10.1080/15434303.2023.2276917

    Allen, M. B. (2005). Eight Questions on Teacher Recruitment and Retention: What does the Research Say?. Education Commission of the States (NJ3).

    Andrews, S., Fullilove, J., & Wong, Y. (2002). Targeting washback-a case-study. System, 30(2), 207-223.

    Atav, E., & Sönmez, S. (2013). Öğretmen adaylarının kamu personeli seçme sınavı (KPSS)’na ilişkin görüşleri. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 2013(1), 1-13.

    Audet, L. A., Lavoie-Tremblay, M., Tchouaket, É., & Kilpatrick, K. (2023). The level of adherence to best-practice guidelines by interprofessional teams with and without acute           care nurse practitioners in cardiac surgery: A study protocol. Plos one, 18(3). https://doi.org/10.1371/journal.pone.0282467

    Balter, D., & Duncombe, W. D. (2008). Recruiting highly qualified teachers: do district recruitment practices matter?. Public Finance Review, 36(1), 33-62.

    Biggs, J. (1999). What the student does: Teaching for enhanced learning. Higher education research & development, 18(1), 57-75.

    Browne, M. W. (1969). Fitting the factor analysis model. Psychometrika, 34(3), 375-394.

    Burrows, J. (1999). Going beyond labels: A framework for profiling institutional stakeholders. Contemporary Education, 70(4), 5.

    Cattell, R. B. (1966). The scree test for the number of factors. Multivariate behavioral research, 1(2), 245-276.

    Cheng, L. (1999). Changing assessment: Washback on teacher perceptions and actions. Teaching and teacher education, 15(3), 253-271.

    Cheng, L. (2005). Changing language teaching through language testing: A washback study (Vol. 21). Cambridge University Press.

    Cheng, L. (1997). How does washback influence teaching? Implications for Hong Kong. Language and Education, 11, 38-54.

    Cheng, L., & Curtis, A. (2004). Washback or Backwash: A Review of the Impact of Testing on Teaching and Learning. In L. Cheng, Y. Watanabe, & A. Curtis (Eds), Washback in Language Testing (pp. 8). Lawrence Erlbaum Associates, Inc.

    Cheng, L., Watanabe, Y. and Curtis, A. (Eds). (2004). Washback in language testing: Research contexts and methods. Mahwah, NJ: Lawrence Erlbaum.

    Choi, I. (2008). The impact of EFL testing on EFL education in Korea. Language Testing, 25(1), 39-62.

    Cohen, R. J., Swerdlik, M. E., & Phillips, S. M. (1996). Psychological testing and assessment: An introduction to tests and measurement. Mayfield Publishing Co.

    Creswell, J. W. (2009). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (3rd ed.). Sage Publication, California.

    Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Holt, Rinehart and Winston, Orlando.

    Çakır, İ. (2017). The washback effects of secondary education placement examination on teachers, school administrators and parents with specific reference to teaching English as a foreign language. Turkish Journal of Teacher Education, 6(2), 61-73.

    Darling-Hammond, L. (2002). The research and rhetoric on teacher certification: A response to “teacher certification reconsidered”. Education Policy Analysis Archives, 10(36), 1-55.

    DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications. Sage Publications.

    Elmaci, S. (2015). Kamu personeli seçme sınavı ve alan bilgisi sınavına ilişkin öğretmen görüşlerinin ve metaforik algılarının belirlenmesi (Master's thesis, Sosyal Bilimler Enstitüsü).

    Erdoğan, P. (2019). A Study on pre-service efl teachers’ admission into teaching programs and EFL teachers’ recruitment in Turkish context.

    Frederiksen, N. (1984). The real test bias: Influences of testing on teaching and learning. American psychologist, 39(3), 193.

    Goldhaber, D., & Hansen, M. (2010). Race, gender, and teacher testing: How informative a tool is teacher licensure testing?. American Educational Research Journal, 47(1), 218-251.

    Guttman, L. (1954). Some necessary conditions for common-factor analysis. Psychometrika, 19(2), 149-161.

    Hatipoğlu, Ç. (2010). Summative Evolution of an Undergraduate ‘English Language Testing and Evaluation’ Course by Future English Language  Teachers. English Language Teacher Education and Development (ELTED), 13, 40-51.

    Hatipoğlu, Ç. (2016). The impact of the university entrance exam on EFL education in Turkey: Pre-service English language teachers’ perspective. Procedia-Social and Behavioral Sciences, 232, 136-144.

    Hawkey, R. (2006). Impact theory and practice: Studies of the IELTS test and Progetto Lingue 2000. Cambridge: Cambridge University Press.

    Howard, A., Basurto-Santos, N. M., Gimenez, T., Moncada, A. M. G., McMurray, M., & Traish, A. (2016). A comparative study of English language teacher recruitment, in-service education and retention in Latin America and the Middle East. Publication City, Country: Publisher.

    Hughes, R. (2004). Testing the visible: literate biases in oral language testing. Journal of Applied Linguistics, 1(3).

    Johnstone, R. (2004). Language teacher education. In A. Davies & C. Elder (eds.), The handbook of applied linguistics (pp. 649-671). Malden, MA: Blackwell Publishing Ltd. http://dx.doi.org/10.1002/9780470757000.ch26

    Karaer, H., Karaer, F., & Kartal, E. (2018). Opinions of teacher candidates towards the teaching field knowledge tests on the public personnel selection examination. Erciyes Journal of Education, 2(2), 40-58.

    Karataş, T. Ö., & Okan, Z. (2021). The Powerful Use of an English Language Teacher Recruitment Exam in the Turkish Context: An Interactive Qualitative Case Study. International Online Journal of Education and Teaching, 8(3), 1649-1677.

    Kılıçkaya, F. (2016). Washback effects of a high-stakes exam on lower secondary school English teachers’ practices in the classroom. Lublin Studies in Modern Languages and Literature, 40(1), 116-134.

    Külekçi, E. (2016). A concise analysis of the Foreign Language Examination (YDS) in Turkey    and its possible washback effects. International Online Journal of Education and Teaching, 3(4), 303-315.

    Liu, E., & Johnson, S. M. (2006). New teachers' experiences of hiring: Late, rushed, and information-poor. Educational Administration Quarterly, 42(3), 324-360.

    Messick, S. (1996). Validity and washback in language testing. Language Testing, 13(3), 241-256. https://doi.org/10.1177/026553229601300302

    MoNE (2015). Milli Eğitim Bakanlığı Öğretmen Atama ve Yer Değiştirme Yönetmeliği. TC. Resmi Gazete, 29329, 17 Nisan 2015. https://www.resmigazete.gov.tr/eskiler/2015/04/20150417-4.htm Erişim: 27.01.2021

    Moser, K. (2012). Does Praxis make perfect? A personal journey through the Praxis II: World Language Test. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 85(4), 123-128.

    Nettles, M. T., Scatton, L. H., Steinberg, J. H., & Tyler, L. L. (2011). Performance and passing rate differences of African American and white prospective teachers on PraxisTM examinations: a joint project of the National Education Association (NEA) and Educational Testing Service (ETS). ETS Research Report Series, 2011(1), i-82.

    Ochieng, C. (2013). Classroom-based factors influencing teaching and learning in Public Primary Schools in Ukwala Division of Siaya County, Kenya (Doctoral dissertation, University of Nairobi).

    Özmen, K. S. (2011a). Analysing washback effect of SEPPPO on prospective English teachers. The Journal of Language and Linguistic Studies, 7(2), 24-52.

    Özmen, K. S. (2011b). Washback effects of the inter-university foreign language examination on foreign language competencies of candidate academics. Novitas-ROYAL (Research on Youth and Language), 5(2), 215-228.

    Pearson, I. (1988). Tests as levers for change. In D. Chamberlain & R.J. Baumgardner (Eds.), ESP in the classroom: Practice and evaluation (pp. 98-107). Modern English, London.

    Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Sage.

    Pituch, K. A., & Stevens, J. P. (2016). Applied Multivariate Statistics for the Social Sciences. 6th ed. New York and London.

    Sadeghi, K., Ballıdağ, A., & Mede, E. (2021). The washback effect of TOEFL iBT and a local English Proficiency Exam on students' motivation, autonomy and language learning strategies. Heliyon, 7(10).

    Sayın, B. A., & Aslan, M. M. (2016). The negative effects of undergraduate placement examination of English (LYS-5) on ELT students in Turkey. Participatory Educational Research, 3(1), 30-39.

    Scaramucci, M. V. (2002). Entrance examinations and TEFL in Brazil: a case study. Revista Brasileira de Linguística Aplicada, 2, 1-13.

    Seçer, İ. (2018). Psikolojik test geliştirme ve uyarlama süreci: SPSS ve LISREL uygulamaları. Anı yayıncılık.

    Sert, C. (2015). The role of teacher field knowledge test on teachers’ knowledge. Procedia-Social and      Behavioral Sciences, 199, 801-805.

    Aktuğ, C. S. (2018). An evaluation of teacher domain-specific knowledge test for teacher candidates of    English in Turkey.

    Sevimli, S. (2007). The washback effect of foreign language foreign language  component of the                university entrance examination on the teaching and learning context of English language groups in secondary education (A case study). [Unpublished MA Thesis,          Gaziantep University].

    Shohamy, E. (1993). The Power of Tests: The Impact of Language Tests on Teaching and Learning.          NFLC Occasional Papers.

    Shohamy, E. (2017). The discourse of language testing as a tool for shaping national,     global, and           transnational identities. In The Discourse of Culture and Identity in National and             Transnational Contexts (pp. 115-126). Routledge.

    Shohamy, E., Donitsa-Schmidt, S., & Ferman, I. (1996). Test impact revisited: Washback effect over time. Language Testing, 13(3), 298–317. https://doi.org/10.1177/026553229601300305

    Shrestha, N. (2021). Factor analysis as a tool for survey analysis. American Journal of Applied    Mathematics and Statistics, 9(1), 4-11.

    Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational    Review, 57(1), 1-22.

    Şeker, H., & Gençdoğan, B. (2006). Psikolojide ve eğitimde ölçme aracı geliştirme. Nobel.          

    Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International journal of medical education, 2, 53.

    Taylor, L. (2005). Washback and impact. ELT Journal, 59(2), 154-155.

    Taylor, R., Hardman, M., Riordan, S., Pillinger, C., & Moss, G. (2023). Teacher quality, recruitment, and                retention: Rapid Evidence Assessment.

    Thomas, S., Smees, R., Madaus, G. F., & Raczek, A. E. (1998). Comparing Teacher       Assessment and   Standard Task Results in England: the relationship between                pupil characteristics and    attainment. Assessment in Education: Principles, Policy & Practice, 5(2), 213-246.

    Thornbury, S. (1997). About Language: Tasks for Teachers of English. Cambridge          University Press.

    Wall, D. & Alderson, J. (1993). Examining washback: The Sri Lankan impact study. Language Testing, 10, 41-69.

    Watanabe, Y. (1996). Investigating washback in Japanese EFL classrooms: Problems of methodology. Australian review of applied linguistics. Series S, 13(1), 208-239.

    Verma, J. P., & Abdel-Salam, A. S. G. (2019). Testing statistical assumptions in research. John Wiley & Sons.

    Yağcı, E., & Kurşunlu, E. (2017). Öğretmen adaylarının aldıkları mesleki eğitimin yeterliliğine    ve Kamu Personeli Seçme Sınavı’na (KPSS) yönelik görüşlerinin incelenmesi. Uluslararası Eğitim Programları ve Öğretim Çalışmaları Dergisi, 7(14), 1-14.

    Yeşilçınar, S. (2018). An Evaluation of EFL Teacher Assessment and Evaluation: A Suggested Model. [Doctoral Dissertation, Gazi University Institute of Educational Sciences]. Ulusal Tez Merkezi. https://tez.yok.gov.tr/UlusalTezMerkezi/TezGoster?key=fS4sqEZr79C_n60Rk6MjFX0kpOrNW5yNkjJWMTkQfWmsbZMWgRAYHAsd97d3kpl1

    Yeşilçınar, S., & Çakır, A. (2020). Development and validation of the English teachers' attitudes towards recruitment system scale. Ilkogretim Online, 19(3).

    Yıldırım, Ö. (2010). Washback effects of a high-stakes university entrance exam: Effects of the   English section of the university entrance exam on future language teachers in Turkey. The Asian EFL Journal Quarterly, 12(2), 92-116.