The Washback Effects of the Ministry of Science, Research and Technology (MSRT) Test on Iranian Ph.D. Candidates' English Language Learning Skills Running Title: Washback Effects of the Ministry of

Document Type : Original Research

Authors
1 PhD Candidate, Department of English, Islamic Azad University, Shiraz Branch, Shiraz, Iran
2 Department of English, Marvdasht Branch, Islamic Azad University, Marvdasht, Iran.
3 Department of English, Shiraz Branch, Islamic Azad University, Shiraz, Iran
Abstract
This explanatory sequential mixed-method study aimed to investigate the washback effect of a local English Proficiency Exam (the Ministry of Science, Research and Technology Test (MSRT)) on Iranian Ph.D. candidates' English language learning skills. The study also examined the changes Iranian Ph.D. candidates perceive as essential to make the MSRT module implementation more useful for English learning. To this end, a sample of 150 Ph.D. candidates with differences in gender, age, and major were invited from Islamic Azad universities of Shiraz and Marvdasht to complete a questionnaire designed in terms of MSRT washback. The participants were chosen through a combination of stratified and convenience sampling methods. Furthermore, a sample of 20 PhD candidates from the same population was selected based on purposeful sampling and participated in the semi-structured interview sessions. The results of the data analysis represented some positive and negative washback effects on MSRT. Moreover, the participants suggested some recommendations on necessary changes and alterations for the MSRT test to facilitate university English learning further. Their feedback was in line with their viewpoints on why MSRT preparation had not satisfactorily prepared them to manage university workloads. The pedagogical implications will be discussed.

Keywords

Subjects


Abeywickrama, P. (2013). Why not non-native varieties of English as listening comprehension test input?. RELC Journal, 44(1), 59-74.
Akpınar, K. D. & Çakıldere, B. (2013). Washback effects of high-stakes language tests of Turkey (KPDS and ÜDS) on productive and receptive skills of academic personnel. Journal of Language and Linguistic Studies, 9(2), 81-94.
Alderson, J. C., & Wall, D. (1993). Does washback exist?. Applied linguistics, 14(2), 115-129.
Ali, M. M., & Hamid, M. O. (2020). Teaching English to the test: Why does negative washback exist within secondary education in Bangladesh? Language Assessment Quarterly, 17(2), 129-146.
Ali, M. M., Hamid, M. O., & Hardy, I. (2020). Ritualisation of testing: Problematising high-stakes English-language testing in Bangladesh. Compare: A Journal of Comparative and International Education, 50(4), 533-553.
Amengual Pizarro, M. (2010). Exploring the washback effects of a high-stakes English test on the teaching of English in Spanish upper secondary schools. Revista Alicantina de Estudios Ingleses, 23, 149-170.
Bachman, L. F. & Palmer, A. S. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford.
Backman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford University Press.
Binnahedh, I. A. (2022). E-assessment: Washback effects and challenges (examining students' and teachers' attitudes towards e-tests). Theory and Practice in Language Studies, 12(1), 203-211.
Borghouts, L. B., Slingerland, M., & Haerens, L. (2017). Assessment quality and practices in secondary PE in the Netherlands. Physical Education and Sport Pedagogy, 22(5), 473–489.
Butler, Y. G., Lee, J., & Peng, X. (2022). Failed policy attempts for measuring English speaking abilities in college entrance exams: Cases from China, Japan, and South Korea. English Today, 38(4), 271-277.
Cheng, L. (2014). Consequences, impact, and washback. In A. J. Kunnan (Ed.), The companion to language assessment (pp. 1130–1145). West Sussex, UK: Wiley Blackwell.
Cheng, L., & Curtis, A. (2012). Test impact and washback: Implications for teaching and learning. Cambridge guide to second language assessment, 89-95.
Chapelle, C. A. (2020). An introduction to language testing's first virtual special issue: Investigating consequences of language test use. Language Testing, 37(4), 638-645.
Damankesh, M., & Babaii, E. (2015). The washback effect of Iranian high school final examinations on students' test-taking and test-preparation strategies. Studies in Educational Evaluation, 45, 62-69.
Dammak, H., Khatibi, A., & Azam, S. F. (2022). Washback of the high-stakes English Baccalaureate exam: Empirical investigation of 4th English language teachers' attitudes and practices in Tunisia. Journal of Positive School Psychology, 5106-5126.
de la Fuente Fernández, A., & Calvo Pascual, M. A. (2022). Washback of Spanish university entrance examination on chemistry teaching in upper secondary education. Assessment in Education: Principles, Policy & Practice, 29(4), 422-440.
Dong, M. (2020). Structural relationship between learners' perceptions of a test, learning practices, and learning outcomes: A study on the washback mechanism of a high-stakes test. Studies in Educational Evaluation, 64(1), 100824.
Dong, M., Fan, J., & Xu, J. (2021). Differential washback effects of a high-stakes test on students' English learning process: Evidence from a large-scale stratified survey in China. Asia Pacific Journal of Education, 43(1), 1-18.
Estaji, M., & Alikhani, H. (2020). The first certificate in English textbook washback Effect: A comparison of teachers' and learners' perceptions. Teaching English Language, 14(1), 119-152.
Gebril, A. (2018). Test preparation in the accountability era: Toward a learning‐oriented approach. TESOL Journal, 9(1), 4-16.
Ghorbani, M. R., Abbassi, H., & Razali, A. B. M. (2021). Exploring the Shortcomings of the Iranian MSRT English Proficiency Test. Pertanika Journal of Social Sciences & Humanities, 29.
Gordon, A. (2020). Tests as drivers of change in education: Contextualizing washback, and the possibility of wash-forward. VNU Journal of Foreign Studies, 36(4), 36-46.
Green, A. (2007). IELTS washback in context: Preparation for academic writing in higher education (Vol. 25). Cambridge University Press.
Hatipoğlu, Ç. (2016). The impact of the university entrance exam on EFL education in Turkey: Pre-service English language teachers' perspective. Procedia-Social and Behavioral Sciences, 23(2), 136-144.
Heshmatifar, Z., Zareian, G. R., & Davoudi, M. (2018). A Qualitative investigation of factors affecting a preparation course for MSRT: A grounded theory. Foreign Language Research Journal, 8(1), 27-56.
Hou, Q., Chen, Z., & Teng, M. (2022). Today's baton and tomorrow's vision: The effect of strengthening patent examination system on corporate innovation strategies. Journal of Business Research, 144, 614-626.
Hughes, A. (2003). Testing for language teachers. Cambridge university press.
Imlig, F., & Ender, S. (2018). Towards a national assessment policy in Switzerland: Areas of conflict in the use of assessment instruments. Assessment in Education: Principles, Policy & Practice, 25(3), 272–290.
Indrawati, T. (2018). Washback of English national examination on teaching learning process. RETAIN, 6(3).
Izadpanh, S., & Abdollahi, M. (2021). The washback impacts of task-based assessment on Iranian EFL learners' vocabulary learning and grammatical ability. International Journal of Research in English Education, 6(3), 21-40.
Karimi, M. N. & Mozaffar, M., (2018). A mixed method inquiry into three techniques of data gathering in language teacher supervision: Video-taping, audio-taping
and field notes. The International Journal of Humanities, 25(4), 18-42.
Kilickaya, F. (2016). Washback effects of a high-stakes exam on lower secondary school English teachers' practices in the classroom. Lublin Studies in Modern Languages and Literature, 40(1), 116-134.
Kong, X., Zhang, X., Yan, C., & Ho, K. C. (2022). China's historical imperial examination system and corporate social responsibility. Pacific-Basin Finance Journal, 72, 1-13.
Lewthwaite, M. D. (2007). Teacher and student sttitudes to IELTS writing tasks: positive or negative washback?. Learning and Teaching in Higher Education: Gulf Perspectives, 4(2), 11-30.
Madaus, G. F. (1991). The effects of important tests on students: Implications for a national examination system. The Phi Delta Kappan, 73(3), 226-231.
Maghsoudi, M., & Khodamoradi, A. (2023). An evaluation of the English language textbooks for Iranian junior high schools based on the objectives of fundamental reform document of education (FRDE). The International Journal of Humanities, 30(2), 98-122.
Moradi, E. (2019). The Washback Effect of Final Examinations at Payame Noor University on Teaching and Learning. Malaysian Journal of Distance Education, 21(1).
Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231–259.
Özmen, K. S. (2011). Washback effects of the inter-university foreign language examination on foreign language competences of candidate academics. Novitas-ROYAL (Research on Youth and Language), 5(2), 215-228.
Pan, Y. C., & Newfields, T. (2012). Tertiary EFL proficiency graduation requirements in Taiwan: A study of washback on learning. Electronic Journal of Foreign Language Teaching, 9(1), 108-122.
Papakammenou, I. R. (2018). Washback on language skills: A study of EFL multi-exam preparation classes. Revisiting the assessment of second language abilities: From theory to practice, 437-454.
Pearson, 1. (1988). Tests as levers for change. In D. Chamberlain, & R. J. Baumgardner
(Eds.), ESP in the classroom: practice and evaluation (pp. 98-107). Mondern
English Publications.
Polat, M. (2019). Washback effect of Turkish foreign language proficiency exam YDS: A scale development study. Journal of Language and Linguistic Studies, 15(4), 1252-1268.
Qi, L. (2004). Has a high-stakes test produced the intended changes?. In L. Cheng, Y.
Watanabe & A. Curtis (Eds.), Washback in Language Testing: Research Contexts and
Methods (pp.171-190). Laurence Erlbaum & Associates.
Rezaeian, M., Seyyedrezaei, S. H., Barani, G., & Seyyedrezaei, Z. S. (2020). An investigation into Iranian non-English PhD students’ perceptions regarding learning as an educational consequence of EPT. Iranian Journal of Learning & Memory, 3(10), 71-80.
Rind, I. A., & Mari, M. A. (2019). Analyzing the impact of external examination on teaching and learning of English at the secondary level education. Cogent Education, 6(1), 1-14.
Sadeghi, K., Ballıdağ, A., & Mede, E. (2021). The washback effect of TOEFL iBT and a local English Proficiency Exam on students' motivation, autonomy and language learning strategies. Heliyon, 7(10), 1-9.
Sadler, D. R. (2016). Three in-course assessment reforms to improve higher education learning outcomes. Assessment & Evaluation in Higher Education, 41(7), 1081-1099.
Saglam, A. L. G., & Farhady, H. (2019). Can exams change how and what learners learn? Investigating the washback effect of a university English language proficiency test in the Turkish context. Advances in Language and Literary Studies, 10(1), 177-186.
Saville, N. D. (2009). Developing a model for investigating the impact of language assessment within educational contexts by a public examination provider. [Unpublished
Doctoral Dissertation]. University of Bedfordshire.
Schmidt, C. (2004). The analysis of semi-structured interviews. In U. Flick, E. von Kardorff, & I. Steinke (Eds.), A companion to qualitative research (pp. 253–258). Sage.
Shirzadi, D., & Amerian, M. (2020). Washback effects of multiple-choice, cloze and metalinguistic tests on EFL students writing. Indonesian Journal of Applied Linguistics, 9(3), 536-544.
Siahpoosh, H., Ramak, M., & Javandel, B. (2019). Washback effect of IELTS on Iranian learners' perspectives‎ on IELTS preparation courses‎. Journal of Applied Linguistics and Language Research, 6(2), 43-52.
Soomro, A. H., & Shah, S. Z. A. (2016). Effects of washback on high school teachers of English. International Journal of English and Education, 6(2), 201-210.
Spolsky, B. (1994). Policy issues in testing and evaluation. The Annals of the American Academy of Political and Social Science, 532(1), 226-237.
Sukyadi, D. & R. Mardiani (2011). The washback effect of the English National Examination (ENE) on English teachers’ classroom teaching and students’ learning. Kata, 13(1), 96-111.
Sumera, A., Barua, A., & Navamoney, A. (2015). Exploring the effect of backwash in first year medical students and comparison with their academic performances. Procedia-Social and Behavioral Sciences, 174, 491-495.
Tsang, C. L., & Isaacs, T. (2022). Hong Kong secondary students' perspectives on selecting test difficulty level and learner washback: Effects of a graded approach to assessment. Language Testing, 39(2), 212-238.
Wall, D. (1997). Impact and washback in language testing. Encyclopedia of language and education, 7, 291-302 .
Watanabe, Y. (2004). Methodology in washback studies. In Washback in language testing (pp. 41-58). Routledge.
Wang, W. (2010). Investigating the washback effect of the new CET 4 listening comprehension subtest on language learners. Chinese Journal of Applied Linguistics 33.5, 28-39.
Xie, Q., & Andrews, S. (2013). Do test design and uses influence test preparation? Testing a model of washback with Structural Equation Modeling. Language Testing, 30(1), 49-70.
Yildirim, O. (2010). Washback effects of a high-stakes university entrance exam: Effects of the English section of the university entrance exam on future English language teachers in Turkey. The Asian EFL Journal Quarterly, 12(2), 92-116.
Zakeri, J., Kiany, G. R., & Baradaran, A. (2018). Model, instrument, and procedure: Do we need to have second thoughts about the evaluation process of English language institutes? International Journal of Humanities, 25(4), 42-64.
Zhan, Y., & Andrews, S. (2014). Washback effects from a high-stakes examination on out-of-class English learning: Insights from possible self-theories. Assessment in Education: Principles, Policy &Practice, 21(1), 71-89.
Zhang, H., & Bournot-Trites, M. (2021). The long-term washback effects of the National Matriculation English Test on college English learning in China: Tertiary student perspectives. Studies in Educational Evaluation, 68, 1-21.
Zheng, X. (2019). Exploring the washback effects of the Chinese national matriculation English test (NMET) on student learning and their test anxiety. [Unpublished master’s dissertation]. Queen’s University Canada.