Document Type : research paper
Authors
1 Department of Foreign Languages and Linguistics Faculty of literature and Humanities,, Shiraz University, Shiraz , Iran
2 Department of Foreign Languages and Linguistics, Faculty of Literature and Humanities, Shiraz University, Shiraz, Iran.
Abstract
Error-tagged learner corpora are helpful resources in language teaching, providing authentic samples of learners' errors. This longitudinal study aims to investigate accuracy development in three subsequent writing performances of Iranian EFL learners across beginner, intermediate, and advanced proficiency levels. This investigation involved developing and annotating the first error–tagged English written learner corpus for Iranian EFL learners, followed by analyzing the errors. The current corpus includes 35747 tokens from 219 written texts, manually transcribed and annotated based on the latest version of the Louvain Error Tagging Manual. A total of 6917 errors were identified. The developmental patterns of all error categories were detected using potential occasion analysis, specifically focusing on the most frequent error types (i.e., articles, noun numbers, and personal pronoun errors). The results indicated that grammar, lexical, and word redundant/missing/order errors increase significantly as proficiency levels increase. Conversely, form, lexico-grammatical, and punctuation errors exhibited a U-shaped trend, rising from beginner to intermediate levels and declining from intermediate to advanced levels.
Additionally, the accuracy of article and noun number usage improved from beginner to intermediate levels but showed little or no change from intermediate to advanced levels, suggesting that higher proficiency levels did not lead to much improvement in this area. However, there was a significant decrease in personal pronoun accuracy from beginner to intermediate levels, followed by a slight increase from intermediate to advanced levels. This study reveals error patterns across different proficiency levels, offering guidance for teachers to adapt their writing instruction methods and enhance learners’ writing accuracy.
Keywords
Abe, m., & Tono, Y. (2005). Variations in L2 spoken and written English: investigating patterns of grammatical errors across proficiency levels. In P. Danielsson, & M. Wagenmakers, Proceedings from the Corpus Linguistics Conference Series (pp. 1-11). Birmingham.
Biber, D., Corad, S., & Reppen, R. (1998). Corpus linguistics: Investigating language structure and language use. Cambridge University Press.
Bintz, W. P. (2011). Teaching vocabulary across the curriculum. Middle School Journal, 42(4), 44-53.
Brezina, V., Weill-Tessier, P., & McEnery, A. (2020). LancsBox v. 5.x. [software].
Brown, H. D. (2014). Principles of language learning and teaching (6th ed.). Pearson Education.
Carletta, J. (1996). Assessing agreement on classffication tasks The kappa statistic. Computational Linguistics, 22(2), 249-254. http://dl.acm.org/citation.cfm?id=230386.230390
Cohen, J. (1960). A coeffictent of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46. https://doi.org/10.1177/001316446002000104
Council of Europe. (2001). Council of Common European framework of reference for languages: Learning, teaching, assessment. Press Syndicate of the University of Cambridge.
Dagneaux, E., Denness, S., & Granger, S. (1998). Computer-aided error analysis. System, 26(2), 163–74. https://doi.org/10.1016/S0346-251X(98)00001-3
De Graaff, R. (2019). You’ve got to crack a few eggs to make an omelette. Linguistic complexity and instruction in SLA: What’s in it for language teaching? Instructed Second Language Acquisitionn, 3(2), 249–258. https://doi.org/10.1558/isla.39398
Derakhshan, A., & Karimian Shirejini, R. (2020). An investigation of the iranian efl learners’ perceptions towards the most common writing problems. SAGE Open, 10(2), 1-10. https://doi.org/10.1177/2158244020919523
Ellis, R. (1994). The study of second language acquisition. Oxford University Press.
Farooq, M. S., Uzair-Ul-Hassan, M., & Wahid, S. (2020). Opinion of second language learners about writing difficulties in English language. South Asian Studies, 27(1), 183-194.
Fati, M. (2013). The effect of English writing proficiency in the type and amount of errors produced by Moroccan EFL students. International Journal of Education and Research, 1(9), 1-12. https://doi.org/10.30495/JAL.2019.671929
Flowerdew, L. (2001). The exploitation of small learner corpora in EAP materials design. In M. Ghadessy, A. Henry, & R. L. Roseberry, Small corpus studies and ELT: Theory and practice (pp. 363-379). Benjamins.
Gass, S. M., & Selinker, L. (2008). Second language acquisition: An introductory course. Routledge.
Ghafar Samar, R. G., & Seyyed Rezaai, S. H. (2006). Analysis of errors made by Iranian English learners in their written production: A new answer to an old question? Iranian Foreign Language Learning Journal, 80, 59-64.
Gorjian, B. (2022). Investigating the Interlingual errors in students’ essay: The case of error classification. Journal of Education, Teaching and Social Studies, 4(3), 26-44. https://doi.org/10.22158/jetss.v4n3p26
Granger, S. (2002). A bird's-eye view of computer learner corpus research. In S. Granger, J. Hung, S. Petch-Tyson & J. Hulstijn (Eds.), Computer learner corpora, second language acquisition and foreign language teaching (pp. 3-33). John Benjamins.
Granger, S. (2003). Error-tagged learner corpora and CALL: A promising synergy. CALICO Journal, 20(3), 465-480.
Granger, S., Swallow, H., & Thewi, J. (2022). The Louvain error tagging manual version 2.0. Centre for English Corpus Linguistics, Université catholique de Louvain.
Housen, A., Kuiken, F., & Vedder, I. (2012). Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA. John Benjamins Publishing Company.
Khaghaninejad, M. S., & Mavadat, R. (2015). Using English discourse markers: a comparison of Persian and English dentistry authors. Theory and Practice in Language Studies, 5(1), 97-109. https://doi.org/10.17507/tpls.0501.13
Khansir, A. A., & Shahhoseiny, H. (2013). The study of written errors of EFLpre-university learners. Journal of Language Teaching and Research, 4(6), 1253-1258.
Khansir, A., & Pakdel, F. (2020). A study of written errors of Iranian learners: A systematic review. Theory and Practice in Language Studies, 10(8), 982-987. http://dx.doi.org/10.17507/tpls.1008.18
Khazaee, H., Maftoon, P., Birjandi, P., & Rezaie Golandouz, G. (2020a). Hedges in English for academic purposes: A corpus-based study of Iranian EFL learners. International Journal of Foreign Language Teaching & Research, 8(33), 115-129.
Khazaee, H., Maftoon, P., Birjandi, P., & Rezaie Golandouz, G. (2020b). Metadiscourse markers in a corpus of learner language: The case of Iranian Efl learners. The Journal of Language and Translation (JLT), 10(3), 17-34. https://doi.org/10.30495/TTLT.2020.678752
Larsen-Freeman, D. (2006). The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied Linguistics, 27(4), 590-619. https://doi.org/10.1093/applin/aml029
Larsen-Freeman, D. (2015). Saying what we mean: Making a case for ‘language acquisition’ to become ‘language development’. Language Teaching, 48(4), 491-505. https://doi.org/10.1017/S0261444814000019
Li, Y. (2022). Corpus-based error analysis of Chinese learners' use of high-frequency verb take. English Language Teaching, 15(2), 21-30. https://doi.org/10.5539/elt.v15n2p21
Long, M. H. (1990). The least a second language acquisition theory needs to explain. TESOL Quarterly, 24(4), 649–666.
Lu, X. (2022). What can corpus software reveal about language development? In A. O'Keeffe, & M. J. McCarthy, The Routledge handbook of corpus linguistics (2nd ed.) (pp. 155-167). Routledge. https://doi.org/10.4324/9780367076399-12
Lüdeling, A., & Hirschmann, H. (2015). Error annotation systems. In S. Granger, G. Gilquin, & F. Meunier, The Cambridge handbook of learner corpus research (pp. 135-158). Cambridge University Press. https://doi.org/10.1017/CBO9781139649414
Ma, Q., & Mei, F. (2021). Review of corpus tools for vocabulary teaching and learning. Journal of China Computer-Assisted Language Learning, 1(1), 177-190. https://doi.org/10.1515/jccall-2021-2008
McEnery, T., Xiao, R., & Tono, Y. (2006). Corpus-based language studies: An advanced resource book. Routledge.
Milton, J., & Meara, P. M. (1995). How periods abroad affect vocabulary growth in a foreign language. ITL Review of Applied Linguistics, 107/108, 17-34. https://doi.org/10.1075/itl.107-108.02mil
Minh Anh, N. H., Yen, N. H., Thi Y Tho, N., & Minh Nhut, L. (2022). Grammatical errors in academic writing of English second-year students. European Journal of English Language Teaching, 7(6), 70-83. http://dx.doi.org/10.46827/ejel.v7i6.4547
Moazzeni Limoudehi, M., & Mazandarani, O. (2019). Iranian EFL learners’ written grammatical errors: Different levels of language proficiency. The Journal of English Language Pedagogy and Practice, 12(24), 116-138. https://doi.org/10.30495/jal.2019.671929
Mohseni, A., & Samadian, S. (2019). Analysis of Cohesion and Coherence in Writing Performance of Iranian Intermediate EFL Learners. Issues in Language Teaching (ILT), 8(2), 213-242. https://doi.org/10.22054/ilt.2019.21262.193
Nanda, R. P. (2015). Teacher’s efforts to cope with problems faced by students in writing skills (Bachelor’s thesis). Universitas Syiah Kuala.
Ngaiza, A. (2023). A linguistic error analysis of ESL written essays by Indian Tamil university students. Journal of Modern Research in English Language Studies, 10(4), 45-59. https://doi.org/10.30479/jmrels.2023.18208.2160
O’Keeffe, A., & Mark, G. (2017). The English grammar profile of learner competence: methodology and key findings. International Journal of Corpus Linguistics, 22(4), 457–489. https://doi.org/10.1075/ijcl.14086.oke
Ortikov, U. (2023). Practical uses of corpus analysis in designing language teaching materials. Oriental Renaissance: Innovative, Educational, Natural and Social Sciences, 3(7), 304-309. https://doi.org/10.1558/slte.25727
Pek, L. S., Mee, R. M., Shing, S. R., Theesmas, D., & Nadarajan, N. M. (2019). Strengthening tertiary students writing skills through TREND Model. Asian Journal of Contemporary Education, 3(1), 65-71. https://doi.org/10.18488/journal.137.2019.31.65.71
Pravec, N. A. (2002). Survey of learner corpora. ICAME Journal, 26(1), 8-14.
Rezaee, A. A., Norouzi, M. H., & Aryaeian, N. (2024). Iranian EFL teachers’ cognition of corrective feedback as an element of classroom management: A qualitative study. Journal of Modern Research in English Language Studies, 11(2), 2-24. https://doi.org/10.30479/jmrels.2023.18807.2216
Richards, J. C. (2008). Moving beyond the plateau: From intermediate to advanced levels in language learning. Cambridge University Press.
Ridha, N. (2012). The effect of EFL learners' mother tongue on their writings in English: Anerror analysis study. Journal of the College of Arts, 22-45.
Romer, U. (2005). Progressives, patterns, pedagogy: A corpus-driven approach to English progressive forms, functions, contexts and didactics. John Benjamins.
Ruzaitė, J., Dereškevičiūtė, S., Kavaliauskaitė-Vilkinienė, V., & Krivickaitė-Leišienė, E. (2020). Error tagging in the Lithuanian learner corpus. The Ninth conference of human language technologies - The Baltic perspective. In A. Utka, J. Vaičenonienė, J. Kovalevskaitė, D. Kalinauskaitė (Eds.), Frontiers in Artificial Intelligence and Applications 328 (pp. 253–260). IOS Press. https://doi.org/10.3233/FAIA200631
Salmani Nodoushan, M. A. (2018). Toward a taxonomy of errors in Iranian EFL learners’ basic-level writing. International Journal of Language Studies, 12(1), 61-78. https://doi.org/10.5281/zenodo.7514650
Santorini, B. (1990). Part-of-speech tagging guidelines for the Penn Treebank project. Technical Report No. MS-CIS-90-47, University of Pennsylvania, Department of Computer and Information Science.
Singh, C. S., Singh, A. J., Razak, N. A., & Ravinthar, T. (2017). Grammar errors made by ESL tertiary students in writing. English Language Teaching, Canadian Center of Science and Education, 10(5), 16-27. http://doi.org/10.5539/elt.v10n5p16
Thewissen, J. (2013). Capturing L2 accuracy developmental patterns: Insights from an error- tagged EFL learner corpus. Modern Language Journal, 97(1), 77-101. https://doi.org/10.1111/j.1540-4781.2012.01422.x
Thewissen, J. (2015). Accuracy across proficiency levels: A learner corpus approach. Presses universitaires de Louvain.
Wee, R., Sim, J., & Jusoff, K. (2009). Enhancing the quality of EAP writing through overt teaching. English Language Teaching, 2(3), 58–68.
Yusuf, Y. Q., Mustafa, F., & Iqbal, R. M. (2021). An inquiry into grammatical errors in writing committed by high achieving EFL students. International Journal of Language Studies, 15(2), 1-22.
Zarabi, H., Yamrali, N., & Gharani, N. (2023). An investigation of the most common difficulties Iranian pre-university EFL learners face in their paragraph writings. International Journal of Language and Translation Research, 3(1), 59-84.
)