The Effect of Various Testing Conditions on Long-Term Retention of Reading Materials: The Case of Initial and Delayed Test Types, and Feedback on Test

Authors

1 PhD candidate of TEFL at Allameh Tabataba’i University of Tehran

2 Assistant professor of TESL at University of Bojnord

3 MA student of TEFL at Allameh Tabataba’i University of Tehran

Abstract

This study investigated various testing conditions for their influence on long-term retention of reading materials. To do so, 84 English as Foreign Language (EFL) learners were randomly selected from a total of 746 and were randomly divided into two equal groups to participate in two experiments. In each experiment, the participants studied some texts and participated in some initial testing conditions before taking a 10-day delayed final exam. The testing conditions of the first experiment were 1) study + simultaneous open-book test, 2) study + open-book test, 3) study + closed-book test + feedback, 4) study + closed-book test, 5) no study no test, and 6) study with no test. The second phase was a replication of the first 5 testing conditions of the first phase accompanied by 3 more conditions, namely, 6) study + study, 7) study + study + study, 8) study + study + study + study. Analysis of variance results showed that different test types, feedback on test, and restudying could differently influence long-term retention. It was found that feedback on test had the highest effect on retention. Similarly, taking a test after study was more influential than restudying. Finally, open-book testing worked better than closed-book testing. 
 

Keywords


Article Title [Persian]

تاثیر شرایط مختلف آزمون بر به خاطر سپاری مطالب : مقایسه موردی انواع آزمون های اولیه و با تاخیر و بازخورد به آزمون

Authors [Persian]

  • محمود قره چلو 1
  • محمدرضا قربانی 2
  • فرهاد غیاثوند 3
1 دانشجوی دکترای آموزش زبان انگلیسی در دانشگاه علامه طباطبایی تهران
2 استادیار TESOL در دانشگاه بجنورد
3 دانشجوی دکترای آموزش زبان انگلیسی در دانشگاه علامه طباطبایی تهران
Abstract [Persian]

اگرچه تاثیر انواع آزمون و بازخورد به آزمون بر به خاطرسپاری مطالب به طور گسترده ای مورد مطالعه قرار گرفته است، اما تنها یک مطالعه آنها را با هم مقایسه کرده است ( آگاروال، کارپیک، کانگ، رودیگر و مک درموت، 2007). برای بررسی صحت نتایج، این مطالعه­ مشابه انجام شده است. این مطالعه تجربی به منظور بررسی میزان تاثیر هر یک از شرایط اولیه آزمون بر نگهداری طولانی مدت اطلاعات صورت گرفت. ابتدا 84 زبان آموز به طور تصادفی از مجموع 746 نفر انتخاب شدند و به سه گروه مساوی تقسیم شدند تا در دو آزمایش شرکت کنند. در هر آزمایش، شرکت کنندگان چندین متن را مورد مطالعه قرار داده و در برخی از شرایط آزمون شرکت کردند. شرایط آزمون در آزمایش اول شامل: 1) مطالعه + آزمون کتاب باز به طور همزمان، 2 ) مطالعه + امتحان کتاب باز، 3) مطالعه + آزمون کتاب بسته + بازخورد، 4) مطالعه + آزمون کتاب بسته، 5) بدون مطالعه بدون آزمون کنترل و 6) مطالعه بدون آزمون بود. آزمایش دوم شامل تکرار 5 شرایط آزمونی آزمایش اول به همراه 3 شرایط اضافی شامل، 6) مطالعه+ مطالعه،7 ) مطالعه+ مطالعه+ مطالعه،8 ) مطالعه+ مطالعه+ مطالعه+ مطالعه بود. نتایج تحلیل واریانس نشان داد که انواع مختلف آزمون، بازخورد به آزمون و بازمطالعه می توانند به شکل های متفاوتی بر به­خاطرسپاری مطالب تاثیر بگذارند .همچنین مشخص شد که بازخورد به آزمون بالاترین تاثیر را بر به­خاطرسپاری مطالب دارد. به طرزی مشابه، گرفتن آزمون پس از مطالعه موثرتر از باز مطالعه بود. و در نهایت، آزمون کتاب باز عملکرد بهتری نسبت به آزمون کتاب بسته در این زمینه داشت.
 

Keywords [Persian]

  • آزمون کتاب بسته
  • آزمون کتاب باز
  • آزمون کتاب بسته به همراه بازخورد
  • دوره مطالعه اولیه
  • حفظ و ماندگاری
Achert, P., & Lee, L. (2005). Reading and vocabulary development 4: Concepts and comments (3rd ed). Boston: Thomson Heinle.

Agarwal, P. K., Karpicke, J. D., Kang, S. H., Roediger, H. L., & McDermott, K. B. (2008). Examining the testing effect with open‐and closed‐book tests. Applied Cognitive Psychology22(7), 861-876.

Bangert-Drowns, R. L., Kulik, C. L. C., Kulik, J. A., & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of educational research61(2), 213-238.

Bjork, R. A. (1999). Assessing our own competence: Heuristics and illusions. In D. Gopher, & A. Koriat (Eds.), Attention and performance XVII. Cognitive regulation of performance: Interaction of theory and application (pp. 435-459). Cambridge, MA: MIT Press.

Butler, A. C., & Roediger III, H. L. (2007). Testing improves long-term retention in a simulated classroom setting. European Journal of Cognitive Psychology19(4-5), 514-527.

Carpenter, S. K., Pashler, H., & Vul, E. (2006). What types of learning are enhanced by a cued recall test? Psychonomic Bulletin & Review13(5), 826-830.

Cnop, I., & Grandsard, F. (1994). An open‐book exam for non‐mathematics majors. International Journal of Mathematical Education in Science and Technology25(1), 125-130.

Eilertsen, T. V., & Valdermo, O. (2000). Open-book assessment: A contribution to improved learning? Studies in Educational Evaluation26(2), 91-103.

Ellis, R., Sheen, Y., Murakami, M., & Takashima, H. (2008). The effects of focused and unfocused written corrective feedback in an English as a foreign language context. System36(3), 353-371.

Epstein, M. L., Epstein, B. B., & Brosvic, G. M. (2001). Immediate feedback during academic testing. Psychological reports88(3), 889-894.

Epstein, M. L., Lazarus, A. D., Calvano, T. B., Matthews, K. A., Hendel, R. A., Epstein, B. B., & Brosvic, G. M. (2010). Immediate feedback assessment technique promotes learning and corrects inaccurate first responses. The Psychological Record52(2), 187-201.

Farrokhi, F., & Sattarpour, S. (2012). The effects of direct written corrective feedback on improvement of grammatical accuracy of high-proficient L2 learners. World Journal of Education2(2), p49.

Feller,M. (1994). Open-book testing and education for the future. Studies in Educational Evaluation, 20, 235-238.

Ferris, D., & Roberts, B. (2001). Error feedback in L2 writing classes: How explicit does it need to be? Journal of second language writing10(3), 161-184.

Glover, J. A. (1989). The ‘‘testing’’ phenomenon: Not gone, but nearly forgotten. Journal of Educational Psychology, 81, 392-399.

Jacob, B. A., & Lefgren, L. (2004). Remedial education and student achievement: A regression-discontinuity analysis. Review of economics and statistics86(1), 226-244.

Jacobs, L. C., & Chase, C. I. (1992). Developing and using tests effectively. A guide for faculty. Jossey-Bass Inc: San Francisco, CA.

Jacoby, L. L. (1978). On interpreting the effects of repetition: Solving a problem versus remembering a solution. Journal of Verbal Learning & Verbal Behavior, 17, 649-667.

Kang, S. H., McDermott, K. B., & Roediger III, H. L. (2007). Test format and corrective feedback modify the effect of testing on long-term retention. European Journal of Cognitive Psychology19(4-5), 528-558.

Karpicke, J. D., & Roediger, H. L. (2007a). Expanding retrieval promotes short-term retention, but equally spaced retrieval enhances long-term retention. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 704-719.

Karpicke, J. D., & Roediger, H. L. (2007b). Repeated retrieval during learning is the key to long-term retention. Journal of Memory and Language, 57, 151-162.

McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007). Testing the testing effect in the classroom. European Journal of Cognitive Psychology19(4-5), 494-513.

McDaniel, M. A., Roediger, H. L., & McDermott, K. B. (2007). Generalizing test-enhanced learning from the laboratory to the classroom. Psychonomic bulletin & review14(2), 200-206.

Mendenhall, W., Beaver, R. J., & Beaver, B. M. (2002). A brief introduction to probability and statistics. Cengage Learning Editors.

Modigliani, V. (1976). Effects on a later recall by delaying initial recall. Journal of Experimental Psychology: Human Learning & Memory, 2, 609-622.

Mohanan, K. P. (1997). Open book examination. A report and a response to some recurrent concerns, Seminar on conducting open book examinations organized by Centre for Development of Teaching and Learning at National University of Singapore, January.

Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005). When does feedback facilitate learning of words? Journal of Experimental Psychology: Learning, Memory, and Cognition31(1), 3-8

Roediger, H. L., & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in cognitive sciences15(1), 20-27.

Roediger, H. L., & Karpicke, J. D. (2006a). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181-210.

Roediger, H. L., & Karpicke, J. D. (2006b). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17, 249-255.

Schmidt, R. A., Young, D. E., Swinnen, S., & Shapiro, D. C. (1989). Summary knowledge of results for skill acquisition: support for the guidance hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition15(2), 352.

Sheen, Y. (2007). The effect of focused written corrective feedback and language aptitude on ESL learners' acquisition of articles. TESOL Quarterly, 41(2), 255-283.

Theophilides, C., & Koutselini, M. (2000). Study behavior in the closed-book and the open-book examination: A comparative analysis. Educational Research and Evaluation6(4), 379-393.

Whitten, W. B., & Bjork, R. A. (1977). Learning from tests: Effects of spacing. Journal of Verbal Learning and Verbal Behavior16(4), 465-478.