Developing and Validating a New Version of an EFL Multiple-Choice Reading Comprehension Test Based on Fuzzy Logic

Shahballa, Amir Hossein; Ghonsooly, Behzad; Karami, Hosein

doi:10.22051/lghor.2019.27083.1154

Document Type : Research article

Authors

¹ PhD Candidate, Department of English, University of Tehran, Kish International Campus

² Professor of Applied Linguistics, Department of English Language and Literature, Ferdowsi University of Mashhad

³ Assistant Professor of English Department, University of Tehran

https://doi.org/10.22051/lghor.2019.27083.1154

Abstract

Multiple-choice tests do not assess examinees’ knowledge in accord with reality. In fact, the partial knowledge of examinees is not assessed. Providing a new approach to the assessment of reading comprehension in the framework of fuzzy logic, this study aims to measure this partial knowledge. In this approach, participants have to choose as many correct options as there are considering the stem. Therefore, the correct answer to each question can range from one option to all options. For the first session, an expository and an argumentative genre, and for the second session, the reading section of a TOEFL test was used. The results showed that the approach is fairer as it considers the partial knowledge of the examinees while in other common multiple-choice tests this is ignored. Also, the use of idea units as the units comprising a text gives us clues regarding the degree of difficulty of different parts of a text as well as clues about why misunderstanding may occur of the same text among different people.

Keywords

20.1001.1.2588350.2019.3.1.4.4

References

Al-Hammadi, A. S., & Milne, R. H. (2004). A neuro-fuzzy classification approach to the assessment of student performance. Proceedings of the 2004 IEEE International Conference on Fuzzy Systems, Hungary, 837-841. doi:10.1109/FUZZY.2004.1375511

Andoline, C. (1980). Syntactic maturity and vocabulary richness of learning disabled children at four age levels. Journal of Learning Disabilities, 13(7), 27-32.

Andrews, R. (2010). Argumentation in higher education: Improving practice through theory and research. Abingdon, UK: Routledge.

Baba, A. F., Bakanay, D., & Cin, F. M. (2012). A fuzzy system for evaluating students' project in engineering education. Computer Applications in Engineering Education, 20(2), 287-294. doi: 10.1002/cae.20395

Baba, A. F., Kuscu, D., & Han, K. (2009). Developing a software for fuzzy group decision support system: A case study. The Turkish Online Journal of Educational Technology, 8(3), 22-29.

Bardovi-Harlig, K. (1992). A second look at T-unit analysis: Reconsidering the sentence. TESOL Quarterly, 26, 390-395.

Bardovi-Harlig, K., & Bofman, T. (1988, March). A second look at T-unit analysis. Paper presented at the 22^nd Annual TESOL convention, Chicago, IL.

Budd, R. (1988). Measuring proficiency in using English syntax. System, 16(2), 171-185.

Chafe, W. L. (1985). Differences between speaking and writing. In D. R. Olson, N. Torrance, & A. Hildyard (Eds.), Literacy, language and learning: The nature of consequences of reading and writing (pp. 105-123). New York, NY: Cambridge University Press.

Cohen, A. D. (1998). Strategies and processes in test-taking and SLA. In L. F. Bachman & A. D. Cohen (Eds), Interfaces between second language acquisition an language testing research (pp. 90-111). England: Cambridge University Press.

Cohen, A. D., & Upton, T. A. (2006). Strategies in responding to the new TOEFL reading task. Princeton, NJ: ETS.

Cin, F. M., & Baba, A. F. (2008, May). Assessment of English proficiency by fuzzy logic approach. Paper presented at the 8^th IETC, Eskişehir, Turkey.

Cohen, L., Manion, L., & Morrison, K. (2000). Research methods in education. London, England: RoutledgeFalmer.

Distefano, P., & Valencia, S. (1980). The effects of syntactic maturity on comprehension of graded reading passages. The Journal of Educational Research, 73(5), 247-251.

Faghih, N., & Alamdar Youli, F. (2007). Manteqe fazi dar azmoonhaye chand gozine-ee [Fuzzy logic in multiple-choice tests]. Shiraz, Iran: Rakhshid.

Gee, J. P. (1996). Social linguistics and literacies: Ideology in discourses. London, England: Taylor & Francis.

Ghonsooly, B. (2013). Boroonfekani andishe dar maharate khandan dar zabane dovvom [Thinking-aloud in second language reading]. Mashhad, Iran: Ferdowsi University of Mashhad Publications.

Harris, J. (2000). An introduction to fuzzy logic applications. Dodrecht, the Netherlands: Kluwer Academic Publishers.

Hosseinchary, M., & Yosefy, F. (2008). Barresiye boloughe nahviye neveshtary dar daneshamoozane doreye ebtedaee [The investigation of written syntax development in primary school students]. Nashriye Daneshkadeh Adabiyat va Oloume Ensaniye Daneshgahe Shahid Bahonare Kerman, 24, 305-323.

Kirszner, L. G., & Mandell, S. R. (2012). Patterns for college writing: A rhetorical reader and guide (12^th ed.). Boston, MA: Bedford/St. Martin’s.

Mariconda, B. (2001). Step-by-step strategies for teaching expository writing. New York, NY: Scholastic.

McNeill, F. M., & Thro, E. (1994). Fuzzy logic: A practical approach. Chestnut Hill, MA: Academic Press.

Rashidi, N., & Shahballa, A. H. (2010, July). The contribution of the idea unit analysis to the measurement of the reader's meaning and author's meaning coincidence. Paper presented at the 3^rd Annual Seminar on Current Issues and Problems in L2 Reading and Writing, Shiraz, Iran.

Richards, J. C. (1983). Listening comprehension: Approach, design, procedure. TESOL Quarterly, 17, 219-240.

Roll, M, Frid, J., & Horne, M. (2007). Measuring syntactic complexity in spontaneous spoken Swedish. Language and Speech, 50(2), 227-245.

Samim-Banihashemi, A. (1992). Motale’ye roshde nahviye neveshtari dar miane daneshamoozan [The investigation of written syntax development among students] (Unpublished MA thesis). Shiraz University, Shiraz, Iran.

Shahballa, A. H., & Alamdar Youli, F. (2012). Reading comprehension of different genres: A fuzzy approach. International Journal of English Linguistics, 2(1), 17-27.

Zadeh, L. A. (2008). Is there a need for fuzzy logic? Information Sciences, 178, 2751–2779.

Zahedi, H. (2001). A fuzzy logic approach toward appreciating partial knowledge in multiple-choice testing (Unpublished master’s thesis). Shiraz University, Shiraz, Iran.

Journal of Language Horizons

Developing and Validating a New Version of an EFL Multiple-Choice Reading Comprehension Test Based on Fuzzy Logic

References

References

Volume 3, Issue 1 - Serial Number 5
January 2019
Pages 71-92

Developing and Validating a New Version of an EFL Multiple-Choice Reading Comprehension Test Based on Fuzzy Logic

References

References

Volume 3, Issue 1 - Serial Number 5January 2019Pages 71-92

Volume 3, Issue 1 - Serial Number 5
January 2019
Pages 71-92