Journal of Language Horizons

Current Issue

By Issue

By Author

By Subject

Author Index

Keyword Index

About Journal

Aims and Scope

Editorial Board

Executive staff

Publication Ethics

Indexing and Abstracting

Related Links

FAQ

Journal Metrics

Peer Review Process

Journal Metrics

News

Guide for Authors

Ethics Commitment Form

Conflict of Interest

Publons Registration Guide

The Reviewer of the Journal in 2020

List of 2021 Reviewer

Reviewers 2022

Developing and Validating a New Version of an EFL Multiple-Choice Reading Comprehension Test Based on Fuzzy Logic

Document Type : Research article

Authors

1 PhD Candidate, Department of English, University of Tehran, Kish International Campus

2 Professor of Applied Linguistics, Department of English Language and Literature, Ferdowsi University of Mashhad

3 Assistant Professor of English Department, University of Tehran

Abstract

Multiple-choice tests do not assess examinees’ knowledge in accord with reality. In fact, the partial knowledge of examinees is not assessed. Providing a new approach to the assessment of reading comprehension in the framework of fuzzy logic, this study aims to measure this partial knowledge. In this approach, participants have to choose as many correct options as there are considering the stem. Therefore, the correct answer to each question can range from one option to all options. For the first session, an expository and an argumentative genre, and for the second session, the reading section of a TOEFL test was used. The results showed that the approach is fairer as it considers the partial knowledge of the examinees while in other common multiple-choice tests this is ignored. Also, the use of idea units as the units comprising a text gives us clues regarding the degree of difficulty of different parts of a text as well as clues about why misunderstanding may occur of the same text among different people.

Keywords

References
Al-Hammadi, A. S., & Milne, R. H. (2004). A neuro-fuzzy classification approach to the assessment of student performance. Proceedings of the 2004 IEEE International Conference on Fuzzy Systems, Hungary, 837-841. doi:10.1109/FUZZY.2004.1375511
Andoline, C. (1980). Syntactic maturity and vocabulary richness of learning disabled children at four age levels. Journal of Learning Disabilities, 13(7), 27-32.
Andrews, R. (2010). Argumentation in higher education: Improving practice through theory and research. Abingdon, UK: Routledge.
Baba, A. F., Bakanay, D., & Cin, F. M. (2012). A fuzzy system for evaluating students' project in engineering education. Computer Applications in Engineering Education, 20(2), 287-294. doi: 10.1002/cae.20395
Baba, A. F., Kuscu, D., & Han, K. (2009). Developing a software for fuzzy group decision support system: A case study. The Turkish Online Journal of Educational Technology, 8(3), 22-29.
Bardovi-Harlig, K. (1992). A second look at T-unit analysis: Reconsidering the sentence. TESOL Quarterly, 26, 390-395.
Bardovi-Harlig, K., & Bofman, T. (1988, March). A second look at T-unit analysis. Paper presented at the 22nd Annual TESOL convention, Chicago, IL.
Budd, R. (1988). Measuring proficiency in using English syntax. System, 16(2), 171-185.
Chafe, W. L. (1985). Differences between speaking and writing. In D. R. Olson, N. Torrance, & A. Hildyard (Eds.), Literacy, language and learning: The nature of consequences of reading and writing (pp. 105-123). New York, NY: Cambridge University Press.
Cohen, A. D. (1998). Strategies and processes in test-taking and SLA. In L. F. Bachman & A. D. Cohen (Eds), Interfaces between second language acquisition an language testing research (pp. 90-111). England: Cambridge University Press.
Cohen, A. D., & Upton, T. A. (2006). Strategies in responding to the new TOEFL reading task. Princeton, NJ: ETS.
Cin, F. M., & Baba, A. F. (2008, May). Assessment of English proficiency by fuzzy logic approach. Paper presented at the 8th IETC, Eskişehir, Turkey.
Cohen, L., Manion, L., & Morrison, K. (2000). Research methods in education. London, England: RoutledgeFalmer.
Distefano, P., & Valencia, S. (1980). The effects of syntactic maturity on comprehension of graded reading passages. The Journal of Educational Research, 73(5), 247-251.
Faghih, N., & Alamdar Youli, F. (2007). Manteqe fazi dar azmoonhaye chand gozine-ee [Fuzzy logic in multiple-choice tests]. Shiraz, Iran: Rakhshid.
Gee, J. P. (1996). Social linguistics and literacies: Ideology in discourses. London, England: Taylor & Francis.
Ghonsooly, B. (2013). Boroonfekani andishe dar maharate khandan dar zabane dovvom [Thinking-aloud in second language reading]. Mashhad, Iran: Ferdowsi University of Mashhad Publications.
Harris, J. (2000). An introduction to fuzzy logic applications. Dodrecht, the Netherlands: Kluwer Academic Publishers.
Hosseinchary, M., & Yosefy, F. (2008). Barresiye boloughe nahviye neveshtary dar daneshamoozane doreye ebtedaee [The investigation of written syntax development in primary school students]. Nashriye Daneshkadeh Adabiyat va Oloume Ensaniye Daneshgahe Shahid Bahonare Kerman, 24, 305-323.
Kirszner, L. G., & Mandell, S. R. (2012). Patterns for college writing: A rhetorical reader and guide (12th ed.). Boston, MA: Bedford/St. Martin’s.
Mariconda, B. (2001). Step-by-step strategies for teaching expository writing. New York, NY: Scholastic.
McNeill, F. M., & Thro, E. (1994). Fuzzy logic: A practical approach. Chestnut Hill, MA: Academic Press.
Rashidi, N., & Shahballa, A. H. (2010, July). The contribution of the idea unit analysis to the measurement of the reader's meaning and author's meaning coincidence. Paper presented at the 3rd Annual Seminar on Current Issues and Problems in L2 Reading and Writing, Shiraz, Iran.
Richards, J. C. (1983). Listening comprehension: Approach, design, procedure. TESOL Quarterly, 17, 219-240.
Roll, M, Frid, J., & Horne, M. (2007). Measuring syntactic complexity in spontaneous spoken Swedish. Language and Speech, 50(2), 227-245.
Samim-Banihashemi, A. (1992). Motale’ye roshde nahviye neveshtari dar miane daneshamoozan [The investigation of written syntax development among students] (Unpublished MA thesis). Shiraz University, Shiraz, Iran.
Shahballa, A. H., & Alamdar Youli, F. (2012). Reading comprehension of different genres: A fuzzy approach. International Journal of English Linguistics, 2(1), 17-27.
Zadeh, L. A. (2008). Is there a need for fuzzy logic? Information Sciences, 178, 2751–2779.
Zahedi, H. (2001). A fuzzy logic approach toward appreciating partial knowledge in multiple-choice testing (Unpublished master’s thesis). Shiraz University, Shiraz, Iran.
Journal of Language Horizons
Volume 3, Issue 1 - Serial Number 5
January 2019
Pages 71-92
Files
Share
How to cite
Statistics