Hostname: page-component-69cd664f8f-gvmbd Total loading time: 0 Render date: 2025-03-13T00:14:57.998Z Has data issue: false hasContentIssue false

Why you should stop using the ideal L2 self and the L2 motivational self-system to measure motivation (Reaction to Al-Hoorie, Hiver & In’nami, 2024)

Published online by Cambridge University Press:  10 March 2025

Neil McClelland*
Affiliation:
University of Kitakyushu, Fukuoka, Japan
Jenifer Larson-Hall
Affiliation:
University of Kitakyushu, Fukuoka, Japan
*
Corresponding author: Neil McClelland; Email: [email protected]

Abstract

This paper responds to Al-Hoorie, Hiver, and In’nami’s (2024) critique of the second language (L2) Motivational Self System (L2MSS) by advocating for an immediate cessation of its use in the absence of substantial revision and validation. We revisit foundational studies in the tradition, exposing critical methodological flaws that we feel undermine empirical support for the model. Further, we examine systemic factors that contributed to the largely uncritical acceptance of the model. Drawing on our own experiences, we reflect on how these dynamics have obstructed the adoption of more robust motivational theories available in psychology and education. We further caution that without a stronger emphasis on validating measurement instruments, similar distractions may continue to hinder progress in the field.

Type
Critical Commentary
Copyright
© The Author(s), 2025. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Al-Hoorie, A. H. (2018). The L2 motivational self system: A meta-analysis. Studies in Second Language Learning and Teaching, 8, 721754. https://doi.org/10.14746/ssllt.2018.8.4.2CrossRefGoogle Scholar
Al-Hoorie, A. H., Hiver, P., & In’nami, Y. (2024) The validation crisis in the L2 motivational self system tradition. Studies in Second Language Acquisition 46 ( 2), 307329. https://doi.org/10.1017/S0272263123000487CrossRefGoogle Scholar
Al-Hoorie, A. H., McClelland, N., Resnik, P., Hiver, P., & Botes, E. (2024). The ideal L2 self versus ability beliefs: Are they really distinct? Journal of Multilingual and Multicultural Development, 119. https://doi.org/10.1080/01434632.2024.2401103CrossRefGoogle Scholar
Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238246.CrossRefGoogle Scholar
Bentler, P. M. (1994). On the quality of test statistics covariance structure analysis: Caveat emptor. In Reynolds, C.R. (Ed.), Cognitive assessment: A multidisciplinary perspective (pp. 237260). Plenum.CrossRefGoogle Scholar
Carroll, L. (1865). Alice’s Adventures in Wonderland. Macmillan.Google Scholar
Claro, J. (2019). Identification with external and internal referents: Integrativeness and the ideal L2 Self. In Al-Hoorie, A. H. & MacIntyre, P. (Eds.), Contemporary Language Motivation Theory: 60 Years Since Gardner and Lambert (1959), pp. 233261: Multilingual Matters.Google Scholar
Csizér, K., & Dörnyei, Z. (2005a). The internal structure of language learning motivation and its relationship with language choice and learning effort. The Modern Language Journal, 89(1), 1936. https://doi.org/10.1111/j.0026-7902.2005.00263.xCrossRefGoogle Scholar
Csizér, K., & Dörnyei, Z. (2005b). Language learners’ motivational profiles and their motivated learning behavior. Language Learning, 55 (4), 613659. https://doi.org/10.1111/j.0023-8333.2005.00319.xCrossRefGoogle Scholar
Csizér, K., & Kormos, J. (2009). Learning experiences, selves and motivated learning behaviour: A comparative analysis of structural models for Hungarian secondary and university learners of English. In Dörnyei, Z. & Ushioda, E. (Eds.), Motivation, language identity and the L2 self (pp. 98119). Multilingual Matters.CrossRefGoogle Scholar
Danesh, J., & Shahnazari, M. (2020). A structural relationship model for resilience, L2 learning motivation, and L2 proficiency at different proficiency levels. Learning and Motivation, 72, 101636. https://doi.org/10.1016/j.lmot.2020.101636CrossRefGoogle Scholar
Dörnyei, Z. (1990). Conceptualizing motivation in foreign language learning. Language Learning, 40(1), 4578. https://doi.org/10.1111/j.1467-1770.1990.tb00954.xCrossRefGoogle Scholar
Dörnyei, Z. (1994). Motivation and motivating in the foreign language classroom. The Modern Language Journal, 78(3), 273284.CrossRefGoogle Scholar
Dörnyei, Z. (2005). The psychology of the language learner: Individual differences in second language acquisition. Lawrence Erlbaum Associates.Google Scholar
Dörnyei, Z., & Chan, L. (2013). Motivation and vision: An analysis of future L2 self images, sensory styles, and imagery capacity across two target languages. Language Learning, 63(3), 437462. https://doi.org/10.1111/lang.12005CrossRefGoogle Scholar
Dörnyei, Z., Csizér, K., & Neméth, N. (2006). Motivation, language attitudes, and globalisation: A Hungarian perspective. Multilingual Matters.CrossRefGoogle Scholar
Dörnyei, Z., & Taguchi, T. (2010). Questionnaires in second language research: Construction, administration, and processing (2nd ed.). Routledge.Google Scholar
Fryer, L. K., Larson-Hall, J., & Stewart, J. (2018). Quantitative methodology. In Phakiti, A., De Costa, P., Plonsky, L., & Starfield, S., (Eds.), The Palgrave handbook of applied linguistics research methodology, (pp. 5576). Palgrave Macmillan.CrossRefGoogle Scholar
Gardner, R. C. (1985a). The attitude/motivation test battery : Technical report. University of Western Ontario Press.Google Scholar
Gardner, R. C. (1985b). Social psychology and second language learning: The role of attitudes and motivation. Edward Arnold.Google Scholar
Gardner, R. C., & Lambert, W. E. (1972). Attitudes and motivation in second language learning. Newbury House.Google Scholar
Gardner, R. C., & Tremblay, P. F. (1994). On motivation: Measurement and conceptual considerations. The Modern Language Journal, 78, 524527. https://doi.org/10.1111/j.1540-4781.1994.tb02073.xGoogle Scholar
Gorsuch, R. L. (2003). Factor analysis. In Schinka, J. A., & Velicer, W. F., (Eds.), Handbook of psychology: Research methods in psychology, Vol. 2, pp. 143164). John Wiley & Sons, Inc‥CrossRefGoogle Scholar
Gass, S., Loewen, S., & Plonsky, L. (2021). Coming of age: The past, present, and future of quantitative SLA research. Language Teaching, 54, 245258. https://doi.org/10.1017/S0261444819000430CrossRefGoogle Scholar
Guilford, J. P. (1946). New standards for test evaluation. Educational and Psychological Measurement, 6, 427439.CrossRefGoogle Scholar
Hiver, P., & Al-Hoorie, A. H. (2020). Reexamining the role of vision in second language motivation: A preregistered conceptual replication of You, Dörnyei, and Csizér (2016). Language Learning, 70, 48102. https://doi.org/10.1111/lang.12371CrossRefGoogle Scholar
Isbell, D., Brown, D., Chen, M., Derrick, D., Ghanem, R., Gutiérrez Arvizu, M. N., … & Plonsky, L. (2022). Misconduct and questionable research practices: The ethics of quantitative data handling and reporting in applied linguistics. Modern Language Journal, 106, 172195. https://doi.org/10.1111/modl.12760CrossRefGoogle Scholar
Kerr, N. L. (1998). HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2(3), 196217.CrossRefGoogle ScholarPubMed
Kormos, J., & Csizér, K. (2008). Age-related differences in the motivation of learning English as a foreign language: Attitudes, selves and motivated learning behavior. Language Learning, 58(2), 327355. https://doi.org/10.1111/j.1467-9922.2008.00443.xCrossRefGoogle Scholar
Larson-Hall, J., & Dewey, D. (2012). An examination of the effects of input, aptitude, and motivation on the language proficiency of missionaries learning Japanese as a second language. In Hansen, L., (Ed.), Second Language Acquisition Abroad: The LDS Missionary Experience (pp. 5188). John Benjamins.CrossRefGoogle Scholar
Magid, M. (2011). A validation and application of the L2 motivational self system among Chinese learners of English. (Doctoral dissertation, University of Nottingham).Google Scholar
McClelland, N. (2010a). Language learning orientations revisited – adapting to the internet age, Bulletin of the Center for Fundamental Education, University of Kitakyushu, 5, 111186.Google Scholar
McClelland, N. (2010b). Student profiling by goal orientation in L2 learning Motivation research: A provisional investigation. Bulletin of the Center for Fundamental Education, University of Kitakyushu, 7, 83150.Google Scholar
McClelland, N. (2015). Redefining “integrativeness” for a global English – a quantitative study [Poster presentation]. JALT 2015: Annual Conference, Shizuoka Convention and Arts Center, Shizuoka, Japan. https://doi.org/10.13140/RG.2.1.3256.2009CrossRefGoogle Scholar
Nunnally, J. C., & Bernstein, I. H. (1967). Psychometric theory (3rd ed.). McGraw-Hill.Google Scholar
Oga-Baldwin, W. L. Q., Fryer, L. K., & Larson-Hall, J. (2019). The critical role of the individual in language education: New directions from the learning sciences. System, 86, Paper 102118. https://doi.org/10.1016/j.system.2019.102118CrossRefGoogle Scholar
Rönkkö, M., & Cho, E. (2020). An Updated Guideline for Assessing Discriminant Validity. Organizational Research Methods, 25(1), 614. https://doi.org/10.1177/1094428120968614CrossRefGoogle Scholar
Papi, M. (2010). The L2 motivational self system, L2 anxiety, and motivated behavior: A structural equation modeling approach. System, 38(3), 467479. https://doi.org/10.1016/j.system.2010.06.011CrossRefGoogle Scholar
Plonsky, L., Brown, D., Chen, M., Ghanem, R., Gutiérrez Arvizu, M. N., Isbell, D. R., … Zhang, M. (2024). “Significance sells”: Applied linguists’ view on questionable research practices. Research Methods in Applied Linguistics, 3, 100099. https://doi.org/10.1016/j.rmal.2024.100099CrossRefGoogle Scholar
Plonsky, L., Larsson, T., Sterling, S., Kytö, M., & Wood, M. (2024). A taxonomy of questionable research practices in quantitative humanities. In De Costa, P. I., Rabie-Ahmed, A., & Cinaglia, C.. (Eds.), Ethical Issues in Applied Linguistics Scholarship (pp. 1027). John Benjamins.CrossRefGoogle Scholar
Plonsky, L., & Oswald, F. L. (2014). How big Is “big”? Interpreting effect sizes in L2 research. Language Learning, 64, 878912. https://doi.org/10.1111/lang.12079CrossRefGoogle Scholar
Rubin, M. (2017). When does HARKing hurt? Identifying when different types of undisclosed post hoc hypothesizing harm scientific progress. Review of General Psychology, 21(4), 308320.CrossRefGoogle Scholar
Ryan, S. (2008). The ideal selves of Japanese learners of English. (Doctoral dissertation, University of Nottingham).Google Scholar
Ryan, S. (2009). Self and identity in L2 motivation in Japan: The ideal L2 self and Japanese learners of English. In Dörnyei, Z., & Ushioda, E. (Eds.), Motivation, language identity and the L2 self (pp. 120143). Multilingual Matters.CrossRefGoogle Scholar
Schoonen, R. (2015). Structural equation modeling in L2 research. In Plonsky, L. (Ed.), Advancing quantitative methods in second language research. Routledge.Google Scholar
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Pearson.Google Scholar
Taguchi, T. (2010). The L2 motivational self system among Japanese university learners of English. (Doctoral dissertation, University of Nottingham).Google Scholar
Taguchi, T., Magid, M., & Papi, M. (2009). The L2 motivational self system among Japanese, Chinese, and Iranian learners of English: A comparative study. In Dörnyei, Z. & Ushioda, E. (Eds.), Motivation, language identity and the L2 self (pp. 6697). Multilingual Matters.CrossRefGoogle Scholar
Tavakol, M., & Wetzel, A. (2020). Factor analysis: a means for theory and instrument development in support of construct validity. International Journal of Medical Education, 11, 245247.CrossRefGoogle ScholarPubMed
Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. American Psychological Association.CrossRefGoogle Scholar
Thompson, B., & Daniel, L. G. (1996). Factor analytic evidence for the construct validity of scores: A historical overview and some guidelines. Educational and Psychological Measurement, 56(2), 197208.CrossRefGoogle Scholar
Yaw, K., Plonsky, L., Larsson, T., Sterling, S., & Kytö, M. (2023). Timeline: Research ethics in applied linguistics. Language Teaching, 56, 478494. https://doi.org/10.1017/S0261444823000010CrossRefGoogle Scholar
Vlaeva, D., & Dörnyei, Z. (2021). Vision enhancement and language learning: A critical analysis of vision-building in an English for academic purposes programme. Language Teaching Research, 25, 946971. https://doi.org/10.1177/13621688211014551CrossRefGoogle Scholar
Yang, Y., & Green, S. B. (2011). Coefficient alpha: A reliability coefficient for the 21st century? Journal of Psychoeducational Assessment, 29, 377392. doi: 10.1177/0734282911406668CrossRefGoogle Scholar
You, C., Dörnyei, Z., & Csizér, K. (2016). Motivation, vision, and gender: A survey of learners of English in China. Language Learning, 66, 94123. https://doi.org/10.1111/lang.12140CrossRefGoogle Scholar