Computerized Vocabulary Assessment in Children 8-11 Years
DOI:
https://doi.org/10.21432/cjlt28025Keywords:
vocabulary, evaluation, digital tool, childrenAbstract
The purpose of this pilot study is to construct a new computerized French language vocabulary assessment test for elementary school children. Multiple choice tasks measuring vocabulary breadth (e.g., image) and depth (e.g., synonym, definition) were administered to 255 children. The speed and accuracy of responses were recorded. As expected, analyses revealed that grade level, gender, and lexical frequency of items impacted response times and/or correct responses. Performance improved with grade level and for frequent words. Girls appear to have a richer vocabulary than boys (e.g., depth) and they appear to be less sensitive to word frequency than boys. An analysis of the psychometric qualities of the test allowed us to retain a 36-item test with satisfactory internal consistency. Finally, a confirmatory factor analysis did not reveal a two-factor structure of vocabulary (e.g., depth, breadth). The results are discussed in terms of the quality of lexical representations and task choice.
References
Auphan, P., Écalle, J., & Magnan, A. (2019). Subtypes of readers with a computer-based assessment of reading ability: A study in French children from G2 to G9. European Journal of Psychology of Education, 34(3), 641-663. https://doi.org/10.1007/s10212-018-0396-7
Auphan, P., Écalle, J., & Magnan, A. (2020). The high potential of computer-based reading assessment. Canadian Journal of Learning and Technology, 46(1), 1-23. https://doi.org/10.21432/cjlt27847
Beauvais, L., Bouchafa, H., Beauvais, C., Kleinsz, N., Magnan, A., & Écalle, J. (2018). Tinfolec : A new French web-based test for reading assessment in primary school. Canadian Journal of School Psychology, 33(3), 227-241. https://doi.org/10.1177%2F0829573518771130
Burnham, K. P., Anderson, D. R., & Burnham, K. P. (2002). Model selection and multimodel inference : A practical information-theoretic approach (2e éd.). Cham : Springer.
Cunningham, A. E. (2005). Vocabulary growth through independent reading and reading aloud to children. Dans E. H. Hiebert et M. L. Kamil, Teaching and learning vocabulary. Bringing research to practice (p. 45‑68). Mahwah, NJ : Lawrence Erlbaum Associates Publishers.
Dujardin, E., Écalle, J., Auphan, P., Gomes, C., Cros, L., & Magnan, A. (2021). Vocabulary assessment with tablets in Grade 1 : Examining effects of individual and contextual factors and psychometric qualities. Frontiers in Education, 6:664131. https://doi.org/10.3389/feduc.2021.664131
Dunn A., & Dunn A. (1981). Peabody picture vocabulary test-revised. Circle Pines, MN : American Guidance Service.
Dunn, L. M., & Dunn, D. M. (2007). PPVT-4 : Peabody picture vocabulary test. San Antonio, TX : Pearson Assessments.
Dunn, L. M., Dunn, D. M., & Styles, B. (2009). The british picture vocabulary scale. Brentford : GL Assessment Limited.
Dunn, L. M., Dunn, L. M., & Theriault-Whalen, C. (1993). EVIP : Échelle de vocabulaire en images Peabody [Pictures vocabulary scale Peabody]. Toronto, ON : Pearson Assessments.
Fenson, L., Marchman, V. A., Thal, D. J., Dale, P. S., Reznick, J. S., & Bates, E. (2007). MacArthur-Bates communicative development inventories. Baltimore, MD : Brookes.
Frank, M. C., Sugarman, E., Horowitz, A. C., Lewis, M. L., & Yurovsky, D. (2016). Using tablets to collect data from young children. Journal of Cognition and Development, 17(1), 1‑17. https://doi.org/10.1080/15248372.2015.1061528
Good, R. H., & Kaminski, R. A. (2002). Dynamic indicators of basic early literacy skills : DIBELS. Dans R. H. Good (dir.), Dynamic measurement group. Eugene, OR : DIBELS.
Hoff, E. (2006). How social contexts support and shape language development. Developmental Review, 26(1), 55‑88. https://doi.org/10.1016/j.dr.2005.11.002
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives. Structural Equation Modeling. A Multidisciplinary Journal, 6(1), 1‑55. https://doi.org/10.1080/10705519909540118
Laveault, D., & Grégoire, J. (2014). Introduction aux théories des tests en sciences humaines (3e éd.). Bruxelles : De Boeck.
Lété, B., Sprenger-Charolles, L., & Colé, P. (2004). MANULEX : A grade-level lexical database from French elementary school readers. Behavior Research Methods, Instruments, & Computers, 36(1), 156-166. https://doi.org/10.3758/BF03195560
Magnan, A., & Écalle, J. (2018). L’apprentissage de la lecture : des processus d’identification de mots écrits à la compréhension. Dans R. Baldy (dir.), Dessiner, lire, écrire et calculer : un regard neuf (p. 93-172). Paris : In Press
Marble-Flint, K. J., Strattman, K. H., & Schommer-Aikins, M. A. (2019). Comparing iPad ® and paper assessments for children with ASD : An initial study. Communication Disorders Quarterly, 40(3), 152‑155. https://doi.org/10.1177/1525740118780750
Muthén, L. K., & Muthén, B. O. (2017). Mplus : Statistical analysis with latent variables. User’s Guide (Version 8). Los Angeles, CA : Authors.
Neumann, M. M., & Neumann, D. L. (2019). Validation of a touch screen tablet assessment of early literacy skills and a comparison with a traditional paper-based assessment. International Journal of Research & Method in Education, 42(4), 385‑398. https://doi.org/10.1080/1743727X.2018.1498078
Oakhill, J., Cain, K., & Elbro, C. (2019). Reading comprehension and reading comprehension difficulties. Dans D. A. Kilpatrick, R. M. Joshi et R. K. Wagner (dir.), Reading development and difficulties. Bridging the gap between research and practice (p. 83‑115). Cham : Springer International Publishing. https://doi.org/10.1007/978-3-030-26550-2_5
Pearson, P. D., Hiebert, E. H., & Kamil, M. L. (2007). Vocabulary assessment : What we know and what we need to learn. Reading Research Quarterly, 42(2), 282‑296. https://doi.org/10.1598/RRQ.42.2.4
Perfetti, C. (2007). Reading ability : Lexical quality to comprehension. Scientific Studies of Reading, 11(4), 357‑383. https://doi.org/10.1080/10888430701530730
Perfetti, C., & Stafura, J. (2014). Word knowledge in a theory of reading comprehension. Scientific Studies of Reading, 18(1), 22‑37. https://doi.org/10.1080/10888438.2013.827687
Rice, M. L., & Hoffman, L. (2015). Predicting vocabulary growth in children with and without specific language impairment : A longitudinal study from 2;6 to 21 years of age. Journal of Speech, Language, and Hearing Research, 58(2), 345‑359. https://doi.org/10.1044/2015_JSLHR-L-14-0150
Richter, T., Isberner, M.-B., Naumann, J., & Neeb, Y. (2013). Lexical quality and reading comprehension in primary school children. Scientific Studies of Reading, 17(6), 415‑434. https://doi.org/10.1080/10888438.2013.764879
Schaefer, B., Bowyer-Crane, C., Herrmann, F., & Fricke, S. (2016). Development of a tablet application for the screening of receptive vocabulary skills in multilingual children : A pilot study. Child Language Teaching and Therapy, 32(2), 179‑191. https://doi.org/10.1177/0265659015591634
Schaefer, B., Ehlert, H., Kemp, L., Hoesl, K., Schrader, V., Warnecke, C., & Herrmann, F. (2019). Stern, gwiazda or star : Screening receptive vocabulary skills across languages in monolingual and bilingual German–Polish or German–Turkish children using a tablet application. Child Language Teaching and Therapy, 35(1), 25‑38. https://doi.org/10.1177/0265659018810334
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review. The Journal of Educational Research, 99(6), 323‑338. https://doi.org/10.3200/JOER.99.6.323-338
Sénéchal, M., Whissell, J., & Bildfell, A. (2017). Starting from home: Home literacy practices that make a difference. Dans K. Cain, D. L. Compton et R. K. Parrila (dir.), Studies in written language and literacy (vol. 15, p. 383‑408). Amsterdam: John Benjamins Publishing Company. https://doi.org/10.1075/swll.15.22sen
Simos, P. G., Sideridis, G. D., Protopapas, A., & Mouzaki, A. (2011). Psychometric evaluation of a receptive vocabulary test for greek elementary students. Assessment for Effective Intervention, 37(1), 34‑49. https://doi.org/10.1177/1534508411413254
Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.) Boston, MA: Pearson Education.
Taylor, C. L., Christensen, D., Lawrence, D., Mitrou, F., & Zubrick, S. R. (2013). Risk factors for children’s receptive vocabulary development from four to eight years in the longitudinal study of Australian children. PLoS ONE, 8(9), e73046. https://doi.org/10.1371/journal.pone.0073046
Wiig, E., Secord, W., Semel, E., Boulianne, L., & Labelle, M. (2009). Évaluation clinique des notions langagières fondamentales : Version pour francophones du Canada (Clinical evaluation of language fundamentals: French Canadian version). Toronto, ON: Pearson Assessments.
Wiig, E. H., & Secord, W. (1992). TOWK. Test of word knowledge. Toronto, ON : Psychological Corporation.
Wiig, E. H., Secord, W. A., & Semel, E. (2013). Clinical evaluation of language fundamentals: CELF-5. Toronto, ON: Pearson Assessments.
Zubrick, S. R., Taylor, C. L., Rice, M. L., & Slegers, D. (2007). Late language emergence at 24 months: An epidemiological study of prevalence, predictors, and covariates. Journal of Speech, Language, and Hearing Research, 50, 1562-1592. https://doi.org/10.1044/1092-4388(2007/106)
Published
Issue
Section
License
Copyright (c) 2021 Jean Ecalle, Nicolas Bailloud, Emilie Dujardin, Annie Magnan
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright Notice
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under an International Creative Commons Attribution-NonCommercial License (CC-BY-NC 4.0) that allows others to share the work for non-commercial purposes, with an acknowledgement of the work's authorship and initial publication in this journal.