Computerized Vocabulary Assessment in Children 8-11 Years

Authors

DOI:

https://doi.org/10.21432/cjlt28025

Keywords:

vocabulary, evaluation, digital tool, children

Abstract

The purpose of this pilot study is to construct a new computerized French language vocabulary assessment test for elementary school children. Multiple choice tasks measuring vocabulary breadth (e.g., image) and depth (e.g., synonym, definition) were administered to 255 children. The speed and accuracy of responses were recorded. As expected, analyses revealed that grade level, gender, and lexical frequency of items impacted response times and/or correct responses. Performance improved with grade level and for frequent words. Girls appear to have a richer vocabulary than boys (e.g., depth) and they appear to be less sensitive to word frequency than boys. An analysis of the psychometric qualities of the test allowed us to retain a 36-item test with satisfactory internal consistency. Finally, a confirmatory factor analysis did not reveal a two-factor structure of vocabulary (e.g., depth, breadth). The results are discussed in terms of the quality of lexical representations and task choice.

Author Biographies

Jean Ecalle, Université Lyon 2

Jean Ecalle est professeur émérite au sein du Laboratoire EMC de l’Université Lyon 2. Ses travaux portent sur l’apprentissage de la lecture auprès de populations d’enfants “tout-venant” et d’enfants en difficultés d’apprentissage. Une partie de ses recherches porte spécifiquement sur l’évaluation des performances en lecture et l’utilisation d’aide informatisée en lecture (voir www.ecalle-magnan.fr).

Nicolas Bailloud, Université Lyon 2

Nicolas Bailloud est docteur en Sciences Cognitives. Il travaille en tant que médiateur Formation à l’atelier Canopé de Lyon, et a un fort intérêt pour les neurosciences de l’éducation. Ses travaux portent, notamment, sur le développement d’applications Web pour évaluer et stimuler le vocabulaire chez l’enfant.

Emilie Dujardin, Université Lyon 2

Emilie Dujardin est docteure en Psychologie Cognitive et du Développement. Elle est en contrat postdoctoral, financé par l’Association Agir pour l’Ecole, au sein du laboratoire EMC. Ses travaux portent sur l’apprentissage de la lecture de l’enfance à l’âge adulte, et visent à déterminer les différences inter-individuelles.

Annie Magnan, Université Lyon 2

Annie Magnan est professeure émérite au sein du Laboratoire EMC de l’Université Lyon 2, membre senior honoraire de l’Institut Universitaire de France. Ses travaux portent sur l’apprentissage de la lecture chez l’enfant. Ses recherches visent à évaluer les performances en lecture, aider à l’apprentissage de la lecture via des remédiations (ex. : aide informatisée) auprès d’enfants au développement normal et d’enfants présentant des difficultés d’apprentissage de la lecture (dyslexiques, sourds, porteurs du Syndrome de Down…). Pour accéder à l’ensemble des publications (voir www.ecalle-magnan.fr).

References

Auphan, P., Écalle, J., & Magnan, A. (2019). Subtypes of readers with a computer-based assessment of reading ability: A study in French children from G2 to G9. European Journal of Psychology of Education, 34(3), 641-663. https://doi.org/10.1007/s10212-018-0396-7

Auphan, P., Écalle, J., & Magnan, A. (2020). The high potential of computer-based reading assessment. Canadian Journal of Learning and Technology, 46(1), 1-23. https://doi.org/10.21432/cjlt27847

Beauvais, L., Bouchafa, H., Beauvais, C., Kleinsz, N., Magnan, A., & Écalle, J. (2018). Tinfolec : A new French web-based test for reading assessment in primary school. Canadian Journal of School Psychology, 33(3), 227-241. https://doi.org/10.1177%2F0829573518771130

Burnham, K. P., Anderson, D. R., & Burnham, K. P. (2002). Model selection and multimodel inference : A practical information-theoretic approach (2e éd.). Cham : Springer.

Cunningham, A. E. (2005). Vocabulary growth through independent reading and reading aloud to children. Dans E. H. Hiebert et M. L. Kamil, Teaching and learning vocabulary. Bringing research to practice (p. 45‑68). Mahwah, NJ : Lawrence Erlbaum Associates Publishers.

Dujardin, E., Écalle, J., Auphan, P., Gomes, C., Cros, L., & Magnan, A. (2021). Vocabulary assessment with tablets in Grade 1 : Examining effects of individual and contextual factors and psychometric qualities. Frontiers in Education, 6:664131. https://doi.org/10.3389/feduc.2021.664131

Dunn A., & Dunn A. (1981). Peabody picture vocabulary test-revised. Circle Pines, MN : American Guidance Service.

Dunn, L. M., & Dunn, D. M. (2007). PPVT-4 : Peabody picture vocabulary test. San Antonio, TX : Pearson Assessments.

Dunn, L. M., Dunn, D. M., & Styles, B. (2009). The british picture vocabulary scale. Brentford : GL Assessment Limited.

Dunn, L. M., Dunn, L. M., & Theriault-Whalen, C. (1993). EVIP : Échelle de vocabulaire en images Peabody [Pictures vocabulary scale Peabody]. Toronto, ON : Pearson Assessments.

Fenson, L., Marchman, V. A., Thal, D. J., Dale, P. S., Reznick, J. S., & Bates, E. (2007). MacArthur-Bates communicative development inventories. Baltimore, MD : Brookes.

Frank, M. C., Sugarman, E., Horowitz, A. C., Lewis, M. L., & Yurovsky, D. (2016). Using tablets to collect data from young children. Journal of Cognition and Development, 17(1), 1‑17. https://doi.org/10.1080/15248372.2015.1061528

Good, R. H., & Kaminski, R. A. (2002). Dynamic indicators of basic early literacy skills : DIBELS. Dans R. H. Good (dir.), Dynamic measurement group. Eugene, OR : DIBELS.

Hoff, E. (2006). How social contexts support and shape language development. Developmental Review, 26(1), 55‑88. https://doi.org/10.1016/j.dr.2005.11.002

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives. Structural Equation Modeling. A Multidisciplinary Journal, 6(1), 1‑55. https://doi.org/10.1080/10705519909540118

Laveault, D., & Grégoire, J. (2014). Introduction aux théories des tests en sciences humaines (3e éd.). Bruxelles : De Boeck.

Lété, B., Sprenger-Charolles, L., & Colé, P. (2004). MANULEX : A grade-level lexical database from French elementary school readers. Behavior Research Methods, Instruments, & Computers, 36(1), 156-166. https://doi.org/10.3758/BF03195560

Magnan, A., & Écalle, J. (2018). L’apprentissage de la lecture : des processus d’identification de mots écrits à la compréhension. Dans R. Baldy (dir.), Dessiner, lire, écrire et calculer : un regard neuf (p. 93-172). Paris : In Press

Marble-Flint, K. J., Strattman, K. H., & Schommer-Aikins, M. A. (2019). Comparing iPad ® and paper assessments for children with ASD : An initial study. Communication Disorders Quarterly, 40(3), 152‑155. https://doi.org/10.1177/1525740118780750

Muthén, L. K., & Muthén, B. O. (2017). Mplus : Statistical analysis with latent variables. User’s Guide (Version 8). Los Angeles, CA : Authors.

Neumann, M. M., & Neumann, D. L. (2019). Validation of a touch screen tablet assessment of early literacy skills and a comparison with a traditional paper-based assessment. International Journal of Research & Method in Education, 42(4), 385‑398. https://doi.org/10.1080/1743727X.2018.1498078

Oakhill, J., Cain, K., & Elbro, C. (2019). Reading comprehension and reading comprehension difficulties. Dans D. A. Kilpatrick, R. M. Joshi et R. K. Wagner (dir.), Reading development and difficulties. Bridging the gap between research and practice (p. 83‑115). Cham : Springer International Publishing. https://doi.org/10.1007/978-3-030-26550-2_5

Pearson, P. D., Hiebert, E. H., & Kamil, M. L. (2007). Vocabulary assessment : What we know and what we need to learn. Reading Research Quarterly, 42(2), 282‑296. https://doi.org/10.1598/RRQ.42.2.4

Perfetti, C. (2007). Reading ability : Lexical quality to comprehension. Scientific Studies of Reading, 11(4), 357‑383. https://doi.org/10.1080/10888430701530730

Perfetti, C., & Stafura, J. (2014). Word knowledge in a theory of reading comprehension. Scientific Studies of Reading, 18(1), 22‑37. https://doi.org/10.1080/10888438.2013.827687

Rice, M. L., & Hoffman, L. (2015). Predicting vocabulary growth in children with and without specific language impairment : A longitudinal study from 2;6 to 21 years of age. Journal of Speech, Language, and Hearing Research, 58(2), 345‑359. https://doi.org/10.1044/2015_JSLHR-L-14-0150

Richter, T., Isberner, M.-B., Naumann, J., & Neeb, Y. (2013). Lexical quality and reading comprehension in primary school children. Scientific Studies of Reading, 17(6), 415‑434. https://doi.org/10.1080/10888438.2013.764879

Schaefer, B., Bowyer-Crane, C., Herrmann, F., & Fricke, S. (2016). Development of a tablet application for the screening of receptive vocabulary skills in multilingual children : A pilot study. Child Language Teaching and Therapy, 32(2), 179‑191. https://doi.org/10.1177/0265659015591634

Schaefer, B., Ehlert, H., Kemp, L., Hoesl, K., Schrader, V., Warnecke, C., & Herrmann, F. (2019). Stern, gwiazda or star : Screening receptive vocabulary skills across languages in monolingual and bilingual German–Polish or German–Turkish children using a tablet application. Child Language Teaching and Therapy, 35(1), 25‑38. https://doi.org/10.1177/0265659018810334

Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review. The Journal of Educational Research, 99(6), 323‑338. https://doi.org/10.3200/JOER.99.6.323-338

Sénéchal, M., Whissell, J., & Bildfell, A. (2017). Starting from home: Home literacy practices that make a difference. Dans K. Cain, D. L. Compton et R. K. Parrila (dir.), Studies in written language and literacy (vol. 15, p. 383‑408). Amsterdam: John Benjamins Publishing Company. https://doi.org/10.1075/swll.15.22sen

Simos, P. G., Sideridis, G. D., Protopapas, A., & Mouzaki, A. (2011). Psychometric evaluation of a receptive vocabulary test for greek elementary students. Assessment for Effective Intervention, 37(1), 34‑49. https://doi.org/10.1177/1534508411413254

Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.) Boston, MA: Pearson Education.

Taylor, C. L., Christensen, D., Lawrence, D., Mitrou, F., & Zubrick, S. R. (2013). Risk factors for children’s receptive vocabulary development from four to eight years in the longitudinal study of Australian children. PLoS ONE, 8(9), e73046. https://doi.org/10.1371/journal.pone.0073046

Wiig, E., Secord, W., Semel, E., Boulianne, L., & Labelle, M. (2009). Évaluation clinique des notions langagières fondamentales : Version pour francophones du Canada (Clinical evaluation of language fundamentals: French Canadian version). Toronto, ON: Pearson Assessments.

Wiig, E. H., & Secord, W. (1992). TOWK. Test of word knowledge. Toronto, ON : Psychological Corporation.

Wiig, E. H., Secord, W. A., & Semel, E. (2013). Clinical evaluation of language fundamentals: CELF-5. Toronto, ON: Pearson Assessments.

Zubrick, S. R., Taylor, C. L., Rice, M. L., & Slegers, D. (2007). Late language emergence at 24 months: An epidemiological study of prevalence, predictors, and covariates. Journal of Speech, Language, and Hearing Research, 50, 1562-1592. https://doi.org/10.1044/1092-4388(2007/106)

Published

2021-11-24

Issue

Section

Articles