Измерение лексического компонента языковой способности (создание и апробация теста)

Главная

Статья в Elpub

РУС ENG

Вестник Томского государственного университета. 2018; : 55-62

Измерение лексического компонента языковой способности (создание и апробация теста)

Набиуллина А. С., Резанова З. И.

https://doi.org/10.17223/15617793/427/7

Аннотация

Представлен проект пилотной версии теста, используемого для измерения лексического компонента языковой способности, позволяющего проводить массовые измерения способностей как носителей одного языка, так и билингвов. Представлен алгоритм создания версии теста, являющийся частичной репликацией словарных шкал Милл Хилл (Mill Hill Vocabulary Scale) Дж. Равена, Дж.К. Равена, Дж.К. Курта. Характеризуются принципы отбора словника, варианты отклонений от исходного теста, результаты пробных тестирований, проведенных в группах учащихся средних школ одного региона.

Список литературы

1. Равен Дж. Прогрессивные матрицы Равена: изменение и стабильность в зависимости от места и времени // Иностранная психология. 1998. № 10. С. 58-65.

2. Хомский Н. О природе и языке: С очерком «Секулярное совершенство и опасности, которые таит демократия» М. : УРСС: ЛЕНЛАНД, 2017. 288 с.

3. Valian V. Arguing about innateness // Journal of Child Language. 2014. № 41. Р. 78-92. doi:10.1017/S0305000914000336. URL: http://joumals.cambridge.org/abstract_S0305000914000336 (дата обращения: 25.07.2017).

4. Christiansen V.H. Language as shaped by the brain // Behavioural and brain sciences. 2008. № 31. Р. 489-558. URL: http://www.psychol.ucl.ac.uk/people/profiles/chater_nick.html (дата обращения: 25.07.2017).

5. Потебня А. А. Мысль и язык // Слово и миф. М. : Правда, 1989. С. 17-200.

6. Гумбольдт В. фон. Избранные труды по языкознанию / пер. с нем. Г.В. Рамишвили ; ред. М.А. Оборина. М. : Прогресс, 1984. 400 с.

7. Pinker S., Jackendoff R. The Faculty of Language: What’s Special about it? // Cognition. 2005. № 95. Р. 201-236. URL: https://ase.tufts.edu/cogstud/jackendoff/papers/FacultyofLanguage.pdf (дата обращения: 20.12.2016).

8. Звегинцев В. А. История языкознания XIX-XX веков в очерках и извлечениях. 3-е изд., доп. М. : Просвещение, 1964. Ч. 1. 466 с.

9. Бодуэн де Куртенэ И.А. Избранные труды по общему языкознанию / сост. В.П. Григорьев, А.А. Леонтьев. М. : Изд-во Академии наук СССР, 1963. Т. 1. 385 с.

10. Фортунатов Ф.Ф. Задачи языковедения и связь его с другими науками // Сравнительное языковедение: Общий курс. М. : КРАСАНД, 2010. С. 3-9.

11. Леонтьев А. А. Психология общения. 3-е изд. М. : Смысл, 1999. 365 с.

12. Психология способностей : хрестоматия / ред.-сост. В.Д. Шадриков. Москва : МПСИ ; Воронеж : МОДЭК, 2012. 488 с.

13. Психология : учеб. для гуманит. вузов. 2-е изд. / под общ. ред. В.Н. Дружинина. СПб. : Питер, 2009. 656 с.: ил.

14. Ekstrom R.B., French J.W. et al. Manual for Kit of Factor-Referenced Cognitive Tests. Educational Testing Service, Princeton, New Jersey, 1976.

15. Delis-Kaplan Executive Function System. Wikipedia - The Free Encyclopedia. URL: https://en.wikipedia.org/wiki/Delis%E2%80%93 Kaplan_Executive_Function_System (дата обращения: 25.07.2017).

16. Wechsler Test. URL: http://wechslertest.com/ (дата обращения: 25.07.2017).

17. Stanford-Binet. URL: https://www.stanfordbinet.net/ (дата обращения: 25.07.2017).

18. PALPA - Psycholinguistic Assessment of Language Processing in Aphasia. URL: https://milogomemima.wordpress.com/2014/09/02/palpa-phycholinguistic-assessments-of-language-processing-in-aphasia/ (дата обращения: 25.07.2017).

19. Doors and People. Pearson. URL: http://www.pearsonclinical.co.uk/Psychology/ChildCognitionNeuropsychologyandLanguage/ ChildMemory/DoorsandPeople/DoorsandPeople.aspx (дата обращения: 25.07.2017).

20. Peabody Picture Vocabulary Test. Wikipedia - The Free Encyclopedia. URL: https://en.wikipedia.org/wiki/Peabody_Picture_Vocabulary_Test. (дата обращения: 25.07.2017).

21. Pinker S., Jackendoff R. The faculty of language: what’s special about it? // Cognition 95. ELSEVIER. 2005. P. 201-236.

22. Hauser M.D., Chomsky N., Fitch W.T. The Faculty of Language: What Is It, Who Has It, How Did It Evolve? // Science’s Compass Review: Neuroscience. 2005. P. 1569-1579. URL: http://science.sciencemag.org/ (дата обращения: 27.10.2016).

23. Батурин Н.А., Мельникова Н.Н. Технология разработки психодиагностических методик. Челябинск : Изд. центр ЮУрГУ, 2012. 135 с.

24. Raven J., Raven J.C., Court J.H. Manual for Raven’s Progressive Matrices and Vocabulary Scales. Section 5: The Mill Hill Vocabulary Scale. San Antonio, TX : Harcourt Assessment, 1998.

25. Словарь русского языка : в 4 т. / РАН, Ин-т лингвист. исследований ; под ред. А.П. Евгеньевой. 4-е изд., стер. М. : Рус. яз.; Полиграфре-сурсы, 1999.

26. Ляшевская О.Н., Шаров С. А. Частотный словарь современного русского языка (на материалах Национального корпуса русского языка). М. : Азбуковник, 2009. URL: http://dict.ruslang.ru/freq.php? (дата обращения: 11.11.2016).

27. Александрова 3.Е. Словарь синонимов русского языка: Практический справочник: Ок. 11 000 синоним. рядов. 11-е изд., перераб. и доп. М. : Рус. яз., 2001. 568 с.

28. Новый объяснительный словарь синонимов русского языка / Ю.Д. Апресян, В.Ю. Апресян, О.Ю. Богуславская [и др.] ; под общ. рук. Ю.Д. Апресяна. М. : Языки славянской культуры (Кошелев), 2003. LXIV, вып. 3. 557 с.

29. Словарь синонимов русского языка : справ. пособие / под ред. А.П. Евгеньевой. М. : Астрель: АСТ, 2002. 648 с.

30. What makes a word difficult? Johnson O’Connor Research Foundation. URL: https://www.jocrf.org/basic-page/what-makes-word-difficult (дата обращения: 30.08.2017).

31. Kibby M.W. Note on relationship of word difficulty and word frequency // Psychological Reports. 1977. № 41 (1). Р. 12-14.

32. Rudell A.P. Frequency of word usage and perceived word difficulty: Ratings of Kucera and Francis words // Behavior Research Methods, Instruments & Computers. 1993. № 25 (4). Р. 455-463.

33. Нагель О.В. Словообразовательные механизмы в процессах восприятия, идентификации и использования языка : дис.. д-ра филол. наук. Томск, 2017. 478 с.

34. Nagel O.V., Bub A.S., Temnikova I.G. Age of Acquisition and Token Word Frequency Correlation in Lexical Decision: Recognition of Russian Suffixed Words // Вопросы когнитивной лингвистики. 2016. № 4. Р. 150-159.

Tomsk State University Journal. 2018; : 55-62

Developing a test for measuring the lexical component of the language faculty

Nabiullina A. S., Rezanova Z. I.

https://doi.org/10.17223/15617793/427/7

Abstract

The study focuses on the language faculty which has a special place among other abilities of a human. In psycholinguistics, the extent of the language faculty is considered one of its main concepts. It can be measured by means of various psycholinguistic tools, testing systems being one of them. Researchers also emphasise the importance of the lexical component of the language faculty. The project described in the paper aims to develop a test to measure the lexicon of Russian native speakers. To solve this task the authors opted for replication and adaptation of the Mill Hill Vocabulary Scale. The paper explains the choice of the approach determined by considerable functional and semantic discrepancies in the vocabulary systems of Russian and English. The authors demonstrate the stages of test development and compare them with the original version. The measuring method relies on a list of stimuli, their synonyms and distractors, i.e. response options that are considered to be wrong in relation to a stimulus. Words varying in the degree of familiarity, difficulty and frequency are used as a stimulus material. 500 words were selected at regular intervals from the Dictionary of the Russian Language edited by A.P. Evgen’eva. Another 500 words were taken from The Frequency Dictionary of Russian by O.N. Lyasheskaya and S.A. Sharov. After an expert review, words rendering emotions, terms and colloquial vocabulary were excluded from the list. Therefore, 271 items made up the total list. After that, words that do not have synonyms were also excluded from the list. 154 stimuli were arranged by frequency. Knowledge of words implies the ability to use them, replace a word with other words and assess the degree of their similarity. As a result, the authors compiled a list of synonyms based on reliable Russian dictionaries of synonyms. Each synonym was ascribed its frequency as well. A supplementary index contains distractors, i.e. words that are different in meaning but somewhat close in form and might belong to one semantic group. At this stage, distractors were taken from the words excluded from the list of stimuli. The list of synonyms and distractors was also added with responses given by respondents. Native Russian speakers with a developed language faculty were asked to write a synonym to each stimulus. The questionnaire was conducted using google-forms. For each word in the open-ended version a record was kept of every response. Wrong words were included into the list of distractors. Experimental series were submitted to the participants. They consisted of a stimulus and six words including one synonym and five distractors. The paper also considers the testing method and results of a pilot testing among schoolchildren aged 11-15. The results of statistical processing of testing materials are presented; further steps to improve the index and ensure its greater validity are discussed.

References

1. Raven Dzh. Progressivnye matritsy Ravena: izmenenie i stabil'nost' v zavisimosti ot mesta i vremeni // Inostrannaya psikhologiya. 1998. № 10. S. 58-65.

2. Khomskii N. O prirode i yazyke: S ocherkom «Sekulyarnoe sovershenstvo i opasnosti, kotorye tait demokratiya» M. : URSS: LENLAND, 2017. 288 s.

3. Valian V. Arguing about innateness // Journal of Child Language. 2014. № 41. R. 78-92. doi:10.1017/S0305000914000336. URL: http://joumals.cambridge.org/abstract_S0305000914000336 (data obrashcheniya: 25.07.2017).

4. Christiansen V.H. Language as shaped by the brain // Behavioural and brain sciences. 2008. № 31. R. 489-558. URL: http://www.psychol.ucl.ac.uk/people/profiles/chater_nick.html (data obrashcheniya: 25.07.2017).

5. Potebnya A. A. Mysl' i yazyk // Slovo i mif. M. : Pravda, 1989. S. 17-200.

6. Gumbol'dt V. fon. Izbrannye trudy po yazykoznaniyu / per. s nem. G.V. Ramishvili ; red. M.A. Oborina. M. : Progress, 1984. 400 s.

7. Pinker S., Jackendoff R. The Faculty of Language: What’s Special about it? // Cognition. 2005. № 95. R. 201-236. URL: https://ase.tufts.edu/cogstud/jackendoff/papers/FacultyofLanguage.pdf (data obrashcheniya: 20.12.2016).

8. Zvegintsev V. A. Istoriya yazykoznaniya XIX-XX vekov v ocherkakh i izvlecheniyakh. 3-e izd., dop. M. : Prosveshchenie, 1964. Ch. 1. 466 s.

9. Boduen de Kurtene I.A. Izbrannye trudy po obshchemu yazykoznaniyu / sost. V.P. Grigor'ev, A.A. Leont'ev. M. : Izd-vo Akademii nauk SSSR, 1963. T. 1. 385 s.

10. Fortunatov F.F. Zadachi yazykovedeniya i svyaz' ego s drugimi naukami // Sravnitel'noe yazykovedenie: Obshchii kurs. M. : KRASAND, 2010. S. 3-9.

11. Leont'ev A. A. Psikhologiya obshcheniya. 3-e izd. M. : Smysl, 1999. 365 s.

12. Psikhologiya sposobnostei : khrestomatiya / red.-sost. V.D. Shadrikov. Moskva : MPSI ; Voronezh : MODEK, 2012. 488 s.

13. Psikhologiya : ucheb. dlya gumanit. vuzov. 2-e izd. / pod obshch. red. V.N. Druzhinina. SPb. : Piter, 2009. 656 s.: il.

14. Ekstrom R.B., French J.W. et al. Manual for Kit of Factor-Referenced Cognitive Tests. Educational Testing Service, Princeton, New Jersey, 1976.

15. Delis-Kaplan Executive Function System. Wikipedia - The Free Encyclopedia. URL: https://en.wikipedia.org/wiki/Delis%E2%80%93 Kaplan_Executive_Function_System (data obrashcheniya: 25.07.2017).

16. Wechsler Test. URL: http://wechslertest.com/ (data obrashcheniya: 25.07.2017).

17. Stanford-Binet. URL: https://www.stanfordbinet.net/ (data obrashcheniya: 25.07.2017).

20. Peabody Picture Vocabulary Test. Wikipedia - The Free Encyclopedia. URL: https://en.wikipedia.org/wiki/Peabody_Picture_Vocabulary_Test. (data obrashcheniya: 25.07.2017).

21. Pinker S., Jackendoff R. The faculty of language: what’s special about it? // Cognition 95. ELSEVIER. 2005. P. 201-236.

23. Baturin N.A., Mel'nikova N.N. Tekhnologiya razrabotki psikhodiagnosticheskikh metodik. Chelyabinsk : Izd. tsentr YuUrGU, 2012. 135 s.

24. Raven J., Raven J.C., Court J.H. Manual for Raven’s Progressive Matrices and Vocabulary Scales. Section 5: The Mill Hill Vocabulary Scale. San Antonio, TX : Harcourt Assessment, 1998.

25. Slovar' russkogo yazyka : v 4 t. / RAN, In-t lingvist. issledovanii ; pod red. A.P. Evgen'evoi. 4-e izd., ster. M. : Rus. yaz.; Poligrafre-sursy, 1999.

26. Lyashevskaya O.N., Sharov S. A. Chastotnyi slovar' sovremennogo russkogo yazyka (na materialakh Natsional'nogo korpusa russkogo yazyka). M. : Azbukovnik, 2009. URL: http://dict.ruslang.ru/freq.php? (data obrashcheniya: 11.11.2016).

27. Aleksandrova 3.E. Slovar' sinonimov russkogo yazyka: Prakticheskii spravochnik: Ok. 11 000 sinonim. ryadov. 11-e izd., pererab. i dop. M. : Rus. yaz., 2001. 568 s.

28. Novyi ob\"yasnitel'nyi slovar' sinonimov russkogo yazyka / Yu.D. Apresyan, V.Yu. Apresyan, O.Yu. Boguslavskaya [i dr.] ; pod obshch. ruk. Yu.D. Apresyana. M. : Yazyki slavyanskoi kul'tury (Koshelev), 2003. LXIV, vyp. 3. 557 s.

29. Slovar' sinonimov russkogo yazyka : sprav. posobie / pod red. A.P. Evgen'evoi. M. : Astrel': AST, 2002. 648 s.

30. What makes a word difficult? Johnson O’Connor Research Foundation. URL: https://www.jocrf.org/basic-page/what-makes-word-difficult (data obrashcheniya: 30.08.2017).

31. Kibby M.W. Note on relationship of word difficulty and word frequency // Psychological Reports. 1977. № 41 (1). R. 12-14.

32. Rudell A.P. Frequency of word usage and perceived word difficulty: Ratings of Kucera and Francis words // Behavior Research Methods, Instruments & Computers. 1993. № 25 (4). R. 455-463.

33. Nagel' O.V. Slovoobrazovatel'nye mekhanizmy v protsessakh vospriyatiya, identifikatsii i ispol'zovaniya yazyka : dis.. d-ra filol. nauk. Tomsk, 2017. 478 s.

34. Nagel O.V., Bub A.S., Temnikova I.G. Age of Acquisition and Token Word Frequency Correlation in Lexical Decision: Recognition of Russian Suffixed Words // Voprosy kognitivnoi lingvistiki. 2016. № 4. R. 150-159.

Измерение лексического компонента языковой способности (создание и апробация теста)

Аннотация

Developing a test for measuring the lexical component of the language faculty

Abstract

События