Technology for determining non-humanities university students' cognitive-and-psychological characteristics
https://doi.org/10.32362/2500-316X-2023-11-3-104-116
Abstract
Objectives. The purpose of this work was to create a special entrance test for first-year students starting to learn a new foreign language. To achieve the research objective, the study analyzed data on testing language/linguistic proficiency and motivation for learning a foreign language. A range of test parameters identifying both abilities and motivation to learn a foreign language in general, but not related to learning a specific language, were highlighted. The identified parameters were used to inform a questionnaire tested on a group of students, whose level of abilities and motivation had already been ascertained. The findings about students were compared with the already known empirical data to support the improvement of test items.
Methods. To describe a special entrance test for first-year students starting to learn a new foreign language in a non-humanities higher education institution, a test technology for identifying certain cognitive, psychological, intellectual, motivational characteristics of a student's language personality was created. The developed test parameters served as the basis for constructing several heterogeneous test blocks.
Results. The initial version of the test obtained was verified by pilot testing first-semester-first-year students. Expert assessments of the foreign language potential learning on the part of students were used to evaluate the reliability and validity of the test. A subsequent correction of tasks and responses was carried out in light of the verification results.
Conclusions. A recommendation to conduct this kind of testing prior to the first semester with the aim of forecasting the success of foreign-language educational activities of students enrolled in the foreign language study group from the “starter” level is formulated. The results of such diagnostics can be used to draw up personified adaptive training programs within the educational process.
About the Authors
N. I. ChernovaRussian Federation
Nadezhda I. Chernova - Dr. Sci. (Pedagog.), Professor, Head of Foreign Languages Department, Institute of Radio Electronics and Informatics, MIREA - Russian Technological University.
78, Vernadskogo pr., Moscow, 119454
Scopus Author ID 57194042371
Competing Interests:
None
E. A. Ivanova
Russian Federation
Ekaterina A. Ivanova - Cand. Sci. (Philolog.), Assistant Professor, Foreign Languages Department, Institute of Radio Electronics and Informatics, MIREA - Russian Technological University.
78, Vernadskogo pr., Moscow, 119454
Scopus ID 57216646627
Competing Interests:
None
N. B. Bogush
Russian Federation
Nadezhda B. Bogush - Cand. Sci. (Philolog.), Assistant Professor, Foreign Languages Department, Institute of Radio Electronics and Informatics, MIREA - Russian Technological University.
78, Vernadskogo pr., Moscow, 119454
Competing Interests:
None
N. V. Katakhova
Russian Federation
Nataliya V. Katakhova - Cand. Sci. (Pedagog.), Associate Professor, Foreign Languages Department, Institute of Radio Electronics and Informatics, MIREA - Russian Technological University.
78, Vernadskogo pr., Moscow, 119454
Scopus Author ID 57204175929
Competing Interests:
None
References
1. Baeva I.V. Adaptive and integrative approach in foreign higher education. Molodoi Uchenyi = Young Scientist. 202.0;13(303):207-210 (in Russ.). Available from URL: https://moluch.ru/archive/303/68412/ (accessed February 28, 2021).
2. Vilkova K.A., Lebedev D.V. Adaptivnoe obuchenie v vysshem obrazovanii: za i protiv (Adaptive Learning in Higher Education: Pros and Ons). Moscow: National Research University Higher School of Economics, Institute of Education; 2020. 36 р. (Series: Modern Analytics of Education. 2020;7(37)7) (in Russ.).
3. Krechetov I.A., Romanenko V.V. Implementing the adaptive learning technigues. Voprosy obrazovaniya = Educational Studies. 2020;2:252-277 (in Russ.). https://doi.org/10.17323/1814-9545-2020-2-252-277
4. Kudzh S.A., Golovanova N.B. On improving training mechanisms teaching staff and prospects for targeted learning in the interests of universities. Russ. Technol. J. 2020;8(4):112-128 (in Russ.). https://doi.org/10.32362/2500-316X-2020-8-4-112-128
5. Savka O.G. Influence of the humanitarian environment on improving the quality of training of specialists in a technical university. Russ. Technol. J. 2021;9(5):95-101 (in Russ.). https://doi.org/10.32362/2500-316X-2021-9-5-95-101
6. Kokkota V.A. Lingvodidakticheskoe testirovanie (Linguodidactic testing). Moscow: Vysshaya shkola; 1989. 130 p. (in Russ.). ISBN 5-06-000219-5
7. Lerner I.Ya. Indicators of the system of educational and cognitive tasks. Novye issledovaniya v pedagogicheskikh naukakh = New Research in Educational Sciences. 1990;2(56):3-74 (in Russ.).
8. Ershova O.N. University linguo-didactic testing: Theoretical and methodological review. In: Problemy upravleniya v sotsial'no-gumanitarnykh, ekonomicheskikh i tekhnicheskikh sistemakh: materialy Vserossiiskoi (zaochnoi) nauchno-prakticheskoi konferentsii (Problems of Management in Social, Humanitarian, Economic and Technical Systems: Materials of the All-Russian (Correspondence) Scientific and Practical Conference). In 2 v. Tver: TSTU; 2016. V 2. P 179-186 (in Russ.).
9. Rusinova E.A. Input control as a mechanism for managing pedagogical systems (based on the materials of the discipline “Foreign languages”). Vestnik Voronezhskogo gosudarstvennogo universiteta. Seriya: Problemy vysshego obrazovaniya = Bulletin of the Voronezh State University. Series: Problems of Higher Education. 2002;2:39-40 (in Russ.). Available from URL: https://rucont.ru/efd/518533 (accessed December 19, 2021),
10. Avanesov V.S. The problem of connection of learning and testing. Narodnoe obrazovanie = National Education. 2016;(7-8):32-140 (in Russ.).
11. Batunova I.V. Testing as one of the most effective methods of control in students training process among students of non-linguistic specialties. Mezhdunarodnyi nauchno-issledovatel'skii zhurnal = International Research Journal. 2017;05(59):8-10 (in Russ.). https://doi.org/10.23670/IRJ.2017.59.005
12. Mineeva O.A., Klopova Yu.V., Oladyshkina A.A. Test control in English in the non-linguistic high school. Gumanitarnye nauchnye issledovaniya = Humanities Scientific Research. 2017;2 (in Russ.). Available from URL: https://human.snauka.ru/2017/02/20723 (accessed February 25, 2022).
13. Scrivener J. Learning teaching. Oxford: Macmillan; 2005. 418 р. ISBN 978-3190-125-760
14. Tatarnitseva S.N., Konoplyuk N.V. Entrance testing in English for students of non-linguistic specialties as a factor in improving the effectiveness of training. Vektor nauki Tol'yattinskogo gosudarstvennogo universiteta. Seriya: Pedagogika, psikhologiya = Science Vector of Togliatti State University. Series: Pedagogy, Psychology. 2017;2:53-58 (in Russ.). https://doi.org/10.18323/2221-5662-2017-2-53-58
15. Mandrikova G.M. Lexical lacunarity as an indicator of the level of development of the language personality of the applicant. Filosofiya obrazovaniya = Philosophy of Education. 2005;3:237-247 (in Russ.).
16. Lukashevich E.V. Diagnostics of the state of the semantic level of the language ability of a modern student. Estestvennaya pis'mennaya russkaya rech': issledovatel'skii i obrazovatel'nyi aspekty. Ch. 1. Problemy pis'mennoi rechi i razvitiya yazykovogo chuvstva: Materialy konferentsii (Natural Written Russian Speech: Research and Educational Aspects. Part 1. Problems of Written Speech and the Development of Language Sense: Materials of the conference). Barnaul: AltGU; 2002. Р 27-36 (in Russ.).
17. Shimanovskaya L.A. Lingvisticheskie zadachi dlya nachinayushchikh perevodchikov (Linguistic Tasks for Beginner Translators). Kazan: KGTU; 2005. 47 p. (in Russ.). Available from URL: https://rucont.ru/efd/292519 (accessed April 12, 2022).
18. Igna O.N. Approaches to the identification of linguistic talent and ability to foreign languages. Vestnik Tomskogo gosudarstvennogo pedagogicheskogo universiteta (Vestnik TGPU) = Tomsk State Pedagogical University Bulletin (TSPU Bulletin). 2013;3(131):115-119 (in Russ.). Available from URL: https://vestnik.tspu.edu.ru/files/vestnik/PDF/articles/igna_o._n._115_119_3_131_2013.pdf (accessed April 12, 2022).
19. Shcherbatykh L.N. Theoretical and applied aspects of the identifying linguistically gifted pupils. Nauka i shkola = Science and School. 2013;4:36-39 (in Russ.).
20. Yakovchenko E.V. Experimental study of the language ability formation (based on metaphor). In: Aktual'nye problemy issledovaniya yazyka: teoriya, metodika, praktika obucheniya: Mezhvuzovskii sbornik nauchnykh trudov. Kursk: Kursk State University; 2003. P. 60-61 (in Russ.).
21. Gohlerner M.M., Eiger G.V. The psychological mechanism of the language sense. Voprosy Psikhologii. 1983;4:137-142 (in Russ.).
22. Teplov B.M. Ability and talent. Vestnik moskovskogo universiteta. Seriya 20: Pedagogicheskoe obrazovanie = Bulletin of Moscow University. Ser. 20: Pedagogical Education. 2014;4:99-105 (in Russ.).
23. Carroll J.B. Psychometric approaches to the study of language abilities. In: Fillmore C.J., Kempler D., Wang W.S.-Y. (Eds.). Individual Differences in Language Ability and Language Behavior. New York, San-Francisco, London: Academic Press; 1979. P. 13-32. https://doi.org/10.1016/B978-0-12-255950-1.50008-1
24. Carroll J.B., Sapon S.M. The modern language aptitude test (MLAT). San Antonio, TX: Psychological Corporation; 1959. 27 p.
25. Cattell R.B., Eber H.W., Tatsuoka M.M. Handbook of the Sixteen Personality Factor Questionnaire (16 PF). Champaign: Institute for Personality and Ability Testing; 1970. 388 p.
26. Eysenck H.J. Prover'te svoi sposobnosti (Test your IQ). St. Petersburg: Lan', Soyuz; 1996. 158 p. (in Russ.).
27. Patitina V.N. Diagnostics of abilities to foreign languages. Vestnik Vostochno-Sibirskoi Otkrytoi Akademii. 2013;7:12-16 (in Russ.). Available from URL: http://vsoa.esrae.ru/pdf/2013/7/723.pdf (accessed February 25, 2022).
28. Pimsleur P.A. Language aptitude testing. In: Davies A. (Ed.). Language Testing Symposium: A Psycholinguistic Approach. London: Oxford University Press; 1968. P. 98-106.
29. Siewert H. Vash koeffitsient intellekta. Testy. (Your IQ. Tests): transl. from Germ. Moscow: Interekspert; 1997. 138 p. (in Russ.).
30. Tunik E.E. Test intellekta Amtkhauera. Analiz i interpretatsiya dannykh (Amthauer's intelligence test. data analysis and interpretation). St. Petersburg: Rech'; 2009. 96 p. (in Russ.).
31. Kabardov M.K. Yazykovye sposobnosti: psikhologiya, psikhofiziologiya, pedagogika (Language Abilities: Psychology, Psychophysiology, Pedagogy). Moscow: Smysl; 2013. 400 p. (in Russ.).
32. Kormos J. New conceptualizations of language aptitude in second language attainment. In: Granena G., Long M. (Eds.). Sensitive periods, language aptitude, and ultimate L2 attainment. Amsterdam, Philadelphia: John Benjamins; 2013. P 131-152. https://doi.org/10.1075/lllt.35.05kor
33. Chan E., Skehan P., Gong G. Working memory, phonemic coding ability and foreign language aptitude: Potential for construction of specific language aptitude tests — the case of Cantonese. A Journal of English Language, Literature in English and Cultural Studies. 2011;1(60):45-73. https://doi.org/10.5007/2175-8026.2011n60p045
34. Khokhlova L.A., Deryagina L.E. Influence of individual psychological peculiarities in successful languages mastering. Rossiiskii mediko-biologicheskii vestnik imeni akademika I.P. Pavlova = I.P. Pavlov Russian Medical Biological Herald. 2010;18(1):124-130 (in Russ.).
35. Molchanov K.V. The dialectic study of the English language in the light of the work “Science of logic” by Hegel: New Dialectic Cognition, Dialectical Programming, and the Processes of Thinking. Russ. Technol. J. 2019;7(2):74-82 (in Russ.). https://doi.org/10.32362/2500-316X-2019-7-2-74-82
36. Voronin A.N., Kochkina O.M. Discursive and linguistic abilities in the structure of human intelligence. Psikhologiya. Zhurnal Vysshei shkoly ekonomiki = Psychology. Journal of the Higher School of Economics. 2008;5(2):124-132 (in Russ.).
37. Vladimirova S.G. David Wechsler's scale: Present and future in solving the problem of intelligence measurement. Yaroslavskii pedagogicheskii vestnik = Yaroslavl Pedagogical Bulletin. 2016;2:122-126 (in Russ.). Available from URL: http://vestnik.yspu.org/releases/2016_2/24.pdf (accessed February 25, 2022).
38. Milman V.E. Method for studying the motivational sphere of personality. In: Praktikum po psikhodiagnostike. Psikhodiagnostika motivatsii i samoregulyatsii (Workshop on Psychodiagnostics. Psychodiagnostics of Motivation and Self-regulation). Moscow: MSU; 1990. P. 23-43 (in Russ.).
39. Pakulina S.A., Ketko S.M. Diagnostics method of learning motivation in pedagogical university students. Psikhologicheskaya nauka i obrazovanie = Psychological Science and Education. 2010;2(1) (in Russ.). Available from URL: https://psyjournals.ru/journals/psyedu/archive/2010_n1/psyedu_2010_n1_26655.pdf (accessed February 25, 2022).
40. Rukhlova T.S. Some ways to determine the level of motivation of teenagers to learn a foreign language. Psikhologiya i pedagogika: metodika i problemy prakticheskogo primeneniya = Psychology and Pedagogy: Methods and Problems of Practical Application. 2012;28:315-317 (in Russ.).
41. Emel'yanova N.A. Motivatsiya ovladeniya inostrannym yazykom: struktura i formirovanie (Motivation for mastering a foreign language: structure and formation). Nizhnii Novgorod: HSE; 2013. 145 p. (in Russ.).
42. Ansimova O.K. Language ability: the theoretical foundations of learning. Science and education: modern trends. In: Nauka i obrazovanie: sovremennye trendy: kollektivnaya monografiya. Cheboksary: Interactive Plus; 2015. P. 7-29 (in Russ.). Available from URL: https://interactive-plus.ru/e-articles/124/Action124-11081.pdf (accessed December 19, 2021).
43. Gavrilova E.V. Linguistic abilities and its cognitive determinants: contemporary research perspectives. Sovremennaya zarubezhnaya psikhologiya = J. Modern Foreign Psychology. 2015;4(4):30-38 (in Russ.). https://doi.org/10.17759/jmfp.2015040405
44. Khokhlova L.A. Psychological approach to the investigation of foreign language abilities. Sovremennye issledovaniya sotsial'nykh problem = Modern Research of Social Problems. 2012;1(09):790-799 (in Russ.). Available from URL: https://cyberleninka.ru/article/n/psihologo-diagnosticheskiy-podhod-k-issledovaniyu-yazykovyh-sposobnostey (accessed February 25, 2022).
45. Ushakova T.N. Duality of human language ability nature. Psikhologicheskii zhurnal = Psychological Journal. 2004;25(2):5-16 (in Russ.).
46. Voronova N.G. Language ability in the context of psychology of abilities. Vestnik Bashkirskogo universiteta = Bulletin of Bashkir University. 2014;19(4):1407-1412 (in Russ.). Available from URL: http://bulletin-bsu.com/arch/files/2014/4/54_4670_Voronova_1407-1412.pdf (accessed February 25, 2022).
47. Matyushkin A.M. Creative giftedness concept. Voprosy Psihologii. 1989;6:29-33 (in Russ.). Available from URL: http://www.voppsy.ru/issues/1989/896/896029.htm (accessed February 25, 2022).
48. Khovanskaya E.A. Study of the language ability: Psycho-pedagogical and methodological aspects. Vestnik Kemerovskogo gosudarstvennogo universiteta = Bulletin of Kemerovo State University. 2014;(3-1):184-188 (in Russ.).
49. Kudinova I.M. Conceptual provisions and a model of linguistic gift assessment. Chelovecheskii capital = Human Capital. 2020;3(135):149-155 (in Russ.).
50. Lukashevich E.V. Teoriya yazykovogo razvitiya v kognitivno-diskursivnoi paradigme (Theory of Language Development in the Cognitive-Discursive Paradigm). Barnaul: Altai State University; 2006. 39 p. (in Russ.).
51. Lukashevich E.V. Language ability of the student in aspect of cognitive and communicative activity. In: Russkii yazyk i kul'tura rechi kak distsiplina gosudarstvennykh obrazovatel'nykh standartov vysshego professional'nogo obrazovaniya: opyt, problemy, perspektivy (Russian language and culture of speech as a discipline of state educational standards of higher professional education: Experience, problems, prospects). Barnaul: Altai State University; 2003. P. 105-117 (in Russ.).
52. Mednick S.A. The remote associates test. Journal of creative behavior. 1968;2(3):213-214. https://doi.org/10.1002/j.2162-6057.1968.tb00104.x
53. Bowden E.M., Jung-Beeman M. Normative data for 144 compound remote associate problems. Behavior Research Methods, Instrumentation, and Computer. 2003;35(4): 634-639. https://doi.org/10.3758/BF03195543
54. Khokhlova L.A. Psikhofiziologicheskie svyazi v strukture inoyazychno-rechevykh sposobnostei (Psychophysiological connections in the structure of foreign language and speech abilities). St.-Petersburg: 7 STUDIYa RIK; 2014. 255 p. (in Russ.).
55. Chelyshkova M.B. Teoriya i praktika konstruirovaniya pedagogicheskikh testov (Theory and practice of designing pedagogical tests). Moscow: Logos; 2002. 432 p. (in Russ.).
56. Maiorov A.N. Teoriya i praktika sozdaniya testov dlya sistemy obrazovaniya (Theory and practice of creating tests for the education system). Moscow: Intellekt-Tsentr; 2002. 352 p. (in Russ.).
57. McNamara T. Language testing. Oxford: Oxford University Press; 2000. 140 p.
58. Martin F., Markant D. Adaptive learning modules. In: David M.E., Amey M.J. (Eds.). The SAGE Encyclopedia of Higher Education. London: Sage; 2020. P. 2-4. http://doi.org/10.4135/9781529714395.n31
- A special entrance test for first-year students starting to learn a new foreign language was developed.
- The initial version of the test obtained was verified by pilot testing first-semester-first-year students.
- Expert assessments of the foreign language potential learning on the part of students were used to evaluate the reliability and validity of the test.
- A subsequent correction of tasks and responses was carried out in light of the verification results.
Review
For citations:
Chernova N.I., Ivanova E.A., Bogush N.B., Katakhova N.V. Technology for determining non-humanities university students' cognitive-and-psychological characteristics. Russian Technological Journal. 2023;11(3):104-116. https://doi.org/10.32362/2500-316X-2023-11-3-104-116