<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">mireabulletin</journal-id><journal-title-group><journal-title xml:lang="ru">Russian Technological Journal</journal-title><trans-title-group xml:lang="en"><trans-title>Russian Technological Journal</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2782-3210</issn><issn pub-type="epub">2500-316X</issn><publisher><publisher-name>RTU MIREA</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.32362/2500-316X-2021-9-6-64-72</article-id><article-id custom-type="elpub" pub-id-type="custom">mireabulletin-402</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>МАТЕМАТИЧЕСКОЕ МОДЕЛИРОВАНИЕ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>MATHEMATICAL MODELING</subject></subj-group></article-categories><title-group><article-title>Методы оценки сложности тестирования в сфере образования</article-title><trans-title-group xml:lang="en"><trans-title>Method for assessing testing difficulty in educational sphere</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Сигов</surname><given-names>А. С.</given-names></name><name name-style="western" xml:lang="en"><surname>Sigov</surname><given-names>A. S.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Сигов Александр Сергеевич, академик РАН, д.ф.-м.н., профессор, президент</p><p>119454, Россия, Москва, пр-т Вернадского, д. 78</p><p>ResearcherID: L-4103-2017, Scopus Author ID: 35557510600</p></bio><bio xml:lang="en"><p>Alexander S. Sigov, Academician of RAS, Dr. Sci. (Phys.–Math.), Professor, President</p><p>78, Vernadskogo pr., Moscow, 119454 Russia</p><p>ResearcherID: L-4103-2017, Scopus Author ID: 35557510600</p></bio><email xlink:type="simple">sigov@mirea.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Цветков</surname><given-names>В. Я.</given-names></name><name name-style="western" xml:lang="en"><surname>Tsvetkov</surname><given-names>V. Ya.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Цветков Виктор Яковлевич, д.т.н., д.э.н., профессор, советник ректората</p><p>119454, Россия, Москва, пр-т Вернадского, д. 78</p><p>ScopusAuthor ID: 56069916700</p></bio><bio xml:lang="en"><p>Viktor Ya. Tsvetkov, Dr. Sci. (Eng.), Dr. Sci. (Econ.), Professor</p><p>78, Vernadskogo pr., Moscow, 119454 Russia</p><p>Scopus Author ID: 56069916700</p></bio><email xlink:type="simple">cvj2@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Рогов</surname><given-names>И. Е.</given-names></name><name name-style="western" xml:lang="en"><surname>Rogov</surname><given-names>I. E.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Рогов Игорь Евгеньевич, директор Института довузовской подготовки</p><p>119454, Россия, Москва, пр-т Вернадского, д. 78</p></bio><bio xml:lang="en"><p>Igor E. Rogov, Director of the Institute of Pre-University Training</p><p>78, Vernadskogo pr., Moscow, 119454 Russia</p></bio><email xlink:type="simple">rogov@mirea.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>МИРЭА – Российский технологический университет</institution><country>Россия</country></aff><aff xml:lang="en"><institution>MIREA – Russian Technological University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2021</year></pub-date><pub-date pub-type="epub"><day>02</day><month>12</month><year>2021</year></pub-date><volume>9</volume><issue>6</issue><fpage>64</fpage><lpage>72</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Сигов А.С., Цветков В.Я., Рогов И.Е., 2021</copyright-statement><copyright-year>2021</copyright-year><copyright-holder xml:lang="ru">Сигов А.С., Цветков В.Я., Рогов И.Е.</copyright-holder><copyright-holder xml:lang="en">Sigov A.S., Tsvetkov V.Y., Rogov I.E.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://www.rtj-mirea.ru/jour/article/view/402">https://www.rtj-mirea.ru/jour/article/view/402</self-uri><abstract><p>Проблема тестирования в сфере образования является актуальной для многих стран. Тестирование решает три задачи: проводит оценку качества текущего обучения, дает инструмент для сравнительного анализа результатов обучения, дает инструмент для управления образовательным процессом в отдельном учебном заведении и по отрасли. Это определяет актуальность тестирования и разработки новых методов оценки результатов тестирования. Статья предлагает новый метод оценки результатов тестирования для разных ситуаций: «преподаватель – учащийся», компьютерный тест, виртуальная тестирующая модель, тест на модели смешанной реальности и другие. Для решения этой задачи вводится квазисигмоидальная функция. Она является аналогом логистической функции, но учитывает особенности реального тестирования. Логистическая функция лежит в интервале от минус до плюс бесконечности. В образовании отрицательных оценок не бывает. Введенная функция лежит только в положительной области аргумента, то есть оценок тестирования. Эту функцию авторы называют функцией сложности. Предварительно исследуется функция логарифмов шансов, логистическая регрессия и вытекающий из этого метод Раша. Отмечены два недостатка метода Раша. Определяется принцип тестирования, который используется в функции сложности. Статья вводит два новых понятия: функция сложности тестирования и интегральная оценка тестирования. Интегральная оценка тестирования является интегральной функцией от точечных оценок. Она переводит точечные результаты тестирования в непрерывную функцию и создает корреляцию между оценками. Приводятся результаты эксперимента с участием студентов РТУ МИРЭА. Результаты эксперимента анализируются. Показана возможность применения метода в образовательных процессах. Метод является альтернативой методу Раша.</p></abstract><trans-abstract xml:lang="en"><p>The problem of testing in education is relevant for many countries. Testing solves three problems. The first task is to assess the quality of current training. The second task is to conduct a comparative analysis of learning outcomes. The third task is the management of the educational process in a particular educational institution and in the education sector. This determines the relevance of testing and the relevance of developing new methods for assessing test results. The article proposes a new method for assessing test results for different situations: “teacher– student”, computer test, virtual testing model, test on a mixed reality model and others. To solve the problem, a special quasi-sigmoidal function is introduced. It is analogous to the logistic function, but takes into account the peculiarities of real testing of students. The logistic function ranges from minus infinity to plus infinity. There are no negative assessments in education. The introduced function lies only in the positive range of the argument. It describes actual positive scores when testing students. The authors called this function the complexity function. With its help, the complexity of the subject is assessed according to the test results. To substantiate the method, the function of the logarithms of the odds, logistic regression and the resulting Rush method are investigated. The article notes two shortcomings of the Rush method. The testing principle has been defined for the new function, which is used to estimate complexity. The article introduces two new concepts: the test difficulty function and the integral test score. Integral assessment of testing is a smooth function and makes it possible to go from a stepwise dependence to a continuous one. The cumulative test score translates the point test results into a continuous function and creates a correlation between the scores. The results of an experiment with the participation of RTU MIREA students are presented. The experimental results are analyzed. The possibility of using the method in educational processes is shown. The method is an alternative to the Rush method.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>алгоритм</kwd><kwd>образование</kwd><kwd>тестирование</kwd><kwd>сложность</kwd><kwd>программные компоненты</kwd><kwd>логиты</kwd><kwd>логистическое уравнение</kwd><kwd>модель Раша</kwd></kwd-group><kwd-group xml:lang="en"><kwd>algorithm</kwd><kwd>education</kwd><kwd>testing</kwd><kwd>complexity</kwd><kwd>software components</kwd><kwd>logits</kwd><kwd>logistic equation</kwd><kwd>Rush model</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Нейман Ю.М., Хлебников В.А. Введение в теорию моделирования и параметризации педагогических тестов. М.: Прометей; 2000. 168 с. ISBN 5-7042-1068-6</mixed-citation><mixed-citation xml:lang="en">Neiman Yu.M., Khlebnikov V.A. Vvedenie v teoriyu modelirovaniya i parametrizatsii pedagogicheskikh testov (Introduction to the theory of modeling and parametrization of pedagogical tests). Moscow: Prometei; 2000. 168 p. (in Russ.). ISBN 5-7042-1068-6</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Сафиулин Р.З. Развитие технологий тестирования в образовании. Управление образованием: теория и практика. 2015;1(17):139−149. URL: https://emreview.ru/index.php/emr/issue/view/17</mixed-citation><mixed-citation xml:lang="en">Safiulin R.Z. Technology development of testing in education. Upravlenie obrazovaniem: teoriya i praktika = Education management review. 2015;1(17):139−149 (in Russ). Available from URL: https://emreview.ru/index.php/emr/issue/view/17</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Kolster R. Structural ambidexterity in higher education: excellence education as a testing ground for educational innovations. Eur. J. High. Educ. 2021;11(1):64−81. https://doi.org/10.1080/21568235.2020.1850312</mixed-citation><mixed-citation xml:lang="en">Kolster R. Structural ambidexterity in higher education: excellence education as a testing ground for educational innovations. Eur. J. High. Educ. 2021;11(1):64−81. https://doi.org/10.1080/21568235.2020.1850312</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Кудж С.А., Цветков В.Я., Рогов И.Е. Поддержка жизненного цикла программных компонент. Российский технологический журнал. 2020;8(5):19−33. https://doi.org/10.32362/2500-316X-2020-8-5-19-33</mixed-citation><mixed-citation xml:lang="en">Kudzh S.A., Tsvetkov V.Ya., Rogov I.E. Life cycle support software components.Rossiiskii tekhnologicheskii zhurnal = Russian Technological Journal. 2020;8(5):19−33 (in Russ.). https://doi.org/10.32362/2500-316X-2020-8-5-19-33</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Mgbemena E. Man-machine systems: A review of current trends and applications. FUPRE J. Sci. Ind. Res. (FJSIR). 2020;4(2):91−117.</mixed-citation><mixed-citation xml:lang="en">Mgbemena E. Man-machine systems: A review of current trends and applications. FUPRE J. Sci. Ind. Res. (FJSIR). 2020;4(2):91−117.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Богоутдинов Б.Б., Цветков В.Я. Применение модели комплементарных ресурсов в инвестиционной деятельности. Вестник Мордовского университета. 2014;24(4):103−116. https://doi.org/10.15507/VMU.024.201403.103</mixed-citation><mixed-citation xml:lang="en">Bogoutdinov B.B., Tsvetkov V.Ya. Application of the model of complementary resources in investing activities. Vestnik Mordovskogo universiteta = Engineering Technologies and Systems. 2014;24(4):103−116 (in Russ.). https://doi.org/10.15507/VMU.024.201403.103</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Bliss C.I. The method of probits.Science. 1934;79(2037):38−39. https://doi.org/10.1126/science.79.2037.38</mixed-citation><mixed-citation xml:lang="en">Bliss C.I. The method of probits.Science. 1934;79(2037):38−39. https://doi.org/10.1126/science.79.2037.38</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Viera A.J. Odds ratios and risk ratios: what’s the difference and why does it matter?South. Med. J.2008;101(7):730−734. https://doi.org/10.1097/smj.0b013e31817a7ee4</mixed-citation><mixed-citation xml:lang="en">Viera A.J. Odds ratios and risk ratios: what’s the difference and why does it matter? South. Med. J. 2008;101(7):730–734. https://doi.org/10.1097/smj.0b013e31817a7ee4</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Jaccard J. Interaction effects in logistic regression. USA: Sage Publishing; 2001. V. 135. 80 p. https://dx.doi.org/10.4135/9781412984515</mixed-citation><mixed-citation xml:lang="en">Jaccard J. Interaction Effects in Logistic Regression. USA: Sage Publishing; 2001. V. 135. 80 p. https://dx.doi.org/10.4135/9781412984515</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Cramer J.S. The origins and development of the logit model. In book: Logit models from economics and other fields. Cambridge University Press; 2003. Ch. 9. https://doi.org/10.1017/CBO9780511615412.010</mixed-citation><mixed-citation xml:lang="en">Cramer J.S. The origins and development of the logit model. In book: Logit models from economics and other fields. Cambridge University Press; 2003. Ch. 9. https://doi.org/10.1017/CBO9780511615412.010</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Jokar M., Subbey S., Gjøsæter H. A logistic function to track time-dependent fish population dynamics. Fisheries Research. 2021;236:105840. https://doi.org/10.1016/j.fishres.2020.105840</mixed-citation><mixed-citation xml:lang="en">Jokar M., Subbey S., Gjøsæter H. A logistic function to track time-dependent fish population dynamics. Fisheries Research. 2021;236:105840. https://doi.org/10.1016/j.fishres.2020.105840</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Muñoz García D.A., Cardona Gómez D.C., Hoyos Mendez Y.C. Vólvulo del sigmoide: revisión narrative. Revista Facultad Ciencias de la Salud: Universidad del Cauca. 2020;22(1):36−44. https://doi.org/10.47373/rfcs.2020.v22.1575</mixed-citation><mixed-citation xml:lang="en">Muñoz García D.A., Cardona Gómez D.C., Hoyos Mendez Y.C. Vólvulo del sigmoide: revisión narrative. Revista Facultad Ciencias de la Salud:Universidad del Cauca. 2020;22(1):36−44. https://doi.org/10.47373/rfcs.2020.v22.1575</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Цветков В.Я., Рогов И.Е. Функциональный подход к оценке успеваемости учебных групп. Образовательные ресурсы и технологии. 2021;1(34):61−68.</mixed-citation><mixed-citation xml:lang="en">Tsvetkov V.Ya., Rogov I.E. Functional approach to the assessment of academic performance of study groups. Obrazovatel’nye resursy i tekhnologii = Educational Resources and Technologies. 2021;1(34):61−68 (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Seif N.A.S.M.A. Building and standardizing a school readiness battery for kindergarten children in light of classical theory and item response theory (A comparative study). MA Thesis. Fayoum University; 2018. URL: http://www.fayoum.edu.eg/english/Education/Psychology/pdf/MsnadaMscE.pdf</mixed-citation><mixed-citation xml:lang="en">Seif N.A.S.M.A. Building and standardizing a school readiness battery for kindergarten children in light of classical theory and item response theory (A comparative study). MA Thesis. Fayoum University; 2018. Available from URL: http://www.fayoum.edu.eg/english/Education/Psychology/pdf/MsnadaMscE.pdf</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Цветков В.Я., Войнова Е.В. Модификация модели Раша для оценки свободного тестирования. Вестник Рязанского государственного радиотехнического университета. 2018;1(63):90−94. https://doi.org/10.21667/1995-4565-2018-63-1-90-94</mixed-citation><mixed-citation xml:lang="en">Tsvetkov V.Ya., Voinova E.V. Modification of Rush model for free testing assessment. Vestnik Ryazanskogo gosudarstvennogo radiotekhnicheskogo universiteta = Vestnik of RSREU. 2018;1(63):90−94 (in Russ.). https://doi.org/10.21667/1995-4565-2018-63-1-90-94</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Кудж С.А. Методы сравнительного анализа. Славянский форум. 2019;3(25):140−150.</mixed-citation><mixed-citation xml:lang="en">Kudzh S.A. Methods for comparative analysis. Slavyanskii forum = Slavic Forum. 2019;3(25):140−150 (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Кудж С.А. Оценка групповой когнитивной сложности. Славянский форум. 2018;2(20):36–43.</mixed-citation><mixed-citation xml:lang="en">Kudzh S.A. Assessment of group cognitive complexity. Slavyanskii forum = Slavic Forum. 2018;2(20):36−43 (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Арнольд В.И. Теория катастроф. Итоги науки и техники. Серия «Современные проблемы математики. Фундаментальные направления». 1986;5:219−277.</mixed-citation><mixed-citation xml:lang="en">Arnol’d V.I. Catastrophe theory.Itogi nauki i tekhniki.“Seriya Sovremennye problemy matematiki. Fundamental’nye napravleniya”. 1986;5:219−277 (in Russ.).</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
