Preview

Russian Technological Journal

Advanced search

ITERATIVE APPROACH TO INCREASING QUALITY OF PROGRAMS TESTING

https://doi.org/10.32362/2500-316X-2017-5-4-3-12

Abstract

The article deals with the problem of improving the quality of applied software (AS) testing. This testing begins with the pre-alpha version and ends at the stage of acceptance testing of the AS. This period includes the process of multiple execution of designed and developed system tests of AS, and includes additional analysis of the program in other ways. We refer to the testing process for a given period of time as a testing cycle (TC), which is usually implemented using the "black box" method without the tester's access to the program code. An analysis of existing methods of tests synthesis showed that these methods not always guarantee an acceptable completeness of testing. Therefore, in this paper we propose an approach to the development of additional tests, based on the analysis of the database of errors (DB) and the capabilities of programmers and testers. These additional tests should confirm or disprove the conclusions about the sufficient completeness of the testing of AS functions during the TC. The work analyzes the types of errors recorded in the database, the level of their influence on the AS, the time spent on their detection and correction. Based on the results of the error analysis, the AS functions that are subject to additional testing are selected. In this approach, the sequence of TC is considered as an iterative process of identifying possible program errors, in which new segments of tests are constructed according to the results of previous cycles. The article gives some practical results obtained in accordance with the proposed methodology and outlines new directions in the study of the effectiveness of AS testing.

About the Authors

B. M. Basok
Moscow Technological University (MIREA); Federal Research Center «Computer Science and Control» of the Russian Academy of Sciences
Russian Federation


V. N. Zakharov
Moscow Technological University (MIREA); Federal Research Center «Computer Science and Control» of the Russian Academy of Sciences
Russian Federation


S. L. Frenkel
Moscow Technological University (MIREA); Federal Research Center «Computer Science and Control» of the Russian Academy of Sciences
Russian Federation


References

1. Басок Б.М., Красовский В.Е. Тестирование программного обеспечения. М.:МИРЭА, 2010. 120 с.

2. Куликов С.А. Тестирование программного обеспечения. Базовый курс. [Электронный ресурс]. - URL: http://svyatoslav.biz/software_testing_book/ (дата обращения:26.06.2017).

3. Технология разработки программного обеспечения // Журнал информационных технологий. IT-технологии. C. 16. [Электронный ресурс]. URL: http://www.irkinfo.ru/tekhnologiya-razrabotki- programmnogo-obespecheniya-str16.html / (дата обращения:28.06.2017).

4. Кулямин В.В., Петренко А.К., Косачев А.С., Бурдонов И.Б. Подход UniTesK к разработке тестов // Программирование. 2003. № 6. C. 25-43.

5. Петренко А.К., Кулямин В.В., Хорошилов А.В. Об интеграции формальных методов в задачах верификации операционных систем // Труды ИСП РАН. 2015. Т. 27. Вып. 5. С. 175-190.

6. Шалыто А.А., Туккель Н.И. Switch-технология - автоматный подход к созданию программного обеспечения «реактивных» систем // Программирование. 2001. № 5. С. 46-62.

7. Landsberg D., Chockler H., Kroening D., Lewis M. Evaluation of measures for statistical fault localisation and an optimising scheme // Fundamental Approaches to Software Engineering : 18th Int. Conf., FASE 2015. 2015/3/31. P. 115-129. [Электронный ресурс]. URL: Evaluation of Measures for Statistical Fault Localisation and an Optimising Scheme http://dblp.uni-trier.de/db/conf/fase/fase2015 (дата обращения: 28.06.2017).

8. Басок Б.М., Гречин А.А. Об усовершенствовании статистического метода оценки полноты тестов программ и устройств // Инструменты и методы анализа программ: Труды Междунар. науч.-практ. конф. Кострома, 2013. С. 40-45.

9. Wei J., Thomas A., Li G., Pattabiraman K. Quantifying the accuracy of high-level fault injection techniques for hardware faults / In: 44th IEEE/IFIP Int. Conf. on Dep. Sys. & Netw. (DSN ’14). IEEE, June 13, 2014. P. 375-382.

10. Harman M., Jia Y., Langdon W.B. A Manifesto for higher order mutation testing // Third Int. Conf. on Software Testing, Verification, and Validation Workshops (ICSTW), 2010. April 6-10, 2010. P. 80-89.


Review

For citations:


Basok B.M., Zakharov V.N., Frenkel S.L. ITERATIVE APPROACH TO INCREASING QUALITY OF PROGRAMS TESTING. Russian Technological Journal. 2017;5(4):3-12. (In Russ.) https://doi.org/10.32362/2500-316X-2017-5-4-3-12

Views: 466


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.


ISSN 2782-3210 (Print)
ISSN 2500-316X (Online)