Use of A/B testing to determine the target state of a business process as part of organizational digital and business transformation

   Objectives. The problem of correctly defining the target state of business processes, which determines whether the results align with a company’s strategic priorities, is key in the digital and business transformation of organizations. Current goal-setting practices, which rely primarily on expert assessments and stakeholder requirements, are characterized by methodological limitations, which include excessive subjectivity and insufficient validation of hypotheses. This work sets out to substantiate and develop an integrated approach to defining the target state of business processes that combines strategic goal-setting tools and verification methods to improve the validity of the proposed changes.

   Methods. The study is based on a critical analysis of existing approaches to goal setting in transformation projects. To overcome the identified limitations, a synthesis of two methodological tools is proposed: the use of the objectives and key results (OKR) system to decompose long-term strategic priorities into measurable indicators of the target process state combined with A/B testing tools to experimentally test hypotheses about which changes in key results lead to the achievement of a strategic goal.

   Results. The integration of OKRs and A/B testing is shown to create a closed-loop change management system. OKRs provide strategic navigation to ensure that the target state is consistent with the company’s mission. A/B testing, in turn, adds an empirical basis for goal setting, allowing for the confirmation or refutation of hypotheses about the impact of process changes on desired business outcomes based on data rather than intuition. By improving the adaptability of the process to environmental changes, this approach reduces the risk of implementing ineffective project solutions.

   Conclusions. The proposed approach bridges the gap between abstract strategic goals and operational changes to improve methodological rigor in goal-setting through a synthesis of planning and experimental testing. Research prospects lie in scaling the approach to complex process architectures and interpreting A/B test results to adjust OKRs.

1. Repin V.V. Biznes-protsessy. Modelirovanie, vnedrenie, upravlenie (Business Processes. Modeling, Implementation, Management). Moscow: Mann, Ivanov I Ferber; 2014, 512 p. (In Russ.). ISBN 978-5-91657-521-7

2. Tel’nov Yu.F., Fedorov I.G. Inzhiniring predpriyatiya i upravlenie biznes-protsessami. Metodologiya i tekhnologiya (Enterprise Engineering and Business Process Management. Methodology and Technology). Moscow: YUNITI-DANA; 2022, 207 p. (In Russ.). ISBN 978-5-238-02622-0. https://www.elibrary.ru/vrrrtd

3. Radchenko A.V. Organizational and Economic Mechanism of Business Processes Managment at the Enterprise. Rossiiskoe predprinimatel’stvo = Rus. J. Entrepreneurship. 2009;10(11):89–93 (in Russ.). https://www.elibrary.ru/kyxukh

4. Mazur I.I., Shapiro V.D. Upravlenie proektami (Project Management). Moscow: Omega-L; 2012, 960 p. (In Russ.). ISBN 978-5-370-02289-0

5. Hammer M., Champy J. Reinzhiniring korporatsii. Manifest revolyutsii v biznese (Reengineering the Corporation. Manifesto for Business Revolution) : transl. from Engl. Moscow: Mann, Ivanov i Ferber; 2010, 274 p. (In Russ.). ISBN 978-5-91657-088-5 [Hammer M., Champy J. Reengineering the Corporation. Manifesto for Business Revolution. London; 1993. 223 p.]

6. Gromov A.I., Flyaishman A., Shmit V. Upravlenie biznes-protsessami: sovremennye metody (Business Process Management: Modern Methods). Moscow: Yurait; 2026, 367 p. (In Russ.). ISBN 978-5-534-03094-5

7. Hammer M., Hershman L. Bystree, luchshe, deshevle: Devyat’ metodov reinzhiniringa biznes-protsessov (Faster, Better, Cheaper: Nine Methods of Business Process Reengineering): transl. from Engl. Moscow: Kommersant; 2012, 355 р. (In Russ.). ISBN 978-5-9614-1807-1 [Hammer M., Hershman L. Faster Cheaper Better: The 9 Levers for Transforming How Work Gets Done. Grown; 2010, 320 p.]

8. Kaplan R., Norton D. Sbalansirovannaya sistema pokazatelei. Ot strategii k deistviyu (Balanced Scorecard. From Strategy to Action) : transl. from Engl. Moscow: Olimp-Business, 2022, 294 p. (in Russ.).

9. Melnikova N.S. The methodology of determination of efficiency in business process reengineering in commercial banks based on the systematic approach. Nauchnyi rezul’tat. Ehkonomicheskie issledovaniya = Research result. Economic Research. 2017;3(1):55–61 (in Russ.).

10. Mishurova I.V., Nikolaev D.V., Nikolaeva N.V., Filimonova N.M. The process of reengineering of business processes in the management of organizational change the process of reengineering of business processes in the management of organizational change. Izv. vyssh. ucheb. zavedenii. Tekhnologiya tekstil’noi promyshlennosti = Textile Industry Technology. 2018;5:42–47 (in Russ.). https://www.elibrary.ru/yxctqt

11. Kutelev P.V. Business Process Reengineering Based on Artificial Intelligence Management. Финансы и кредит = Finance and Credit. 2019;25(12):2889–2902 (in Russ.). doi: 10.24891/fc.25.12.2889, https://www.elibrary.ru/dmibqz

12. Womack J., Jones D. Berezhlivoe proizvodstvo. Kak izbavit’sya ot poter’ i dobit’sya protsvetaniya vashei kompanii (Lean Thinking. Banish Waste and Create Wealth in Your Corporation): transl. from Engl. Moscow: Al’pina Pablisher; 2013, 470 p. (In Russ.). ISBN 978-5-9614-4398-1

13. Azarov V.N., Chekmarev A.V. Application of Methodologies, Methods and Tools on Total Quality Management in Designing a Digital Enterprise. “Lean Six-Sigma Digital Production Model.” Kachestvo. Innovatsii. Obrazovanie = Quality. Innovation. Education. 2024;3(191):3–29 (in Russ.). https://www.elibrary.ru/pafowb

14. Gul’chevskaya N.E., Sukmanyuk I.V. Navigator vnedreniya OKR: Opyt rossiiskikh kompanii (OKR Implementation Navigator: The Experience of Russian Companies). Moscow: Al’pina Pablisher; 2024, 316 p. (In Russ.).

15. Doerr J. Izmeryaite samoe vazhnoe: Kak Googl, Intel i drugie kompanii dobivayutsya rosta s pomoshch’yu OKR (Measure What Matters: How Google, Bono, and the Gates Foundation Rock the World with OKRs.). Moscow: Mann, Ivanov I Ferber; 2024, 336 p. (in Russ.). [Doerr J. Measure What Matters: How Google, Bono, and the Gates Foundation Rock the World with OKRs. NY: Penguin; 2018, 320 p.]

16. Drucker P.F. Management Practice. Moscow: Mann, Ivanov and Ferber, 2015, 406 p. (In Russ.). [Drucker P.F. Praktika menedzhmenta (The Practice of Management). Moscow: Mann, Ivanov i Ferber; 2015, 406 p. (In Russ.). ISBN 978-5-00057-373-0] [Drucker P.F. The Practice of Management. NY: Harper & Row; 1954, 413 p.]

17. Vellore V. Upravlenie po tselyam i klyuchevym rezul’tatam: Kak rasprostranit’ metodologiyu OKR na vsyu organizatsiyu (Management by Objectives and Key Results: How to Extend the OKR Methodology Across the Organization). Moscow: Al’pina Pablisher; 2024, 288 p. (In Russ.). ISBN 978-5-9614-8922-4

18. Niven P., Lamort B. Tseli i klyuchevye rezul’taty. Polnoe rukovodstvo po vnedreniyu OKR (Objectives and Key Results. Driving Focus, Alignment, and Engagement with OKRs): transl. from Engl. Moscow: Mann, Ivanov i Ferber; 2021, 256 p. (In Russ.). ISBN 978-5-00169-204-1 [Niven P., Lamort B. Objectives and Key Results. Driving Focus, Alignment, and Engagement with OKRs. John Wiley & Sons; 2016, 224 p.]

19. Yashin N.S., Andreeva T.A. The Hoshin Kanri Methodology in Strategic Management of Oil and Gas Corporation. Vestnik Saratovskogo gosudarstvennogo sotsial’no-ehkonomicheskogo universiteta = Vestnik Saratov State Socio-Economic University. 2013;5(49):116–122 (in Russ.). https://www.elibrary.ru/sacbax

20. Brykalov S.M. Introduction of ‘Hoshin Kanri’ Approach in the Atomic Industry Enterprises: Experience, Methodology, Problems. Ehkonomika i predprinimatel’stvo = Economy and Entrepreneurship. 2015;57(4-1):470–474 (in Russ.). https://www.elibrary.ru/trsyzb

21. Liker J.K. Dao Toyota: 14 printsipov menedzhmenta vedushchei kompanii mira (The Toyota Way. 14 Management Principles of the World’s Leading Company) : transl. from Engl. Moscow: Al’pina; 2023, 492 p. (In Russ.). ISBN 978-5-6047582-0-5

22. Imai M. Gemba Kaizen. Put’ k snizheniyu zatrat i povysheniyu kachestva (Gemba Kaizen. The Path to Cost Reduction and Quality Improvement) : transl. from Jap. Moscow: Al’pina Pablisher; 2024, 414 p. (In Russ.).

23. Hunt R., Xavier F. Application of the QFD Methodology in Strategic Management. Strategicheskii menedzhment = Strategic Management. 2011;3:184–198 (in Russ.). https://www.elibrary.ru/ncwzjh

24. Koch R. Printsip 80/20 (The 80/20 Principle) : transl. from Engl. Moscow: Bombora; 2023, 512 p. (In Russ.).

25. Ono T. Proizvodstvennaya sistema Toioty. Ukhodya ot massovogo proizvodstva (The Toyota Production System. Moving Away from Mass Production) : transl. from Engl. Moscow: Institute for Comprehensive Strategic Studies; 2012, 208 p. (In Russ.).

26. Batrimenko A., Tarasova I. Vnutrennee predprinimatel’stvo: Kak zadeistvovat’ potentsial sotrudnikov dlya razvitiya biznesa. Prakticheskoe rukovodstvo (Intrapreneurship: How to Harness Employee Potential for Business Development. A Practical Guide). M.: Olimp-Biznes; 2023, 424 p. (In Russ.).

27. Adizes I.K. Upravlenie izmeneniyami bez potryasenii i konfliktov (Managing Change Without Shocks and Conflicts) : transl. from Engl. Moscow: Al’pina; 2023, 260 р. (In Russ.).

28. Xu Ya., Tang D., Kohavi R. Doveritel’noe A/V-testirovanie. Prakticheskoe rukovodstvo po kontroliruemym ehksperimentam (Confidence A/B Testing. A Practical Guide to Controlled Experiments) : transl. from Engl. M.: DMK-Press; 2021, 299 p. ISBN 978-1-108-72426-5 (Engl.). ISBN 978-5-97060-913-2 (Russ.).

29. Dantas T.M., Oliveira F.L.C. Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing. Int. J. Forecast. 2018;34(4):748–761. doi: 10.1016/j.ijforecast.2018.05.006