Restoration of a blurred photographic image of a moving object obtained at the resolution limit

Objectives. When processing images of the Earth’s surface obtained from satellites, the problem of restoring a blurry image of a moving object is of great practical importance. The aim of this work is to study the possibility of improving the quality of restoration of blurry images obtained at the limit of the resolution of the camera.

Methods. Digital signal processing methods informed by the theory of incorrect and ill-conditioned problems were used.

Results. The proposed method for restoring a blurred photographic image of a moving object differs from traditional approaches in that the discrete convolution equation, to which the problem of restoring a blurred image is reduced, is obtained by approximating the corresponding integral equation based on the Kotelnikov interpolation series rather than on the traditional basis of the quadrature formula. In the work, formulas are obtained for calculating the kernel of the convolution obtained using the Kotelnikov interpolation series. The discrete convolution inversion problem, which belongs to the class of ill-posed problems, requires regularization. Results of traditional approaches to restoring blurred images using the quadrature formula with Tikhonov regularization and the proposed method based on the Kotelnikov interpolation series are compared. Although the quality of the blurred image restoration is almost the same in both cases, in the quadrature formula the blur value is expressed as an integer number of pixels, while, when using the Kotelnikov series, this value can also be specified in fractions of a pixel.

Conclusions. The expediency of discretizing the convolution describing the image distortion of the blur type on the basis of the Kotelnikov interpolation series when processing a blurred image obtained at the limit of the resolution of the camera is demonstrated. In this case, the amount of blur can be expressed in fractions of a pixel. This situation typically arises when processing satellite photography of the Earth’s surface.

1. Sizikov V., Dovgan A. Reconstruction of images smeared uniformly and non-uniformly. CEUR Workshop Proceedings. 2019;2344: paper 2. Available from URL: https://ceur-ws.org/Vol-2344/paper2.pdf

2. Sizikov V.S. Pryamye i obratnye zadachi vosstanovleniya izobrazhenii, spektroskopii i tomografii s MatLab (Direct and Inverse Problems of Image Reconstruction, Spectroscopy and Tomography with MATLAB). St. Petersburg: Lan’; 2011. 410 p. (in Russ.). ISBN 978-5-8114-2754-3

3. Vasilenko G.I., Taratorin A.M. Vosstanovlenie izobrazhenii (Image Recovery). Moscow: Radio i svyaz’; 1986. 302 p. (in Russ.).

4. Bakushinskii A.B., Goncharskii A.V. Nekorrektnye zadachi. Chislennye metody i prilozheniya (Incorrect Tasks. Numerical Methods and Applications). Moscow: Moscow University Press; 1989. 199 p. (in Russ.).

5. Bates R., McDonnell M. Vosstanovlenie i rekonstruktsiya izobrazhenii (Image Restoration and Reconstruction): transl. from Engl. Moscow: Mir; 1989. 336 p. (in Russ.). [Bates R., McDonnell M. Image Restoration and Reconstruction. NY: Oxford University Press; 1986. 312 p.]

6. Gonzalez R., Woods R. Tsifrovaya obrabotka izobrazhenii (Digital Image Processing). Moscow: Tekhnosfera; 2012. 1104 p. (in Russ.). [Gonzalez R., Woods R. Digital Image Processing. Prentice Hall; 2008. 954 p.]

7. Goncharskii A.V., Leonov A.S., Yagola A.G. Methods for solving Fredholm integral equations of the 1st kind of convolution type. In: Some Problems of Automated Processing and Interpretation of Physical Experiments. V. 1. Moscow: Moscow University Press; 1973. P. 170–191 (in Russ.).

8. Medoff B.P. Image Reconstruction from Limited Data: Theory and Application in Computed Tomography. In: G. Stark (Ed.). Image Reconstruction. Moscow: Mir; 1992. P. 384–436 (in Russ.).

9. Tikhonov A.N., Goncharskii A.V., Stepanov V.V., Yagola A.G. Regulyariziruyushchie algoritmy i apriornaya informatsiya (Regularizing Algorithms and A Priori Information). Moscow: Nauka; 1983. 198 p. (in Russ.).

10. Aref’eva M.V., Sysoev A.F. Fast regularizing algorithms for digital image restoration. In: Vychislitel’nye metody i programmirovanie (Numerical Methods and Programming). 1983. Is. 39. P. 40–55 (in Russ.).

11. Vasilenko G.I. Teopiya vosstanovleniya signalov: O reduktsii k ideal’nomu priboru v fizike i tekhnike (Theory of Signal Recovery: On the Reduction to an Ideal Device in Physics and Technology). Moscow: Sovetskoe Radio; 1979. 272 p. (in Russ.).

12. Tikhonov A.N., Arsenin V.Ya. Metody resheniya nekorrektnykh zadach (Methods for Solving Ill-Posed Problems). Moscow: URSS; 2022. 288 p. (in Russ.). ISBN 978-5-9710-9341-1

13. Tikhonov A.N., Goncharskii A.V., Stepanov V.V. Inverse problems of photo image processing. In: Tikhonov A.N., Goncharskii A.V. (Eds.). Incorrect Problems of Natural Sciences. Moscow: Moscow University Press; 1987. P. 185–195 (in Russ.).

14. Russ J.C. The Image Processing Handbook. Boca Raton: CRC Press; 2007. 852 p.