NOISE CHARACTERISTICS ESTIMATION IN REAL-WORLD IMAGES USING CONVOLUTIONAL NEURAL NETWORK IN MOBILE PLATFORM

Ростислав Вікторович Цехмистро, Вікторія Валеріївна Абрамова, Андрій Сергійович Рубель, Михайло Леонтійович Усс, Галина Анатоліївна Проскура, Олексій Сергійович Рубель

Abstract


The subject of the study is the noise characteristics in real images obtained by mobile devices. The goal is to create a demo mobile application in Android platform, which realizes real-time estimation of noise characteristics in such images. Tasks: to investigate the accuracy of noise characteristics estimation by NoiseNet neural network on test images from the Tampere17 database; to conduct a preliminary study of the type, intensity and correlation characteristics of the noise in images obtained by mobile devices; to investigate the possibility of using NoiseNet to assess the noise characteristics in these images. The following results were obtained. Analyzing the noise characteristics in test images from the Tampere17 database, distorted by white Gaussian noise, it was shown that in general, the NoiseNet neural network demonstrates a rather high estimation accuracy (the relative error of evaluation does not exceed 0.2). However, for some images, in particular, highly textured, the value of relative error can be several times higher. The noise characteristics of images taken in various conditions by cameras embedded in mobile devices from various manufacturers were studied. It is shown that the noise in such images is signal-dependent and is often characterized by a high degree of spatial correlation. At the same time, the degree of spatial correlation of noise largely depends on lighting conditions of photo taking and is higher for images obtained in dim light. Since the NoiseNet neural network is not designed to work with spatially correlated noise, for its applying the images were preprocessed to eliminate the spatial correlation of noise. The ready-to-use NoiseNet neural network and the Android demo application for testing are available on the GitHub resource: https://github.com/radiuss/NoiseNet.

Keywords


convolution neural network; noise characteristics; mobile phone; estimate of quality image; processing image data

References


Lukac, R. Single-sensor imaging. CRC Taylor & Francis Publ., 2009. 626 p.

Pratt, W. Digital image processing. Fourth Edition. NY, USA, Wiley-Interscience Publ., 2007. 812 p.

Lim, S. Characterization of noise in digital photographs for image processing. Digital Photography II, 2006, pp. 159-170.

Pižurica, A. Image Denoising Algorithms: From Wavelet Shrinkage to Nonlocal Collaborative Filtering. Wiley Encyclopedia of Electrical and Electronics Engineering, 2017, pp 1-17.

Milanfar, P. A Tour of Modern Image Filtering. IEEE Signal Processing Magazine, 2013, vol. 30, pp. 106-128.

Lebrun, M., Colom, M., Buades. A., Morel, J. M. Secrets of image denoising cuisine. Acta Numerica, 2012, vol. 21, pp. 475–576.

Paliy, D., Katkovnik, V., Bilcu, R., Alenius, S., Egiazarian, K. Spatially adaptive color filter array interpolation for noiseless and noisy data. International Journal of Imaging Systems and Technology, 2007, vol. 17, no. 3, pp. 105-122.

Elad, M. Sparse and Redundant Representations. New York, Springer Science Publ., 2010. 397 p.

Li, X., Gunturk, B., Zhang, L. Image demosaicing: a systematic survey. Visual Communications and Image Processing 2008, 2008, vol. 6822, pp. 1-15.

Goossens, B., Pizurica, A., Philips, W., Removal of correlated noise by modeling the signal of interest in the wavelet domain. IEEE Transactions on Image Processing, 2009, vol. 18, pp. 1153-1165.

Rubel, O., Rubel, A., Lukin, V., Egiazarian, K. Blind DCT-based prediction of image denoising efficiency using neural networks, in Proc. 7-th Eur. Workshop Vis. Inf. Process. (EUVIP), nov. 2018, pp. 1-6.

Chatterjee, P., Milanfar, P., Practical Bounds on Image Denoising: From estimation to information. IEEE Transactions on Image Processing, 2011, vol. 20, pp. 1221–1233.

Abramov, S., Zabrodina, V., Lukin, V., Vozel, B., Chehdi, K., Astol, J., Methods for Blind Estimation of the Variance of Mixed Noise and Their Performance Analysis. Numerical Analysis - Theory and Application. Paris, 2011, pp. 1-23.

Abramov, S., Segmentation-based method for blind evaluation of noise variance in images. Journal of Applied Remote Sensing, 2008, vol. 2, no. 1, pp. 22-37.

Abramov, S., Zabrodina, V., Lukin, V., Vozel, B., Chehdi, K., Astola, J., Improved method for blind estimation of the variance of mixed noise using weighted LMS line fitting algorithm. Proceedings of 2010 IEEE International Symposium on Circuits and Systems, Paris, 2010, pp. 2642-2645.

Colom, M., Lebrun, M., Buades, A., Morel, J. A non-parametric approach for the estimation of intensity-frequency dependent noise. 2014 IEEE International Conference on Image Processing (ICIP), Paris, 2014, pp. 4261–4265.

Abramova, V., Abramov, S., Lukin, V. Iterative Method for Blind Evaluation of Mixed Noise Characteristics on Images. Information and Telecommunication Sciences, 2015, vol. 6, no. 1, pp. 8-14.

Ponomarenko, M., Gapon, N., Voronin, V., Egiazarian, K. Blind estimation of white Gaussian noise variance in highly textured images, Image Proc.: Alg. and Syst. XVI. California, 2018, pp. 1-5.

Uss, M., Vozel, B., Lukin, V., Chehdi, K., Image informative maps for component-wise estimating parameters of signal-dependent noise. Journal of Electronic Imaging, 2013, vol. 22, no. 1, pp. 1-7.

Uss, M., Vozel, B., Lukin, V., Chehdi, K., NoiseNet: Signal-Dependent Noise Variance Estimation with Convolutional Neural Network. Advanced Concepts for Intelligent Vision Systems, Poitiers, 2018, pp. 414-425.

Abramova, V., Abramov, S., Lukin, V., Roenko, A., Vozel, B. Automatic Estimation of Spatially Correlated Noise Variance in Spectral Domain for Images. Telecommunications and Radio Engineering, 2014, vol. 73, no. 6, pp. 511-527.

Foi, A., Trimeche, M., Katkovnik, V., Egiazarian, K. Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data. IEEE Transactions on Image Processing, 2008, vol. 17, no. 10, pp. 1737-1754.

Azzari, L., Foi, A. Variance Stabilization for Noisy+Estimate Combination in Iterative Poisson Denoising. IEEE Signal Processing Letters, 2016, vol. 23, pp. 1086-1090.

Makitalo, M., Foi, A. Noise Parameter Mismatch in Variance Stabilization, With an Application to Poisson–Gaussian Noise Estimation. IEEE Transactions on Image Processing, 2014, vol. 23, pp. 5348-5359.

Rubel, O., Lukin, V., Uss, M., Vozel, B., Pogrebnyak, O., Egiazarian, K. Efficiency of texture image enhancement by DCT-based filtering. Neurocomputing, 2016, vol. 156, pp. 948-965.

Rubel, O., Lukin, V., Abramov, S., Vozel, B., Egiazarian, K., Pogrebnyak, O. Efficiency of texture image filtering and its prediction. Signal, Image and Video Processing, 2016, vol. 10, no. 8, pp. 1543-1550.

Rubel, O., Lukin, V., Abramov, S., Vozel, B., Pogrebnyak, O., Egiazarian, K. Is Texture Denoising Efficiency Predictable? International Journal of Pattern Recognition and Artificial Intelligence, 2018, vol. 32, no. 1, pp. 1-32.




DOI: https://doi.org/10.32620/reks.2019.2.05

Refbacks

  • There are currently no refbacks.