Научная статья на тему 'Super-resolution microscopy based on wide spectrum denoising and compressed sensing'

Super-resolution microscopy based on wide spectrum denoising and compressed sensing Текст научной статьи по специальности «Физика»

CC BY
38
13
i Надоели баннеры? Вы всегда можете отключить рекламу.
Журнал
Компьютерная оптика
Scopus
ВАК
RSCI
ESCI
Область наук
Ключевые слова
fluorescence microscopy / super-resolution / noise / diffraction theory / compressed sensing

Аннотация научной статьи по физике, автор научной работы — Cheng T., Jin H.

WSD can effectively remove random noise of a raw image from very low density to ultra-high density fluorescent molecular distribution scenarios. The size of the raw image that WSD can denoise is subject to the used measurement matrix. A large raw image must be divided into blocks so that WSD denoises each block separately. Based on traditional single-molecule localization and super-resolution reconstruction scenarios, wide spectrum denoising (WSD) for blocks of different sizes was studied. The denoising ability is related to block sizes. The general trend is when the block gets larger, the denoising effect gets worse. When the block size is equal to 10, the denoising effect is the best. Using compressed sensing, only 20 raw images are needed for reconstruction. The temporal resolution is less than half a second. The spatial resolution is also greatly improved.

i Надоели баннеры? Вы всегда можете отключить рекламу.
iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.
i Надоели баннеры? Вы всегда можете отключить рекламу.

Текст научной работы на тему «Super-resolution microscopy based on wide spectrum denoising and compressed sensing»

Super-resolution microscopy based on wide spectrum denoising

and compressed sensing

T. Cheng1, H. Jin1 1 Guangxi University of Science and Technology, 545006, Liuzhou, P. R. China, Chengzhong District, Avenue Donghuan 268

Abstract

WSD can effectively remove random noise of a raw image from very low density to ultra-high density fluorescent molecular distribution scenarios. The size of the raw image that WSD can denoise is subject to the used measurement matrix. A large raw image must be divided into blocks so that WSD denoises each block separately. Based on traditional single-molecule localization and super-resolution reconstruction scenarios, wide spectrum denoising (WSD) for blocks of different sizes was studied. The denoising ability is related to block sizes. The general trend is when the block gets larger, the denoising effect gets worse. When the block size is equal to 10, the denoising effect is the best. Using compressed sensing, only 20 raw images are needed for reconstruction. The temporal resolution is less than half a second. The spatial resolution is also greatly improved.

Keywords: fluorescence microscopy, super-resolution, noise, diffraction theory, compressed sensing.

Citation: Cheng T, Jin H. Super-resolution microscopy based on wide spectrum denoising and compressed sensing. Computer Optics 2023; 47(3): 426-432. DOI: 10.18287/2412-6179-CO-1172.

Introduction

Far-field optical microscopy imaging in the visible light band has the advantages of noncontact, being nondestructive, and allowing internal sample probing. Owing to the diffraction phenomenon, the point light source cannot form a point image on the focal plane after passing through the microscope imaging system. It forms a diffuse spot (i.e., an Airy disc). Because of the diffraction limit, the lateral resolution is only 200 nm [1 - 4].

Far-field optical super-resolution microscopy imaging beyond the diffraction limit has always been a popular research topic [5 - 7]. Both Stochastic optical reconstruction microscopy (STORM) and (fluorescence) photoacti-vated localization microscopy ((F)PALM) are based on the imaging of sparsely distributed molecules and single-molecule localizations (SMLs) [1, 2, 8, 9]. In these SML-based microscopic techniques, only a portion of the sparsely distributed molecules is imaged and localized in each raw image. The final super-resolution image requires thousands of raw images. The lateral resolutions are approximately 20 nm [1, 2, 7, 10, 11].

The noise of a raw image acquired by an electron-multiplying charge-coupled device (EMCCD) mainly includes a shot noise following a Poisson distribution, a readout noise following a Gaussian distribution and a background [9, 12 - 14]. SML algorithms, such as the Gaussian fitting method, have good anti-noise ability [1, 2, 7 - 9, 15]. Therefore, the denoising preprocessing is not necessary for raw images. Various studies on fluorescent molecular localization in the field of super-resolution microscopy rarely report denoising of raw images before localization [1, 2, 5 - 9, 15].

Compressed sensing (CS) is a super resolution microscopy reconstruction method which is different from SMLs. CS can increase the maximum density of fluores-

cent molecules in a raw image, even if these fluorophores are not distributed so sparsely that their images overlap with one another [7, 9, 16, 17]. Because the readout noise of EMCCD cameras and its variance are small, raw image simulations sometimes consider only the background and the Poisson noise [9, 12 - 14].

The requirements of super-resolution microscopy experiment for microscopes, cameras and fluorescent dyes are very high. If cheap microscopes, cameras and fluorescent dyes are used, the acquired raw images often contain a lot of noises. It is almost impossible to reconstruct any effective super-resolution cell microtubule structure [8, 17, 18]. Wide spectrum denoising (WSD) is applicable to various random noises. It is an efficient denoising algorithm for raw images [17, 18].

In the traditional SMLs and super-resolution reconstruction, if the size of the raw image pixel is approximately equal to the standard deviation (s.d.) of the point spread function (PSF), good localization and reconstruction effects can be achieved [6 - 9, 16]. Therefore, a large number of traditional experimental data accumulated in the past were based on the size of the raw image pixel about equal to the s.d. of the PSF [5, 6, 10, 19].

Based on the traditional experimental data, we studied the denoising effect of WSD on low-density and high-density raw images and its relationship with the block sizes. Simulation and experimental results show that WSD has good denoising ability to the traditional experimental data, and the corresponding super-resolution reconstruction is obviously better and faster. The temporal resolution of half a second was realized.

1. PSF-based measurement matrices corresponding to different sizes of raw images

The PSF is the light-intensity distribution function at work in the image plane when light from an infinitely

small point object passes through an optical system, such as a microscope. The imaging process of the optical system is the convolution of the object function and PSF [9, 12, 14, 16, 20].

Eq. (1) shows a mathematical model between a raw image and a super-resolution image after converting a 2D image to a 1D vector [16 - 18]. The vectors, y and x consist of row-wise or column-wise concatenations of the raw image and the super-resolution image (i.e., pixelated original image) respectively.

The measurement matrix A is determined by the PSF of the imaging system. The acquired raw image corresponds to the i th column of A if only one molecule emits fluoroscopic photons at the position index i of x [9, 16].

y = Ax, (1)

where xeR#, y eRM, AeRMxN, M< N, Mand N are natural numbers from 1. x is a vector containing N elements. y is a vector containing M elements. A is a matrix of size M xN.

To be distinguished from the pixels of the raw image, the pixels of the super-resolution image are referred to as grids. The super-resolution image's grid is 1/8 of the pixel size of the raw image. If the size of the raw image is 7x7 pixels, it is located in the middle of the 64 x 64 grid super-resolution image. At this point, the size of the corresponding measurement matrix A is 49 x 4096. The matrix A is labeled as A7. If the size of the raw image is 37 x 37 pixels, the size of the corresponding measurement matrix A (i.e., A37) is 1369 x 92417. In this paper, 31 matrices (i.e., A7 - A37) were studied.

2. Wide spectrum denoising (WSD)

WSD can be effectively used to remove random noise such as Poisson and Gaussian noise from very low density to ultra-high density fluorescent molecular distribution scenarios [17, 18]. If the measurement matrix A is operated by orthogonalization and normalization, the measurement matrix Ao can be obtained. Row orthogonal normalization is an operation in the matrix theory. It makes the rows of the matrix completely orthogonal. Moreover, it makes the 2-norm of each row of the matrix equal to 1. Through Ao and A, the operator matrix T which is equivalent to the row orthogonal normalization operation can be obtained, where T=AOT (AAT)-1. Therefore, y=Ax can be equivalently converted to Ty = TAx. If a singular value decomposition is applied to T, T=USVT. S is a diagonal sparse matrix that is composed of singular values of T. VT is a transpose matrix of V. Therefore, Ty = TAx can be equivalently converted to SVTy = SVTAx.

According to the geometrical and physical meanings of the square matrices S and V, V can change the direction of a vector, and S can change the magnitude (i.e., I2-norm) of a vector. S can be regarded as a high-dimensional ellipsoid projection operator with the singular values of T as the axis of the high-dimensional ellip-

soid. The long axis is much longer than the short axis in the high-dimensional ellipsoid [17].

Regardless of the type of noise, it is approximately orthogonal to the signal as long as it is random noise. The noise-free raw image was projected onto the short-axis region of the high-dimensional ellipsoid of S. Thereafter, the noise that was approximately orthogonal to this image was projected onto the long-axis region of the high-dimensional ellipsoid of S, resulting in a sharp amplification of the noise. S is a sparse matrix whose elements are zero except for the diagonal elements. In the matrix theory, such a matrix is referred to as a high-dimensional ellipsoid with diagonal elements as its long- and short-axes [17].

Let z = SVTy. The threshold value cri is the largest absolute values of elements of z between the indices Mx0.9 and Mx0.95. M is the number of rows of the measurement matrix A and it also represents the number of pixels in the block. z is a vector containing M elements. Mx0.9 and Mx0.95are respectively the integer part of M x 0.9 and M x 0.95. The index is the serial number (or, sequence number) of elements of z from 1 to M. Through numerous experiments, we have found that the values of the elements in z without noise can rarely be greater than cri. Therefore, z's elements greater than cri are set to cri. The new z is represented by zwsd. In this way, the noise of the raw image can be effectively removed. The denoised raw image using WSD is ywsD, ywsD =T 1Uzwsd [17].

The current main criterion for judging the performance of the measurement matrix is the maximum absolute value of the coherence coefficients between the columns of the measurement matrix (i.e. ||max|) [21]. The coherence coefficient (|) is the cosine of the included angle between two column vectors (i.e., the inner products between any two distinct normalized columns). The \|max\ values of all 31 matrices are 0.999511. The \|max\ does not change with the change of the matrix size, if the grid size of super-resolution image and the pixel size of raw image remains unchanged.

The raw image of 37 x 37 pixels is small. The raw image of 7 x 7 pixels is smaller. If the raw image is large, the raw image must be divided into blocks according to block sizes (i.e., 7 - 37). We denoised these small blocks using WSD respectively. Thereafter, the denoised blocks are merged block by block. If the size of the raw image is 14 x14 pixel, and the number of rows of the measurement matrix A is 49, the raw image must be divided into 4 blocks. Then WSD denoises each block separately. The size of each block is 7 x 7 pixel.

3. Simulation data and division of raw images

To evaluate the denoising performance of WSD for different block sizes of raw images, we generate simulated 500 super-resolution images with known true molecular positions and corresponding 500 raw images. The pixels of the super-resolution image are referred to as grids. The effective grid size is 11.429 nm. The simulation ran-

domly places 34 molecules in a 1024 x 1024 grid region. 1024 x 11.429 nm = 11.7 ^m. 1 ^m = 1000 nm. The area of the grid region is 11.7 ^m x 11.7 ^m. We generate simulated 20 super-resolution images with known true molecular positions and corresponding 20 raw images again. The simulation randomly places 863 molecules in a 1024 x 1024 grid (11.7 ^m x 11.7 ^m) region. The corresponding molecular densities are 0.248 and 6.304 |im 2 respectively. The super-resolution image's grid is 1/8 of the pixel size of the raw image. The effective pixel size of the raw image is 91.429 nm. The size of the raw image is 128 x 128 pixels. The PSF is a Gaussian function. The s.d. of the PSF is equal to 1.11 times of the raw pixel size. The simulation is for a photon number of 3,000 per molecule and a uniform background of 64 photons per pixel. Poisson noise and Gaussian noise (Gaussian noise variances of 0.01) are added to each frame of the raw image.

Signal to Noise Ratio (SNR) can indicate the overall quality of the denoised raw images and the reconstructed super-resolution image [16]. Structural similarity index measure (SSIM) is used for measuring the similarity between two images [22, 23]. The SSIM values range between 0 and 1. If the two images are identical, the value of SSIM is equal to 1. SSIM can be used to measure the quality of raw image denoising and super-resolution reconstruction. In this paper, SNR and SSIM are used to measure the denoising effect of raw images and the reconstruction effect of super-resolution images.

SNR = 20 x log10 [„ I|X|I\ |, (2)

^||xr - x||2)

where x is a real signal, xgRn; ||-||2 is the norm of a vector; and xr denotes the other signal corresponding x.

SSIM (x, y )=, + c'))(2Q » + c2) , , (3)

( + |2 + c ) +a2y + c2)

where | and CTx represent the mean and the variance of image x, respectively. Oxy represents the covariance of image x and y. c = (k\L)2 and c2 = (feZ)2. L is the dynamic range of pixel values. = 0.01, ¿2 = 0.03.

4. Denoising and reconstruction of simulated low-

density raw images based on different block sizes

Fig. 1 is the mean value of SNRs of 500 simulated raw images before and after denoising. Each frame contains 34 fluorescence molecules. SNR are inversely proportional to block size after denoising. SNR decreases as the block size gets bigger. The SNR before denoising was 3.113 dB at block size 7. SNR is increased by more than 5 dB after denoising. The maximum value of SNRs is 9.252 dB, and the block size is equal to 10.

The upper row in Fig. 2 is a frame of raw images before and after denoising and the true noiseless raw image. After denoising, SSIM was increased from 0.062 to 0.096, an increase of about half of 0.062. SNR increased from 2.426 dB to 7.939 dB, increasing by 5.513 dB.

Fig. 2b is smoother than Fig. 2a and the denoising effect is obvious. WSD is an efficient denoising algorithm.

7 10 15 20 25 30 35 37

8-

CQ R

2.

a.

z -

co

4-

-8 -6 -4

2- -2

7 10 15 20 25 30 35 37 block size

Fig. 1. Comparison of the mean SNRs based on 500 simulated raw images before and after denoising. The simulation is for a photon number of3,000 per molecule and a background of 64 photons per pixel. Each frame contains 34 fluorescent molecules. Poisson noise and Gaussian noise (Gaussian noise variances of 0.01) are added to each frame of the raw image. The y axis is labeled in SNR (dB). The x axis is labeled in block size

The middle row is the super-resolution image reconstructed by CS based on the raw image before and after denoising and the true super-resolution image. After denoising, SSIM increased from 0.011 to 0.758, increasing by about 0.747. SNR increased from -14.891 dB to 0.241 dB, increasing by 15.132 dB. WSD has a significant enhancement effect on superresolution reconstruction.

The lower row is enlarged images from the center areas marked by yellow squares in the middle row. The reconstruction failed in Figs. 2d and g. No valid microtu-bule structures were seen. Compared with Figs. 2h and i, although the microtubule structure in Fig. 2h is thicker than that in Fig. 2i, it can well express the real microtu-bule structure. The cell microtubule structure is clear.

5. Denoising and reconstruction of simulated high-

density raw images based on different block sizes

Fig. 3 is the mean value of SNRs of 20 simulated raw images before and after denoising. Each frame contains 863 fluorescence molecules. SNR is inversely proportional to block size after denoising. SNR decreases as block size gets bigger. The SNR before denoising was 5.545 dB at block size 7. SNR is increased by about 4.5 dB after denoising. The maximum value of SNRs is 10.238 dB, and the block size is equal to 10, too.

Fig. 4 is a frame of raw images before and after de-noising and the true noiseless raw image. After denoising, SSIM was increased from 0.259 to 0.416, increasing by about 0.157. The SNR increased from 5.332 dB to 9.981 dB, increasing by 4.649 dB. Fig. 4b is smoother than Fig. 4a and the denoising effect is obvious. WSD is an efficient denoising algorithm.

Before (0.062, 2.426 dB)

After (0.096, 7.939 dB)

True

a

a) I^K^l^^nB b) HIc)

(0.011,-14.891 dB) (0.758,0.241 dB)

Fig. 2. Comparison of the raw image and the super-resolution image before and after denoising. The upper row is a frame of the 500 raw images before and after denoising, and the true raw image. The middle row is the corresponding super-resolution image before and after denoising based on the 500 raw images, and the true super-resolution image. The lower row is enlarged images from the center areas marked by yellow squares in the middle row. The yellow squares in the middle row are 3640 x 3640 nm. The number pairs above the images indicate SSIM and SNR (dB) of the images. Scale bars: 1 ym

35 37

10 9

□a 8 a:

œ

7

-10 9 8 -7 -6 -5

35 37

block size

Fig. 3. Comparison of the mean SNRs based on 20 simulated raw images before and after denoising. The simulation is for a photon number of3,000per molecule and a background of 64 photons

per pixel. Each frame contains 863fluorescent molecules. Poisson noise and Gaussian noise (Gaussian noise variances of 0.01) are added to each frame of the raw image. The y axis is labeled in SNR (dB). The x axis is labeled in block size

Fig. 5 is the super-resolution image reconstructed by CS based on the raw images before and after denoising. After denoising, SSIM increased from 0.302 to 0.735, increasing by about 0.433. SNR increased from -17.183 dB to -1.459 dB, increasing by 15.724 dB. WSD has a significant enhancement effect on super-resolution reconstruction.

Comparing the enlarged images from the top and bottom areas marked by yellow squares in the left column, the reconstruction failed in Figs. 5a-c. No valid microtubule structures were seen. Although the microtubule structure in Figs. 5e and f is thicker, it can well express the real microtu-bule structure. The cell microtubule structure is clear.

6. Real experimental data analysis

Fig. 6 shows an experimental raw image with a high-density molecular distribution before and after denoising, and the corresponding super-resolution reconstruction results. The upper row in Fig. 6 is a frame of 20 raw images before and after denoising. Comparing the images, it is obvious that the denoised raw images are smoother than the raw images. The denoising effect is obvious.

6

5

(0.259, 5.332 dB)

(0.416, 9.981 dB)

a) Before b) After c) True

Fig. 4. Comparison of a frame of the 20 raw images before and after denoising. (a) The raw images before denoising. (b) The raw images after denoising. (c) The true raw image. The number pairs above the images indicate SSIM and SNR (dB) of the images. Scale bars: 1 ym (0.302,-17.183 dB)

a) Before (0.735,-1.459 dB)

b) Enlarged

c) Enlarged

d) After e) Enlarged f) Enlarged

Fig. 5. Comparison of the super-resolution image before and after denoising. The upper row is the super-resolution image before denoising based on the 20 raw images. The lower row is the super-resolution image after denoising based on the 20 raw images. The yellow squares in the left column are 3640 x 3640 nm. The middle and right columns are enlarged images from the center areas marked by yellow squares in the left column. The number pairs above the images indicate SSIM and SNR (dB) of the images. Scale bars: 1 ym

¡>з

e) Before f) After g) Before h) After

Fig. 6. Comparison of the experimental raw images and the super-resolution images before and after denoising. The upper row is 2 frames of raw images from 2 different raw image sets before and after denoising. The lower row is corresponding super-resolution

images before and after denoising respectively. Scale bars: 1 ym

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

Comparing the reconstruction results of the raw images before and after denoising in Figs. 6e-h, the spatial resolution is obviously improved and the cell microtubule structure is clearer and thinner. After denoising, CS can converge faster, and the number of iterations is reduced, increasing the computational speed. The CS calculation time of one frame image is 21 min and 14 min before and after denoising respectively. The calculation time was reduced by 7 min (i.e., 1/3).

Real denoising experiments of WSD prove that a complex cell microtubule structure can be reconstructed only using 20 frame high-density raw images and CS. The raw images were recorded at a frame rate of 46.436 Hz. The frame rate of 46.436 Hz means that 20 raw images can be acquired per second. 20 frame / 46.436 frame x 1s = 0.4307 s. The temporal resolution of the super-resolution image sequence reaches approximately 0.4307 s (20 frames).

Conclusion

In traditional SMLs and super-resolution reconstruction, if the raw pixel size is approximately equal to the PSF's s.d., good localization and reconstruction effects can be achieved. Based on similar scenarios, we studied the denoising ability of WSD for blocks of different sizes. The denoising ability of WSD is related to the block sizes. The larger the block is, the worse the denoising effect is. When the block size is equal to 10, the best denoising effect can be achieved. At this time, the number of rows of the measurement matrix is 100. 10 x 10 = 100. The size of the block WSD can denoise is 10 x 10 pixel. SNR can be increased by 5 dB at low density and 4.5 dB at high density. The denoising effect is better at low density. De-noising has great influence on super-resolution reconstruction effect and reconstruction time. Better superresolution reconstruction and shorter reconstruction time can be achieved after denoising. Based on real experimental data and WSD, it can monitor the life process of living cells with a temporal resolution of half a second (0.4307 s at a frame rate of 46.436 Hz). The superresolution reconstruction time reduced by 1/3. The cell microtubule structure is clearer and thinner. The hmoA does not change with the change of the matrix size, if the grid size of super-resolution image and the pixel size of raw image remains unchanged.

Acknowledgements

The work was funded by Guangxi National Natural Science Foundation (2022GXNSFAA035593), National Natural Science Foundation of China (81660296, 41461082).

References

[1] Betzig E, Patterson GH, Sougrat R, Lindwasser OW, Olenych S, Bonifacino JS,Davidson MW, Lippincott-Schwartz J, Hess HF, Imaging intracellular fluorescent proteins at nanometer resolution, Science 2006; 313(15): 1642-1645. DOI: 10.1126/science.1127344.

[2] Rust MJ , Bates M, Zhuang XW, Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM), Nature methods 2006; 3(10) :793-796. D0I:10.1038/nmeth929.

[3] Komis G, Samajova O, Ovecka M, Samaj J, Superresolution Microscopy in Plant Cell Imaging, Trends in Plant Science 2015; 20 (12): 834-843. DOI: 10.1016/j.tplants.2015.08.013.

[4] Nizamudeena Z, Markusb R, Lodgec R, Parmenterd C, Platte M, Chakrabartif L, Sottilea V, Rapid and accurate analysis of stem cell-derived extracellular vesicles with super resolution microscopy and live imaging, BBA -Molecular Cell Research (2018); 76 (1865):1891-1900. D0I:10.1016/j.bbamcr.2018.09.008.

[5] Achimovich AM, Ai H, Gahlmann A, Enabling technologies in super-resolution fluorescence microscopy: reporters, labeling, and methods of measurement, Current Opinion in Structural Biology (2019); 32 (58): 224-232. D0I:10.1016/j.sbi.2019.05.001.

[6] Valli J, Garcia-Burgos A, Rooney LM, Oliveira BVdMe, Duncan RR, Rickman C, Seeing beyond the limit: A guide to choosing the right super-resolution microscopy technique, Journal of Biological Chemistry (2021); 297(1): 1-13 . D0I:10.1016/j.jbc.2021.100791.

[7] Calises Gi, Ghezzi A, Ancora D, D'Andrea C, Valentini G, Farina A, Bassi A, Compressed sensing in fluorescence microscopy, Progress in Biophysics and Molecular Biology (2022); 60 (168) : 66-80. DOI : 10.1016/j.pbiomolbio.2021.06.004.

[8] Thompson RE, Larson DR, Webb WW, Precise Nanometer Localization Analysis for Individual Fluorescent Probes, Biophysical Journal (2002); 63 (82) :2775-2783. DOI : 10.1016/S0006-3495(02)75618-X.

[9] [9]Zhu L, Zhuang Wei, Elnatan D, Huang B, Faster STORM using compressed sensing, Nature methods (2102), 9(7):721-723. DOI: 10.1038/nmeth.1978.

[10] Cheezum MK, Walker WF, Guilford WH, Quantitative Comparison of Algorithms for Tracking Single Fluorescent Particles, Biophysical Journal (2001) ;81(4):2378-2388. D0I:10.1016/S0006-3495(01)75884-5.

[11] Dame S, Hagai K, Thomas P, Nico S, Junhong M, Suliana M, Michael U, Quantitative evaluation of software packages for single-molecule localization microscopy, Nature Methods(2015); 12(8):717-724. D0I:10.1038/nmeth.3442.

[12] Holden SJ, Uphoff S, Kapanidis AN, DAOSTORM: an algorithm for high- density super-resolution microscopy, Nature Methods(2011);8 (4):279-280. D0I:10.1038/nmeth0411-279.

[13] Beier HT, Ibey BL, Experimental comparison of the highspeed imaging performance of an EM-CCD and SCMOS camera in a dynamic live-cell imaging test case, PLOS 0NE(2014);9 (1) :1-6. D0I:10.1371/journal.pone.0084614.

[14] Min JH, Vonesch C, Kirshner H, Carlini L, Olivier. N, Holden. S, Manley S, Ye.JC, Unser M, FALCON: fast and unbiased reconstruction of high-density super-resolution microscopy data, Scientific reports(2014); 12 (4577):1-9. D0I:10.1038/srep04577.

[15] Woll D, Flors C, Super-resolution Fluorescence Imaging for Materials Science, Small Methods(2017); 1(1700191): 1-12. DOI: 0.1002/smtd.201700191.

[16] Cheng T, Chen DN, Yu B, Niu HB, Reconstruction of super-resolution STORM images using compressed sensing based on low-resolution raw images and interpolation, Biomedical Optics Express(2017), 8(5) :2445-2457.D0I :10.1364/B0E.8.002445.

[17] Cheng T, Chen DN, Li H, Wide spectrum denoising (WSD) for superresolution microscopy imaging using compressed sensing and a high-resolution camera, Journal of Physics: Conference Series (2020 International Conference on Computer Vision and Data Mining), 1651 (2020) 012177. DOI:10.1088/1742-6596/1651/1/012177.

[18] Cheng T. Wide spectrum denoising method for microscopic images. US Patent 16845110 of July 2, 2022.

[19] Biomedical Imaging Group, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Benchmarking of Single-Molecule Localization Microscopy Software, Source: <http://bigwww.epfl.ch/smlm/>.

[20] Li YM, Mund M, Hoess. P, Deschamps J, Matti U, Nijmeijer. B, Jimenez V, Ellenberg J, Ries. J, Real-time 3D single-molecule localization using experimental point

spread functions, Nature Methods(2018);19 (15) : 367-369. D01:10.1038/nmeth.4661.

[21] Elad M, Optimized projections for compressed sensing, IEEE Trans. Signal Process(2007); 55 (12):5695-5702. D0I:10.1109/TSP.2007.900760.

[22] Roa C, Le VND, Mahendroo M, Saytashev I, RamellaRoman JC, Auto-detection of cervical collagen and elastin in Mueller matrix polarimetry microscopic images using, Biomedical Optics Express(2021);12 (4):2236-2249. D0I:10.1364/B0E.420079.

[23] Lee G, Oh J-W, Her N-G, JeongW-K, DeepHCS ++ : Bright-field to fluorescence microscopy image conversion using multi-task learning with adversarial losses for label-free highcontent screening, Medical Image Analysis(2021); 70 (101995)1-16. D0I:10.1016/j.media.2021.101995.

Authors' information

Tao Cheng, Doctor of Technical Sciences, Professor, Professor of School of Mechanical and Automotive Engineering of Guangxi University of Science and Technology. Research interests: medical imaging and image processing. He is also the corresponding author of this paper. E-mail: ctnp@163.com .

Hu Jin, Master's student of School of Mechanical and Automotive Engineering of Guangxi University of Science and Technology. Research interests: microscopy and image processing. E-mail:_jinhu0777@163.com .

Received June 6, 2022. Final version - December 1, 2022.

i Надоели баннеры? Вы всегда можете отключить рекламу.