Aberration correction and adaptive optics
Aberrations are the wavefront phase deviations of the light from the desired ideal shape that cause imperfect image formation in optical microscopes. They are caused either by imperfections in optics in the imaging systems or by the sample structure. Typically, in the context of biomedical imaging, sample induced aberrations limit the system performance by reducing the maximum imaging depth, image sharpness and contrast.
Optical aberrations can be corrected by using reconfigurable optical elements such as deformable mirrors, spatial light modulators or other adaptive devices. The required correction is determined by using wavefront sensors or image quality-based assessments. Alternatively, if sufficient phase information is captured, the image quality can be improved through computational techniques. For example, in optical coherence tomography systems computational adaptive optics can be used to produce sharp images even from outside of the focal plane of an imaging lens.
We are developing methods and systems that harness the benefits of computational adaptive optics, and optically reconfigurable elements for aberration sensing and correction to allow sharper and faster imaging in optical coherence tomography and fluorescence microscopy.
RECENT PUBLICATIONS:
- Zhu, D., Wang, R., Zurauskas, M., Pande, P., Bi, J., Yuan, Q., Wang, L., Gao, Z. and Boppart, S.A., 2020. Automated fast computational adaptive optics for optical coherence tomography based on a stochastic parallel gradient descent algorithm. Optics Express, 28(16), pp.23306-23319.
- Iyer, R.R., Liu, Y.Z. and Boppart, S.A., 2019. Automated sensorless single-shot closed-loop adaptive optics microscopy with feedback from computational adaptive optics. Optics express, 27(9), p.12998.
- South, F.A., Liu, Y.Z., Bower, A.J., Xu, Y., Carney, P.S. and Boppart, S.A., 2018. Wavefront measurement using computational adaptive optics. JOSA A, 35(3), pp.466-473.
- South, F.A., Kurokawa, K., Liu, Z., Liu, Y.Z., Miller, D.T. and Boppart, S.A., 2018. Combined hardware and computational optical wavefront correction. Biomedical Optics Express, 9(6), pp.2562-2574.
- Shemonski ND, South SA, Liu YZ, Adie SG, Carney PS, and Boppart SA, "Computational high-resolution optical imaging of the living human retina," Nat. Photonics 9(7), 440–443, 2015.
- Ahmad A, Shemonski ND, Adie SG, Kim HS, Hwu WMW, Carney PS, and Boppart SA, "Real-time in vivo computed optical interferometric tomography," Nat. Photonics 7: 444–448, 2013.
- Ralston TS, Marks DL, Carney PS, Boppart SA. Interferometric synthetic aperture microscopy. Nature Physics, 3:129-134, 2007.
Interferometric synthetic aperture microscopy
Interferometric Synthetic Aperture Microscopy (ISAM) is an optical imaging technique developed and demonstrated by Ralston, Marks, Carney, and Boppart. Rather than imaging a fluorescent sample, ISAM measures light scattered from an unstained object. ISAM is based on Optical Coherence Tomography (OCT), a maturing noninvasive technique that has already found application, particularly in opthamology. In addition, the Boppart group is actively pursuing the application of OCT and ISAM to other biomedical tasks, such as cancer detection in a variety of tissue types.
OCT and ISAM both rely on interferometric detection of scattered light. A broadband source is used and the resulting data are a function of two spatial variables and the wavelength - (x,y,λ). With the correct processing the data can be used to infer object structure in three spatial dimensions - (x,y,z). In OCT the image is reconstructed only where the probing light is in focus. The achievement of ISAM is to recognize that light outside of the focus can be computationally focused after data acquisition. This greatly improves the depth-of-field available. As in OCT, the processing used in ISAM requires interferometric detection of data, so that phase information is available. As the name of this technology indicates, ISAM has strong commonalities with Synthetic Aperture Radar (SAR). OCT can be viewed as analogous to standard radar.
PUBLICATIONS:
- T S Ralston, D L Marks, P S Carney, and S A Boppart, "Inverse scattering for optical coherence tomography," Journ. Opt. Soc. Am. A, 23, 1027-1037, (2006).
- D L Marks, T S Ralston,P S Carney, and Stephen A. Boppart, "Inverse scattering for rotationally-scanned optical coherence tomography," Journ. Opt. Soc. Am. A, 23, 2433-2439 (2006).
- T S Ralston, D L Marks, S A Boppart, and P S Carney, "Inverse scattering for high-resolution interferometric microscopy," Opt. Lett, 31, 3585-3587 (2006). T S Ralston, D L Marks, P S Carney and S A Boppart, "Interferometric synthetic aperture microscopy," Nature Physics 3, 129-134, (2007).
- B J Davis, S C Schlachter, D L Marks, T S Ralston, S A Boppart and P S Carney, "Non-paraxial vector-field modeling of optical coherence tomography and interferometric synthetic aperture microscopy," Journ. Opt. Soc. Am A. 24,2527-2542, (2007).
- B J Davis, D L Marks, T S Ralston, S A Boppart and P S Carney, "Autocorrelation artifacts in optical coherence tomography and interferometric synthetic aperture microscopy," Opt. Lett, 32, 1441-1443, (2007).
- D L Marks, T S Ralston, S A Boppart and P S Carney, "Inverse scattering for frequency-scanned full-field optical coherence tomography," Journ. Opt. Soc. Am A, 24, 1034-1041 (2007).
Computational adaptive optics
Aberration, which causes a deviation of an ideal wavefront, is an important issue affecting image quality in many imaging modalities. With increased NA for higher transverse resolution, the optical wavefront is more susceptible to being distorted by the imperfections of the imaging optics and the sample itself. As a result, the resolution may decrease, as well as the contrast and the signal-to-noise ratio. OCT/OCM also share this limitation are directly affected by aberrations in the system optics or the sample. Sophisticated optical designs can suppress the static system aberrations, but they are not versatile for complex biological tissues that introduce unique, often dynamically changing, sample aberrations. Hardware-based adaptive optics (HAO) physically sense and correct the aberrations for improving the signal strength and resolution. The systems, however, remain expensive and complex. In addition, the aberration compensation can only be valid for one isoplanatic patch during the imaging procedure, which extends the time of the imaging session for the application of large volumetric imaging. We have utilized the phase information of OCT/OCM to compensate the aberrations through post-processing.
Computational aberration correction of astigmatism in a silicone tissue phantom containing 1 μm titanium-dioxide particles. These images were generated from a single 3D dataset that was acquired with a highly astigmatic illumination beam. The OCT images show the two en face (x-y) planes with the best line foci, located 300 μm above and 300 μm below the plane of least confusion. The aberration-corrected OCT and aberration-corrected ISAM images show en face planes corresponding to the same depths as the OCT images. Dimensions of the 3D dataset are 256 × 256 × 1230 μm (x × y × z), where the units of the z axis denote optical path length.
PUBLICATIONS:
- Adie SG, Graf BW, Ahmad A, Carney PS, and Boppart SA, "Computational adaptive optics for broadband optical interferometric tomography of biological tissue," Proc. Natl. Acad. Sci. U. S. A. 109(19), 7175–7180, 2012.
- Liu YZ, Shemonski ND, Adie SG, Ahmad A, Bower AJ, Carney PS, and Boppart SA, "Computed optical interferometric tomography for high-speed volumetric cellular imaging," Biomed. Opt. Express 5(9), 2988–3000, 2014.
- South FA, Liu Y-Z, Xu Y, Shemonski ND, Carney PS, Boppart SA. Polarization-sensitive interferometric synthetic aperture microscopy. Applied Physics Letters, 107:211106, 2015. 2015.
- Shemonski ND, South FA, Liu Y-Z, Adie SG, Carney PS, Boppart SA. Computational high-resolution optical imaging of the living human retina. Nature Photonics, 9:440-443, 2015. 2015.
- Shemonski ND, South FA, Liu Y-Z, Adie SG, Carney PS, Boppart SA. Computational high-resolution optical imaging of the living human retina. Nature Photonics, 9:440-443, 2015. 2015.
- Shemonski ND, South FA, Liu Y-Z, Adie SG, Carney PS, Boppart SA. Computational high-resolution optical imaging of the living human retina. Nature Photonics, 9:440-443, 2015. 2015.
- Shemonski ND, South FA, Liu Y-Z, Adie SG, Carney PS, Boppart SA. Computational high-resolution optical imaging of the living human retina. Nature Photonics, 9:440-443, 2015. 2015.
Adaptive optics for ophthalmic imaging
High-resolution in vivo imaging is of great importance for the fields of biology and medicine. The introduction of hardware- based adaptive optics (HAO) has pushed the limits of optical imaging, enabling high-resolution near diffraction-limited imaging of previously unresolvable structures. In ophthalmology, when combined with optical coherence tomography, HAO has enabled a detailed three-dimensional visualization of photoreceptor distributions and individual nerve fibre bundles in the living human retina. However, the introduction of HAO hardware and supporting software adds considerable complexity and cost to an imaging system, limiting the number of researchers and medical professionals who could benefit from the technology. We have demonstrated a fully automated computational approach that enables high-resolution in vivo ophthalmic imaging without the need for HAO. Our results highlight that computational methods in coherent microscopy are applicable in highly dynamic living systems.
PUBLICATIONS:
- Shemonski ND, South FA, Liu Y-Z, Adie SG, Carney PS, Boppart SA. Computational high-resolution optical imaging of the living human retina. Nature Photonics, 9:440-443, 2015. 2015.
Wavefront sensing using computational adaptive optics
In many optical imaging applications, it is necessary to correct for aberrations to obtain high quality images. Optical coherence tomography (OCT) provides access to the amplitude and phase of the backscattered optical field for three-dimensional (3D) imaging samples. Computational adaptive optics (CAO) modifies the phase of the OCT data in the spatial frequency domain to correct optical aberrations without using a deformable mirror, as is commonly done in hardware-based adaptive optics (AO). This provides improvement of image quality throughout the 3D volume, enabling imaging across greater depth ranges and in highly aberrated samples. However, the CAO aberration correction has a complicated relation to the imaging pupil and is not a direct measurement of the pupil aberrations. Here we present new methods for recovering the wavefront aberrations directly from the OCT data without the use of hardware adaptive optics. This enables both computational measurement and correction of optical aberrations.
Measurement and correction of aberrations in an ex vivo mouse brain slice. (a) Corrected depth image when CAO is applied to the entire FOV. The inset shows the global wavefront. (b)–(d) OCT images from Subregion 1 corresponding to the green square in (a). (f)–(h) OCT images from Subregion 2 corresponding to the red square in (a). (b), (f) Uncorrected OCT images. (c), (g) Globally corrected images using the wavefront from (a). (d), (h) Locally corrected images. (e), (i) Local wavefront measurements used to obtain the images in (d) and (h), respectively. The image intensities are normalized to the peak amplitude of the uncorrected OCT subregions. The scale bar and subregion widths are 200 μm.
PUBLICATIONS:
- South FA, Liu Y-Z, Huang P-C, Kohlfarber T, Boppart SA. Local wavefront mapping in tissue using computational adaptive optics OCT. Optics Letters, 44:1186-1189. 2019.
- South FA, Liu Y-Z, Bower AJ, Xu Y, Carney PS, Boppart SA. Wavefront measurement using computational adaptive optics. Journal of the Optical Society of America A, 35:466-473. 2018.
- Iyer RR, Liu Y-Z, Boppart SA. Automated sensorless single-shot closed-loop adaptive optics microscopy with feedback from computational adaptive optics. Optics Express, 27(9):12998-13014. 2019.
- Zhu D, Wang R, Zurauskas M, Pande P, Bi J, Yuan Q, Wang L, Gao Z, Boppart SA. Automated fast computational adaptive optics for optical coherence tomography based on a stochastic parallel gradient descent algorithm. Optics Express, 28:23306-23319, 2020.
Combined hardware and computational adaptive optics
In many optical imaging applications, it is necessary to overcome aberrations to obtain high-resolution images. Aberration correction can be performed by either physically modifying the optical wavefront using hardware components, or by modifying the wavefront during image reconstruction using computational imaging. Here we address a longstanding issue in computational imaging: photons that are not collected cannot be corrected. This severely restricts the applications of computational wavefront correction. Additionally, performance limitations of hardware wavefront correction leave many aberrations uncorrected. We combine hardware and computational correction to address the shortcomings of each method. Coherent optical backscattering data is collected using high-speed optical coherence tomography, with aberrations corrected at the time of acquisition using a wavefront sensor and deformable mirror to maximize photon collection. Remaining aberrations are corrected by digitally modifying the coherently-measured wavefront during imaging reconstruction. This strategy obtains high-resolution images with improved signal-to-noise ratio of in vivo human photoreceptor cells with more complete correction of ocular aberrations, and increased flexibility to image at multiple retinal depths, field locations, and time points. While our approach is not restricted to retinal imaging, this application is one of the most challenging for computational imaging due to the large aberrations of the dilated pupil, time-varying aberrations, and unavoidable eye motion. In contrast with previous computational imaging work, we have imaged single photoreceptors and their waveguide modes in fully dilated eyes with a single acquisition. Combined hardware and computational wavefront correction improves the image sharpness of existing adaptive optics systems, and broadens the potential applications of computational imaging methods.
PUBLICATIONS:
- South FA, Kurokawa K, Liu Z, Liu Y-Z, Miller DT, Boppart SA. Combined hardware and computational optical wavefront correction. Biomedical Optics Express, 9:2562-2574. 2018.
Single-shot sensorless adaptive optics
Traditional wavefront-sensor-based adaptive optics (AO) techniques face numerous challenges that cause poor performance in scattering samples. Sensorless closed-loop AO techniques overcome these challenges by optimizing an image metric at different states of a deformable mirror (DM). This requires acquisition of a series of images continuously for optimization − an arduous task in dynamic in vivo samples. To correct these OAs induced by tissue scattering, a sensorless AO algorithm, called AutoAO, was adapted. The optimal wavefront is estimated by performing CAO on an initial volume to minimize an image metric, and then the pattern is translated to the DM. Unlike other commonly used sensorless AO algorithms that require a series of iterative images at different states of a deformable mirror (DM), AutoAO requires just one initial volume for optimization that was acquired within 1.25 s. Our technique overcomes the disadvantages of sensor-based AO, reduces the number of image acquisitions compared to traditional sensorless AO, and retains the advantages of both computational and hardware-based AO.
PUBLICATIONS:
- Iyer RR, Liu Y-Z, Boppart SA. Automated sensorless single-shot closed-loop adaptive optics microscopy with feedback from computational adaptive optics. Optics Express, 27(9):12998-13014. 2019.