E-mail Alert
RSS
| Citation: |
Abraham E, Liu ZW. Design, setup, and facilitation of the speckle structured illumination endoscopic system. Opto-Electron Sci 4, 240022 (2025). doi: 10.29026/oes.2025.240022
|
Design, setup, and facilitation of the speckle structured illumination endoscopic system
-
Abstract
Structured illumination, a wide-field imaging approach used in microscopy to enhance image resolution beyond the system's diffraction limits, is a well-studied technique that has gained significant traction over the last two decades. However, when translated to endoscopic systems, severe deformations of illumination patterns occur due to the large depth of field (DOF) and the 3D nature of the targets, introducing significant implementation challenges. Hence, this study explores a speckle-based system that best suits endoscopic practices to enhance image resolution by using random illumination patterns. The study presents a prototypic model of an endoscopic add-on, its design, and fabrication facilitated by using the speckle structured illumination endoscopic (SSIE) system. The imaging results of the SSIE are explained on a colon phantom model at different imaging planes with a wide field of view (FOV) and DOF. The obtained imaging metrics are elucidated and compared with state-of-the-art (SOA) high-resolution endoscopic techniques. Moreover, the potential for a clinical translation of the prototypic SSIE model is also explored in this work. The incorporation of the add-on and its subsequent results on the colon phantom model could potentially pave the way for its successful integration and use in futuristic clinical endoscopic trials.-
Keywords:
- Speckle imaging /
- endoscopic add-on /
- colon phantom /
- clinical translation
-
-
References
[1] Meng HY. Chapter 8 - Oncology—Acquired. In Meng HY. Self-Assessment Questions for Clinical Molecular Genetics 431–508 (Elsevier, Amsterdam, 2019). [2] Seeff LC, Richards TB, Shapiro JA et al. How many endoscopies are performed for colorectal cancer screening? Results from CDC’s survey of endoscopic capacity. Gastroenterology 127, 1670–1677 (2004). doi: 10.1053/j.gastro.2004.09.051 [3] Sonnenberg A, Amorosi SL, Lacey MJ et al. Patterns of endoscopy in the United States: analysis of data from the centers for Medicare and Medicaid services and the national endoscopic database. Gastrointest Endosc 67, 489–496 (2008). doi: 10.1016/j.gie.2007.08.041 [4] Ruhl CE, Everhart JE. Indications and outcomes of gastrointestinal endoscopy. Accessed 24 January 2023. https://www.niddk.nih.gov/about-niddk/strategic-plans-reports/burden-of-digestive-diseases-in-united-states/indications-outcomes-gastrointestinal-endoscopy/. [5] Global gastrointestinal endoscopy market analysis and forecast, 2019–2028. Accessed 24 January 2023. https://www.marketstudyreport.com/reports/global-gastrointestinal-endoscopy-market-analysis-and-forecast-2019-2028. [6] Spaner SJ, Warnock GL. A brief history of endoscopy, laparoscopy, and laparoscopic surgery. J Laparoendosc Adv Surg Tech A 7, 69–73 (1997). doi: 10.1089/lap.1997.7.69 [7] Olympus endoscopes. Accessed 24 January 2023. https://www.olympus-global.com/technology/museum/endo/?page=technology_museum. [8] Image Quality Metrics. Oncology medical physics. Accessed 24 January 2023. https://oncologymedicalphysics.com/image-quality-metrics/. [9] Vleggaar FP, Siersema PD. Barrett's esophagus, reflux esophagitis, and eosinophilic esophagitis. Gastrointest Endosc 76, 496–500 (2012). doi: 10.1016/j.gie.2012.07.004 [10] Zachariah R, Rombaoa C, Samarasena J et al. The potential of deep learning for gastrointestinal endoscopy—a disruptive new technology. In Xing L, Giger ML, Min JK. Artificial Intelligence in Medicine 223–245 (Elsevier, Amsterdam, 2021). [11] Shukla R, Abidi WM, Richards-Kortum R et al. Endoscopic imaging: how far are we from real-time histology. World J Gastrointest Endosc 3, 183–194 (2011). [12] Hur C, Yachimski PS. Screening for esophageal squamous cell carcinoma. In Chandrasekhara V, Elmunzer BJ, Khashab MA et al. Clinical Gastrointestinal Endoscopy 3rd ed 291–301. e2 (Elsevier, Amsterdam, 2019). [13] Kwon RS, Adler DG, Chand B et al. High-resolution and high-magnification endoscopes. Gastrointest Endosc 69, 399–407 (2009). doi: 10.1016/j.gie.2008.12.049 [14] Reddymasu SC, Sharma P. Advances in endoscopic imaging of the esophagus. Gastroenterol Clin North Am 37, 763–774 (2008). doi: 10.1016/j.gtc.2008.09.011 [15] ASGE Technology Committee. Confocal laser endomicroscopy. Gastrointest Endosc 80, 928–938 (2014). doi: 10.1016/j.gie.2014.06.021 [16] Nelson DB, Block KP, Bosco JJ et al. High resolution and high-magnification endoscopy: September 2000. Gastrointest Endosc 52, 864–866 (2000). doi: 10.1016/S0016-5107(00)70225-2 [17] Eberl T, Jechart G, Probst A et al. Can an endocytoscope system (ECS) predict histology in neoplastic lesions. Endoscopy 39, 497–501 (2007). doi: 10.1055/s-2007-966446 [18] Inoue H, Kazawa T, Sato Y et al. In vivo observation of living cancer cells in the esophagus, stomach, and colon using catheter-type contact endoscope, "endo-cytoscopy system". Gastrointest Endosc Clin N Am 14 , 589–594 (2004). [19] Das A, Sivak MV, Chak A et al. High-resolution endoscopic imaging of the GI tract: a comparative study of optical coherence tomography versus high-frequency catheter probe EUS. Gastrointest Endosc 54, 219–224 (2001). doi: 10.1067/mge.2001.116109 [20] Bhushan S, Richards-Kortum R, Anandasabapathy S. Progress and challenges of global high-resolution endoscopy. Int Arch Intern Med 4, 024 (2020). [21] Abraham E, Zhou JX, Liu ZW. Speckle structured illumination endoscopy with enhanced resolution at wide field of view and depth of field. Opto-Electron Adv 6, 220163 (2023). doi: 10.29026/oea.2023.220163 [22] Mudry E, Belkebir K, Girard J et al. Structured illumination microscopy using unknown speckle patterns. Nat Photonics 6, 312–315 (2012). doi: 10.1038/nphoton.2012.83 [23] Yeh LH, Chowdhury S, Waller L. Computational structured illumination for high-content fluorescence and phase microscopy. Biomed Opt Express 10, 1978–1998 (2019). doi: 10.1364/BOE.10.001978 [24] Ponsetto JL, Wei FF, Liu ZW. Localized plasmon assisted structured illumination microscopy for wide-field high-speed dispersion-independent super resolution imaging. Nanoscale 6, 5807–5812 (2014). doi: 10.1039/C4NR00443D [25] Dan D, Lei M, Yao BL et al. DMD-based LED-illumination super-resolution and optical sectioning microscopy. Sci Rep 3, 1116 (2013). doi: 10.1038/srep01116 [26] Qian J, Lei M, Dan D et al. Full-color structured illumination optical sectioning microscopy. Sci Rep 5, 14513 (2015). doi: 10.1038/srep14513 [27] Pagac M, Hajnys J, Ma QP et al. A review of vat photopolymerization technology: materials, applications, challenges, and future trends of 3D printing. Polymers 13, 598 (2021). doi: 10.3390/polym13040598 [28] Guttridge C, Shannon A, O'Sullivan A et al. Biocompatible 3D printing resins for medical applications: a review of marketed intended use, biocompatibility certification, and post-processing guidance. Ann 3D Print Med 5, 100044 (2022). doi: 10.1016/j.stlm.2021.100044 [29] Raymond J. Which TPU is for you? Accessed 24 January 2023. https://www.bixbyintl.com/blog/which-tpu-is-for-you/. [30] Polyurethane film for medical industry. Accessed 24 January 2023. https://www.americanpolyfilm.com/medical-grade-tpu-film/. [31] PSI. Polyolefins are Everywhere. Accessed 24 January 2023. https://www.polymersolutions.com/blog/top-types-of-polyolefins-the-most-common-kind-of-plastics/. [32] Gumargalieva KZ, Zaikov GE, Polishchuk AY et al. Biocompatibility and biodegradation of polyolefins. Int Polym Sci Technol 29, 60–72 (2002). [33] Burkhardt F, Schirmeister CG, Wesemann C et al. Pandemic-driven development of a medical-grade, economic and decentralized applicable polyolefin filament for additive fused filament fabrication. Molecules 25, 5929 (2020). doi: 10.3390/molecules25245929 [34] Hochberger J, Meves V, Ginsberg GG. Difficult cannulation and sphincterotomy. In Chandrasekhara V, Elmunzer BJ, Khashab MA et al. Clinical Gastrointestinal Endoscopy 3rd ed 563–570. e2 (Elsevier, Amsterdam, 2019). [35] Lee YU, Zhao JX, Ma Q et al. Metamaterial assisted illumination nanoscopy via random super-resolution speckles. Nat Commun 12, 1559 (2021). doi: 10.1038/s41467-021-21835-8 [36] Lee YU, Posner C, Niev ZY et al. Organic hyperbolic material assisted illumination nanoscopy (Adv. Sci. 22/2021). Adv Sci 8, 2170149 (2021). doi: 10.1002/advs.202170149 [37] Rex DK, Repici A, Gross SA et al. High-definition colonoscopy versus Endocuff versus EndoRings versus full-spectrum endoscopy for adenoma detection at colonoscopy: a multicenter randomized trial. Gastrointest Endosc 88, 335–344.e2 (2018). doi: 10.1016/j.gie.2018.02.043 [38] Schouw HM, Huisman LA, Janssen YF et al. Targeted optical fluorescence imaging: a meta-narrative review and future perspectives. Eur J Nucl Med Mol Imaging 48, 4272–4292 (2021). doi: 10.1007/s00259-021-05504-y [39] Chien FC. Simulation approach to optimize fluorescence imaging performance of wide-field temporal-focusing microscopy with tunable wavelength excitation. Proc SPIE 11076, 110761Q (2019). [40] Kiepas A, Voorand E, Mubaid F et al. Optimizing live-cell fluorescence imaging conditions to minimize phototoxicity. J Cell Sci 133, jcs242834 (2020). doi: 10.1242/jcs.242834 [41] Liao JH, Zhang CS, Xu XC et al. Deep-MSIM: fast image reconstruction with deep learning in multifocal structured illumination microscopy. Adv Sci 10, 2300947 (2023). doi: 10.1002/advs.202300947 [42] Jin LH, Liu B, Zhao FQ et al. Deep learning enables structured illumination microscopy with low light levels and enhanced speed. Nat Commun 11, 1934 (2020). doi: 10.1038/s41467-020-15784-x [43] Shah ZH, Müller M, Wang TC et al. Deep learning based denoising and reconstruction of super-resolution structured illumination microscopy images. Photonics Res 9, B168–B181 (2021). doi: 10.1364/PRJ.416437 [44] Ling C, Zhang CL, Wang MQ et al. Fast structured illumination microscopy via deep learning. Photonics Res 8, 1350–1359 (2020). doi: 10.1364/PRJ.396122 -
Supplementary Information
Supplementary information for Design, setup, and facilitation of the speckle structured illumination endoscopic system
-
Access History
Figures(6)
Tables(4)
Article Metrics
Export File
Citation
Abraham E, Liu ZW. Design, setup, and facilitation of the speckle structured illumination endoscopic system. Opto-Electron Sci 4, 240022 (2025). doi: 10.29026/oes.2025.240022
Format
Content
DownLoad:
-
Figure 1.
Schematic of the SSIE system. (a) Bench top components , Block 1: laser source of 532 nm, Block 2 (optical components): optical mirrors, Block 3: MM fiber, Block 4: fiber/free space beam splitter, Block 5 (optical components): collimators, optical mirrors and MM fiber, Block 6: step motor, processor, and motor controls. (b) Endoscope add-on (right to left), Block 7: endoscopic add-on, Block 8: target (colon phantom model).
-
Figure 2.
Experimental SSIE benchtop setup. (a) Fiber based setup. (b) Free space setup. The arrow denotes the pathway and direction of the laser beams traversal. (c) Step motor programmed to aid in the MM fiber modulation.
-
Figure 3.
Design and fabrication of the add-on sleeve. (a) 3D CAD (computer aided design) representation of the add-on sleeve with two fiber holding slits on either ends. (b) 2D model of the sleeve ,cross section of (a) along cutting plane 1, ID and OD are the internal and outer diameters, L is the length of the sleeve, T represents the tilt length and Ɵ represents the tilt angle. The cross sections are identical across cutting planes 1 and 2. (c) Photograph of the 3D printed sleeve. (d, e) Schematic of the cross-sectional front end of the endoscope probe without and with the external cover (heat shrink tape) (yellow color slits on either ends represent the fiber slits), respectively. (f) Schematic of the side view of the endoscopic probe with different layers. The inserted portion refers to the section potentially put into the human body/region of examination and the external portion refers to the rest of the endoscopic probe which is connected to the laser setup of the SSIE (Fig.1(a, b)). (g) Photograph of an example Olympus CV-160 endoscopic probe with the sleeve (grey color) which is placed inside an external cover made of heat shrink tape (black) along with the TPU film. (h) Control knobs of the endoscopic probe. (i) Picture to depict the bending length of the endoscopic probe with the add-on sleeve (grey color) attached to the endoscope tip (rigid portion: head). (j) Magnified image of the MM fiber wound around the endoscope insertion tube.
-
Figure 4.
Phantom construction and feature deposition. (a) Schematic of feature deposition by drop casting fluorescence dye on sample. (b) Schematic of feature blood vessel drawing on silicone pads. (c) Schematic of the cross-sectional view of the colon model with bumps to simulate a realistic colon. (d) Photograph of the internal cross-sectional view of the colon phantom tunnel simulated with bumps where features drop cast and drawn. (e) Photograph of the external frame of the colon phantom.
-
Figure 5.
Fluorescence imaging results with SSIE on colon phantom. (a, b) Diffraction limited and enhanced SSIE image at imaging distance 2.7 cm. Scale bar: 200 μm. (c) Ground truth microscopic image of boxed region in (a). (d, e) Fourier spectra of (a) and (b). (f, g, j, k) Diffraction limited and enhanced SSIE image at imaging distance 5.7 cm. Scale bar: 2100 μm (large FOV: f, g), Scale bar: 800 μm (medium FOV: j, k). (h, i, l, m) Fourier spectra of (f, g, j, k). (n, o) Diffraction limited and enhanced SSIE image at imaging distance 7.2 cm. Scale bar: 500 μm. (p, q) Fourier spectra of (n) and (o). (r, s) Diffraction limited and enhanced SSIE image at imaging distance 10 cm. Scale bar: 400 μm. (t, u) Fourier transforms of (r) and (s).
-
Figure 6.
Sampling parameter vs enhancement. (a) Diffraction limited image. (b–h) Number of frames taken for SSIE processing: 20, 40, 60, 80, 100, 120, 150. Imaging distance: 5.7 cm, Scale bar: 200 μm. (j) Diffraction limited image. (k–r) Number of frames taken for SSIE processing: 20, 30, 50, 70, 90, 100, 110, 117, 150. Imaging distance: 4.7 cm, Scale bar: 600 μm. (i) Enhancement plot of (b–h). (s) Enhancement plot of (k–r).
