Inverse sensing is an important research direction to provide new perspectives for optical sensing. For inverse sensing, the primary challenge is that scattered photon has a complicated profile, which is hard to derive a general solution. Instead of a general solution, it is more feasible and practical to derive a solution based on a specific environment. With deep learning, we develop a multifunctional inverse sensing approach for a specific environment. This inverse sensing approach can reconstruct the information of scattered photons and characterize multiple optical parameters simultaneously. Its functionality can be upgraded dynamically after learning more data. It has wide measurement range and can characterize the optical signals behind obstructions. The high anti-noise performance, flexible implementation, and extremely high threshold to optical damage or saturation make it useful for a wide range of applications, including self-driving car, space technology, data security, biological characterization, and integrated photonics.
Multifunctional inverse sensing by spatial distribution characterization of scattering photons
First published at:Sep 19, 2019
1. Born M, Wolf E. Principles of Optics; Electromagnetic Theory of Propagation, Interference, and Diffraction of Light 5th ed (Pergamon Press, Oxford, 1975).
2. Kerker M, Loebl E M. Physical chemistry: a series of mono-graphs. In The Scattering of Light and Other Electromagnetic Radiation (Elsevier Science, 1969).
3. Gariepy G, Tonolini F, Henderson R, Leach J, Faccio D. Detection and tracking of moving objects hidden from view. Nat Photonics 10, 23–26 (2016).
4. Liu H W, Huang Y G, Jiang H R. Artificial eye for scotopic vision with bioinspired all-optical photosensitivity enhancer. Proc Natl Acad Sci UAS 113, 3982–3985 (2016).
5. Endler J A. The color of light in forests and its implications. Ecol Monogr 63, 1–27 (1993).
6. Su J, Goldberg A F G, Stoltz B M. Label-free detection of single nanoparticles and biological molecules using microtoroid optical resonators. Light Sci Appl 5, e16001 (2016).
7. Rust M J, Bates M, Zhuang X W. Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM). Nat Methods 3, 793–796 (2006).
8. Wang Z B, Guo W, Li L, Luk'yanchuk B, Khan A et al. Optical virtual imaging at 50 nm lateral resolution with a white-light nanoscope. Nat Commun 2, 218 (2011).
9. Gao P, Yao N, Wang C T, Zhao Z Y, Luo Y F et al. Enhancing aspect profile of half-pitch 32 nm and 22 nm lithography with plasmonic cavity lens. Appl Phys Lett 106, 093110 (2015).
10. Allsop T, Arif R, Neal R, Kalli K, Kundrát V et al. Photonic gas sensors exploiting directly the optical properties of hybrid carbon nanotube localized surface plasmon structures. Light Sci Appl 5, e16036 (2016).
11. Aćimović S S, Šípová H, Emilsson G, Dahlin A B, Antosiewicz T J et al. Superior LSPR substrates based on electromagnetic decoupling for on-a-chip high-throughput label-free biosensing. Light Sci Appl 6, e17042 (2017).
12. Deng R R, Qin F, Chen R F, Huang W, Hong M H et al. Temporal full-colour tuning through non-steady-state upconversion. Nat Nanotechnol 10, 237–242 (2015).
13. Wei Z, Chen X D. Deep-learning schemes for full-wave nonlinear inverse scattering problems. IEEE Trans Geosci Remote Sens 57, 1849–1860 (2019).
14. Maze J R, Stanwix P L, Hodges J S, Hong S, Taylor J M et al. Nanoscale magnetic sensing with an individual electronic spin in diamond. Nature 455, 644–647 (2008).
15. Yang J, Luo F F, Kao T S, Li X, Ho G W et al. Design and fabrication of broadband ultralow reflectivity black Si surfaces by laser micro/nanoprocessing. Light: Sci Appl 3, e185 (2014).
16. Liao S K, Cai W Q, Liu W Y, Zhang L, Li Y et al. Satel-lite-to-ground quantum key distribution. Nature 549, 43–47 (2017).
17. Wei Z, Chen R, Chen X D. Nonlinear reconstruction of multilayer media in scanning microwave microscopy. IEEE Trans Instrum Meas 68, 197–205 (2019).
18. Yin T T, Wei Z, Chen X D. Wavelet transform subspace-based optimization method for inverse scattering. IEEE J Multiscale Multiphys Comput Tech 3, 176–184 (2018).
19. Taflove A, Hagness S C. Computational Electrodynamics: The Finite-difference Time-domain Method 3rd ed (Artech House, Boston, 2005).
20. Popoff S M, Lerosey G, Fink M, Boccara A C, Gigan S. Controlling light through optical disordered media: transmission matrix approach. New J Phys 13, 123021 (2011).
21. Dickinson E J F, Ekström H, Fontes E. COMSOL multiphysics®: finite element software for electrochemical analysis. A mini-review. Electrochem Commun 40, 71–74 (2014).
22. Hou G Z, Lyu L J. Design of ultra wide-angle photographic objective based on ZEMAX. J Appl Opt 37, 441–445 (2016).
23. Mnih V, Kavukcuoglu K, Silver D, Rusu A A, Veness J et al. Human-level control through deep reinforcement learning. Nature 518, 529–533 (2015).
24. Hezaveh Y D, Levasseur L P, Marshall P J. Fast automated analysis of strong gravitational lenses with convolutional neural networks. Nature 548, 555–557 (2017).
25. Shen Y, Harris N C, Skirlo S, Prabhu M, Baehr-Jones T et al. Deep learning with coherent nanophotonic circuits. Nat Photonics 11, 441–446 (2017).
26. Schmidhuber J. Deep learning in neural networks: an overview. Neural Networks 61, 85–117 (2015).
27. Hazlett H C, Gu H B, Munsell B C, Kim S H, Styner M et al. Early brain development in infants at high risk for autism spectrum disorder. Nature 542, 348–351 (2017).
28. Goodfellow I, Bengio Y, Courville A. Deep Learning (MIT Press, Cambridge, 2016).
29. He X N, Chua T S. Neural factorization machines for sparse predictive analytics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in In-formation Retrieval 355–364 (ACM, 2017); http://doi.org/10.1145/3077136.3080777
30. Zhao N, Zhang H W, Hong R C, Wang M, Chua T S. VideoWhisper: toward discriminative unsupervised video feature learning with attention-based recurrent neural networks. IEEE Trans Multimed 19, 2080–2092 (2017).
31. Fu J, Luo H Y, Feng J S, Low K H, Chua T S. DrMAD: distilling reverse-mode automatic differentiation for optimizing hyperparameters of deep neural networks. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence 1469–1475 (IJCAI, 2016).
32. Jo Y, Park S, Jung J, Yoon J, Joo H et al. Holographic deep learning for rapid optical screening of anthrax spores. Sci Adv 3, e1700606 (2017).
33. Velten A, Willwacher T, Gupta O, Veeraraghavan A, Bawendi M G et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat Commun 3, 745 (2012).
34. Humar M, Yun S H. Intracellular microlasers. Nat Photonics 9, 572–576 (2015).
35. Huang B, Wang W Q, Bates M, Zhuang X W. Three-dimensional super-resolution imaging by stochastic optical reconstruction microscopy. Science 319, 810–813 (2008).
36. Du Z R, Chen L W, Kao T S, Wu M X, Hong M H. Improved optical limiting performance of laser-ablation-generated metal nanoparticles due to silica-microsphere-induced local field en-hancement. Beilstein J Nanotechnol 6, 1199–1204 (2015).
37. Yin J, Cao Y, Li Y H, Liao S K, Zhang L et al. Satellite-based entanglement distribution over 1200 kilometers. Science 356, 1140–1144 (2017).
38. Memon Q, Ahmed M, Ali S, Memon A R, Shah W. Self-driving and driver relaxing vehicle. In Proceedings of 2016 2nd International Conference on Robotics and Artificial Intelligence, 170–174 (IEEE, 2016);
39. Bates M, Huang B, Dempsey G T, Zhuang X. Multicolor su-per-resolution imaging with photo-switchable fluorescent probes. Science 317, 1749–1753 (2007).
40. Paniccia M. Integrating silicon photonics. Nat Photonics 4, 498–499 (2010).
41. Sun C, Wade M T, Lee Y, Orcutt J S, Alloatti L et al. Single-chip microprocessor that communicates directly using light. Nature 528, 534–538 (2015).
42. Luther-Davies B. Integrated optics: flexible chalcogenide photonics. Nat Photonics 8, 591–593 (2014).
Get Citation: Chen L W, Yin Y M, Li Y, Hong M H. Multifunctional inverse sensing by spatial distribution characterization of scattering photons. Opto-Electron Adv 2, 190019 (2019).