arXiv ScienceSearch

arXiv subjects

Alex Turpin

Publications and source records attributed to Alex Turpin.

13 recordsLinked to original sources

High-speed object detection with a single-photon time-of-flight image sensor

3D time-of-flight (ToF) imaging is used in a variety of applications such as augmented reality (AR), computer interfaces, robotics and autonomous systems. Single-photon avalanche diodes (SPADs) are one of the enabling technologies providing accurate depth data even over long ranges. By developing SPADs in array format with integrated processing combined with pulsed, flood-type illumination, high-speed 3D capture is possible. However, array sizes tend to be relatively small, limiting the lateral resolution of the resulting depth maps, and, consequently, the information that can be extracted from the image for applications such as object detection. In this paper, we demonstrate that these limitations can be overcome through the use of convolutional neural networks (CNNs) for high-performance object detection. We present outdoor results from a portable SPAD camera system that outputs 16-bin photon timing histograms with 64x32 spatial resolution. The results, obtained with exposure times down to 2 ms (equivalent to 500 FPS) and in signal-to-background (SBR) ratios as low as 0.05, point to the advantages of providing the CNN with full histogram data rather than point clouds alone. Alternatively, a combination of point cloud and active intensity data may be used as input, for a similar level of performance. In either case, the GPU-accelerated processing time is less than 1 ms per frame, leading to an overall latency (image acquisition plus processing) in the millisecond range, making the results relevant for safety-critical computer vision applications which would benefit from faster than human reaction times.

eess.IV

A pulse oximeter based on Time-of-Flight histograms

A pulse oximeter is an optical device that monitors tissue oxygenation levels. Traditionally, these devices estimate the oxygenation level by measuring the intensity of the transmitted light through the tissue and are embedded into everyday devices such as smartphones and smartwatches. However, these sensors require prior information and are susceptible to unwanted changes in the intensity, including ambient light, skin tone, and motion artefacts. Previous experiments have shown the potential of Time-of-Flight (ToF) techniques in measurements of tissue hemodynamics. Our proposed technology uses histograms of photon flight paths within the tissue to obtain tissue oxygenation, regardless of the changes in the intensity of the source. Our device is based on a 45ps time-to-digital converter (TDC) which is implemented in a Xilinx Zynq UltraScale+ field programmable gate array (FPGA), a CMOS Single Photon Avalanche Diode (SPAD) detector, and a low-cost compact laser source. All these components including the SPAD detector are manufactured using the latest commercially available technology, which leads to increased linearity, accuracy, and stability for ToF measurements. This proof-of-concept system is approximately 10cmx8cmx5cm in size, with a high potential for shrinkage through further system development and component integration. We demonstrate preliminary results of ToF pulse measurements and report the engineering details, trade-offs, and challenges of this design. We discuss the potential for mass adoption of ToF based pulse oximeters in everyday devices such as smartphones and wearables.

physics.med-ph

3D imaging from multipath temporal echoes

Echo-location is a broad approach to imaging and sensing that includes both man-made RADAR, LIDAR, SONAR and also animal navigation. However, full 3D information based on echo-location requires some form of scanning of the scene in order to provide the spatial location of the echo origin-points. Without this spatial information, imaging objects in 3D is a very challenging task as the inverse retrieval problem is strongly ill-posed. Here, we show that the temporal information encoded in the return echoes that are reflected multiple times within a scene is sufficient to faithfully render an image in 3D. Numerical modelling and an information theoretic perspective prove the concept and provide insight into the role of the multipath information. We experimentally demonstrate the concept by using both radio-frequency and acoustic waves for imaging individuals moving in a closed environment.

eess.IV

Statistical Dependencies Beyond Linear Correlations in Light Scattered by Disordered Media

Imaging through scattering and random media is an outstanding problem that to date has been tackled by either measuring the medium transmission matrix or exploiting linear correlations in the transmitted speckle patterns. However, transmission matrix techniques require interferometric stability and linear correlations, such as the memory effect, can be exploited only in thin scattering media. Here we show the existence of a statistical dependency in strongly scattered optical fields in a case where first-order correlations are not expected. We also show that this statistical dependence and the related information transport is directly linked to artificial neural network imaging in strongly scattering, dynamic media. These non-trivial dependencies provide a key to imaging through dynamic and thick scattering media with applications for deep-tissue imaging or imaging through smoke or fog

physics.optics

Spatial images from temporal data

Traditional paradigms for imaging rely on the use of a spatial structure, either in the detector (pixels arrays) or in the illumination (patterned light). Removal of the spatial structure in the detector or illumination, i.e., imaging with just a single-point sensor, would require solving a very strongly ill-posed inverse retrieval problem that to date has not been solved. Here, we demonstrate a data-driven approach in which full 3D information is obtained with just a single-point, single-photon avalanche diode that records the arrival time of photons reflected from a scene that is illuminated with short pulses of light. Imaging with single-point time-of-flight (temporal) data opens new routes in terms of speed, size, and functionality. As an example, we show how the training based on an optical time-of-flight camera enables a compact radio-frequency impulse radio detection and ranging transceiver to provide 3D images.

eess.IV

Variational Inference for Computational Imaging Inverse Problems

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be trained, which in imaging applications implicates prohibitively expensive collections with specific imaging instruments. This paper introduces a novel framework to train variational inference for inverse problems exploiting in combination few experimentally collected data, domain expertise and existing image data sets. In such a way, Bayesian machine learning models can solve imaging inverse problems with minimal data collection efforts. Extensive simulated experiments show the advantages of the proposed framework. The approach is then applied to two real experimental optics settings: holographic image reconstruction and imaging through highly scattering media. In both settings, state of the art reconstructions are achieved with little collection of training data.

cs.LG

Light scattering control in transmission and reflection with neural networks

Scattering often limits the controlled delivery of light in applications such as biomedical imaging, optogenetics, optical trapping, and fiber-optic communication or imaging. Such scattering can be controlled by appropriately shaping the light wavefront entering the material. Here, we demonstrate a machine-learning approach for light control. Using pairs of binary intensity patterns and intensity measurements we train neural networks (NNs) to provide the wavefront corrections necessary to shape the beam after the scatterer. Additionally, we demonstrate that NNs can be used to find a functional relationship between transmitted and reflected speckle patterns. As a proof of the validity of this relationship, we demonstrate focusing and scanning of light in transmission through opaque media using reflected light. Our approach demonstrates the versatility of NNs for light shaping and for efficiently and flexibly correcting for scattering. In particular, the feasibility of transmission control based on reflected light opens up new opportunities for applications in optical imaging, sensing, and light delivery.

physics.optics

Conical refraction healing after partially blocking the input beam

In conical refraction, when a focused Gaussian beam passes along one of the optic axes of a biaxial crystal it is transformed into a pair of concentric bright rings at the focal plane. We demonstrate both theoretically and experimentally that this transformation is hardly affected by partially blocking the Gaussian input beam with an obstacle. We analyze the influence of the size of the obstruction both on the transverse intensity pattern of the beam and on its state of polarization, which is shown to be very robust.

physics.optics

Transformation of vector beams with radial and azimuthal polarizations in biaxial crystals

We present both experimentally and theoretically the transformation of radially and azimuthally polarized vector beams when they propagate through a biaxial crystal and are transformed by the conical refraction phenomenon. We show that, at the focal plane, the transverse pattern is formed by a ring-like light structure with an azimuthal node, being this node found at diametrically opposite points of the ring for radial/azimuthal polarizations. We also prove that the state of polarization of the transformed beams is conical refraction-like, i.e. that every two diametrically opposite points of the light ring are linearly orthogonally polarized.

physics.optics

On the dual-cone nature of the conical refraction phenomenon

In conical refraction (CR), a focused Gaussian input beam passing through a biaxial crystal and parallel to one of the optic axes is transformed into a pair of concentric bright rings split by a dark (Poggendorff) ring at the focal plane. Here, we show the generation of a CR transverse pattern that does not present the Poggendorff fine splitting at the focal plane, i.e. it forms a single light ring. This light ring is generated from a non-homogeneously polarized input light beam obtained by using a spatially inhomogeneous polarizer that mimics the characteristic CR polarization distribution. This polarizer allows modulating the relative intensity between the two CR light cones in accordance with the recently proposed dual--cone model of the CR phenomenon. We show that the absence of interfering rings at the focal plane is caused by the selection of one of the two CR cones.

physics.optics

Light propagation in biaxial crystals

We present a formalism able to predict the transformation of light beams passing through biaxial crystals. We use this formalism to show both theoretically and experimentally the transition from double refraction to conical refraction, which is found when light propagates along one of the optic axes of a biaxial crystal. Additionally, we demonstrate that the theory is applicable both to non-cylindrically symmetric and non-homogeneously polarized beams by predicting the transformation of input beams passing through a cascade of biaxial crystals.

physics.optics

Type I and type II second harmonic generation of conically refracted beams

Type I and type II second harmonic generation (SHG) of a beam transformed by the conical refraction phenomenon are presented. We show that, for type I, the second harmonic intensity pattern is a light ring with a point of null intensity while, for type II, the light ring possesses two dark regions. Taking into account the different two-photon processes involved in SHG, we have derived analytical expressions for the resulting transverse intensity patterns that are in good agreement with the experimental data. Finally, we have investigated the spatial evolution of the second harmonic signals, showing that they behave as conically refracted beams.

physics.optics

Free Space Optical Polarization De-multiplexing and Multiplexing by means of Conical Refraction

Polarization de-multiplexing and multiplexing by means of conical refraction is proposed to increase the channel capacity for free space optical communication applications. The proposed technique is based on the forward-backward optical transform occurring when a light beam propagates consecutively along the optic axes of two identical biaxial crystals with opposite orientations of their conical refraction characteristic vectors. We present experimental proof of usefulness of the conical refraction de-multiplexing and multiplexing technique by increasing in one order of magnitude the channel capacity at optical frequencies in a propagation distance of 4m.

physics.optics