arXiv subjects

Laura Waller

Publications and source records attributed to Laura Waller.

At least 19 recordsLinked to original sources

arXiv2026

Sparse Light Field Sampling Improves Casual 3D and 4D Reconstruction

Many consumer smartphones, stereo cameras, and light field cameras record multiple synchronized viewpoints in a single exposure event. However, novel view synthesis pipelines commonly use only a monocular stream and rely on camera motion or learned priors to obtain angular coverage. In this paper, we ask: why do we use only one viewpoint? We analyze sensor-limited multi-view, where one sensor trades off spatial and angular resolution, and exposure-limited multi-view, where multiple sensors on one commodity device observe each event simultaneously. We introduce a new dataset incorporating three types of commodity multi-view cameras, and evaluate sparse-view 3DGS and 4DGS baselines measuring reconstruction quality as a function of number of exposures and angle between extreme views. Our results demonstrate that using multiple cameras, even with a low baseline, significantly improves reconstruction quality in single-shot, few-shot, and casual video settings. In addition, under a fixed sensor budget, angular sampling improves reconstruction when exposures are scarce despite lower spatial resolution. The gains are most pronounced for single-shot and dynamic scenes, where a stationary monocular camera lacks the angular diversity to recover scene geometry and motion.

eess.IV↗

arXiv2026

Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problems

Neural network surrogates are an emerging alternative to traditional electromagnetic wave simulators like finite-difference time-domain (FDTD); their goal is to replace rigorous physical simulations with pre-trained neural networks that solve wave-scattering forward and inverse problems orders of magnitude faster. However, nonrecurrent, single-step surrogates have scaled only to a few tens of simulation variables. Here, we show that this barrier can be overcome by dynamically generating salient training examples during training, rather than randomly sampling the large space of possible examples. We introduce an algorithm that runs in parallel with surrogate training, using gradient ascent to search refractive-index and source configurations for cases where the surrogate disagrees with a full-wave ground-truth simulator. We also use source and ground-truth normalization with an evolving replay dataset to stabilize and accelerate learning. Using this approach, we train a fast, single-step surrogate for two-dimensional wave scattering with up to 41,772 controllable variables, including dense, freely configurable grids of refractive indices and complex-valued sources. The resulting neural surrogate is robustly accurate across diverse structured and unstructured examples and generalizes inductively to larger domains, reaching over 3 million controllable variables without retraining, a $73.8\times$ increase. We demonstrate the surrogate on large-scale forward simulations and inverse design of freeform beam splitters and gradient-index (GRIN) lenses up to 98 wavelengths wide, showing comparable or better performance than FDTD-based designs, with speedups from $1.29\times$ to $26.5\times$. These results demonstrate a practical path toward fast, robustly accurate, inductively scalable neural simulators for photonic inverse design and other wave-scattering inverse problems.

physics.optics↗

arXiv2026

Spectral DiffuserScope: a compact snapshot hyperspectral microscope

Hyperspectral fluorescence microscopy enables important biological and clinical applications, but conventional systems are bulky or require scanning, limiting temporal resolution and throughput. We introduce a computational snapshot hyperspectral microscope that uses compressed sensing to achieve higher spatial-spectral resolution than traditional snapshot systems. Our device is compact (~15 cm x 6 cm x 6 cm) and easily attaches to standard fluorescence microscopes. We benchmark our system against existing snapshot methods through simulations to evaluate its spatial and spectral performance. Experimental imaging of fluorescent beads, labeled cells, and lanthanide hydrogel beads demonstrates a practical, high-throughput solution for hyperspectral microscopy in biological and clinical applications.

physics.optics↗

arXiv2026

Hist2Style: Histogram-Guided Stylization with Bilateral Grids

Photorealistic style transfer aims to match the color and tone of an input image to that of a style target while preserving the content and details of the original scene. Although existing large image models can facilitate these kinds of appearance edits, their high computational demands, potential for hallucinations, and limited user control make them unsuitable for high-resolution, real-time workflows. We introduce Hist2Style, a bilateral-grid formulation for fast, edge-aware stylization that preserves visual fidelity by constraining operations to locally affine transforms in bilateral space. Our model distills a large image editing model into a lightweight network by training on a large supervised corpus generated with language and vision-language models, targeting spatially varying color edits. The network conditions on a histogram-based embedding of the style target to provide an interpretable interface for adjusting the output style by modifying the target color distribution. Overall, Hist2Style maintains content structure by construction, avoids hallucinations, and supports real-time, high-resolution photorealistic stylization with interactive user-controllable color and tone adjustments.

cs.CV↗

arXiv2026

A visual introduction to information theory

Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the presence of noise. Here, we present a visual, intuition-driven guide to key concepts in information theory. We show how entropy, mutual information, and channel capacity follow from basic probability, and how they determine the shortest possible encoding of a data source and the maximum rate of reliable communication through a noisy channel. Our presentation assumes only a familiarity with basic probability theory.

cs.IT↗

arXiv2026

Depth-multiplexing spectral domain OCT for full eye length imaging with a single modulation unit

Clinical measurement of a patient's axial eye length is emerging as a crucial approach to track progression and monitor management of myopia. However, the preferred method for such measurements is swept-source OCT, whose cost prohibits broad use, especially in lower-income communities. Spectral domain (SD) OCT is a more affordable option, but it has limited imaging depth range, so is not suitable for full eye length measurement. Depth-multiplexing (DM) techniques for SD-OCT provide a workaround by capturing images at multiple depths within the eye. However, these methods typically require multiple light modulation units or detectors for simultaneous imaging across depths, adding complexity and cost. In response, we propose a novel DM-SD-OCT approach that utilizes a single light modulation unit for depth encoding. We capture images at multiple depths within the eye simultaneously with a single line scan camera, then computationally demix the contributions from different depths. Here, we demonstrate acquisition and demixing of signals from three distinct depths within the eye and validate experimentally in human subjects. Our method thus offers a cost-effective solution for comprehensive eye length measurement in clinical myopia research.

physics.optics↗

arXiv2026

Designing lensless imaging systems to maximize information capture

Mask-based lensless imaging uses an optical encoder (e.g. a phase or amplitude mask) to capture measurements, then a computational decoding algorithm to reconstruct images. In this work, we evaluate and design lensless encoders based on the information content of their measurements using mutual information estimation. Our approach formalizes the object-dependent nature of lensless imaging and quantifies the interdependence between object sparsity, encoder multiplexing, and noise. Our analysis reveals that optimal encoder designs should tailor encoder multiplexing to object sparsity for maximum information capture, and that all optimally-encoded measurements share the same level of sparsity. Using mutual information-based optimization, we design information-optimal encoders for compressive imaging of fixed object distributions. Our designs demonstrate improved downstream reconstruction performance for objects in the distribution, without requiring joint optimization with a specific reconstruction algorithm. We validate our approach experimentally by evaluating lensless imaging systems directly from captured measurements, without the need for image formation models, reconstruction algorithms, or ground truth data. Our comprehensive analysis establishes design and engineering principles for lensless imaging systems, and offers a model for the study of general multiplexing systems, especially those with object-dependent performance.

physics.optics↗

arXiv2026

ConvRML: high-quality lensless imaging with random multi-focal lenslets

Mask-based lensless imagers use simple optics and computational reconstruction to design compact form factor cameras with compressive imaging ability. However, these imagers generally suffer from poor reconstruction quality. Here, we describe several advances in both hardware and software that result in improved lensless imaging quality. First, we use a precision-manufactured random multi-focal lenslet (RML) phase mask to produce improved measurements with reduced multiplexing. Next, we implement a ConvNeXt-based reconstruction architecture, which provides up to 4.6 dB improvement in peak signal-to-noise ratio over state-of-the-art attention-based architectures. Finally, we establish a parallel imaging setup that simultaneously images a scene with RML, diffuser, and lens systems, with which we collect datasets with 100,000 measurements for each system, to be used for reconstruction model training and evaluation. Using this standardized system, we quantify the improved measurement quality of the RML compared to a diffuser using the modulation transfer function and mutual information. Our ConvRML system benefits from both the optical and the computational developments presented in this work, and our contributions establish resources to support the continued development of high-quality, compact, and compressive lensless imagers.

physics.optics↗

arXiv2026

Scalable dataset acquisition for data-driven lensless imaging

Data-driven developments in lensless imaging, such as machine learning-based reconstruction algorithms, require large datasets. In this work, we introduce a data acquisition pipeline that can capture from multiple lensless imaging systems in parallel, under the same imaging conditions, and paired with computational ground truth registration. We provide an open-access 25,000 image dataset with two lensless imagers, a reproducible hardware setup, and open-source camera synchronization code. Experimental datasets from our system can enable data-driven developments in lensless imaging, such as machine learning-based reconstruction algorithms and end-to-end system design.

eess.IV↗

arXiv2026

Event2Audio: Event-Based Optical Vibration Sensing

Small vibrations observed in video can unveil information beyond what is visual, such as sound and material properties. It is possible to passively record these vibrations when they are visually perceptible, or actively amplify their visual contribution with a laser beam when they are not perceptible. In this paper, we improve upon the active sensing approach by leveraging event-based cameras, which are designed to efficiently capture fast motion. We demonstrate our method experimentally by recovering audio from vibrations, even for multiple simultaneous sources, and in the presence of environmental distortions. Our approach matches the state-of-the-art reconstruction quality at much faster speeds, approaching real-time processing.

eess.IV↗

arXiv2025

A Gaussian Parameterization for Direct Atomic Structure Identification in Electron Tomography

Atomic electron tomography (AET) enables the determination of 3D atomic structures by acquiring a sequence of 2D tomographic projection measurements of a particle and then computationally solving for its underlying 3D representation. Classical tomography algorithms solve for an intermediate volumetric representation that is post-processed into the atomic structure of interest. In this paper, we reformulate the tomographic inverse problem to solve directly for the locations and properties of individual atoms. We parameterize an atomic structure as a collection of Gaussians, whose positions and properties are learnable. This representation imparts a strong physical prior on the learned structure, which we show yields improved robustness to real-world imaging artifacts. Simulated experiments and a proof-of-concept result on experimentally-acquired data confirm our method's potential for practical applications in materials characterization and analysis with Transmission Electron Microscopy (TEM). Our code is available at https://github.com/nalinimsingh/gaussian-atoms.

eess.IV↗

arXiv2025

Information-driven design of imaging systems

Imaging systems have traditionally been designed to mimic the human eye and produce visually interpretable measurements. Modern imaging systems, however, process raw measurements computationally before or instead of human viewing. As a result, the information content of raw measurements matters more than their visual interpretability. Despite the importance of measurement information content, current approaches for evaluating imaging system performance do not quantify it: they instead either use alternative metrics that assess specific aspects of measurement quality or assess measurements indirectly with performance on secondary tasks. We developed the theoretical foundations and a practical method to directly quantify mutual information between noisy measurements and unknown objects. By fitting probabilistic models to measurements and their noise characteristics, our method estimates information by upper bounding its true value. By applying gradient-based optimization to these estimates, we also developed a technique for designing imaging systems called Information-Driven Encoder Analysis Learning (IDEAL). Our information estimates accurately captured system performance differences across four imaging domains (color photography, radio astronomy, lensless imaging, and microscopy). Systems designed with IDEAL matched the performance of those designed with end-to-end optimization, the prevailing approach that jointly optimizes hardware and image processing algorithms. These results establish mutual information as a universal performance metric for imaging systems that enables both computationally efficient design optimization and evaluation in real-world conditions. A video summarizing this work can be found at: https://waller-lab.github.io/EncodingInformationWebsite/

physics.optics↗

arXiv2025

Correcting Fabrication-Induced Curvature in Micromirror-Based Spatial Light Modulators with a Microlens Array

Computer generated holography requires high-speed spatial light modulators (SLMs) for dynamically patterning light in 3D. Piston-motion micromirror-based SLMs support high-speed ($\geq$ 10 kHz) phase modulation; however, fabricating micromirror arrays with sufficient fill factor necessary for high diffraction efficiency is challenging. In particular, the larger mirrors of high fill factor designs are susceptible to stress-induced curvature that significantly degrades optical performance. In this work, we introduce an optical compensation method using a pitch-matched microlens array (MLA) to focus light onto just the center of each mirror. Our approach thus avoids curvature-induced artifacts and improves optical fill factor to nearly 100$\%$, independent of the original mechanical fill factor. Through simulations and experiments on a fabricated micromirror array with bowed mirrors, we show that the Pearson correlation coefficient of the imparted phase profile is improved from 0.11 to 0.85 and the brightness of a holographically-generated single spot is enhanced by 8$\times$ with our microlens array in place. Our hybrid optical-electromechanical strategy thus provides a scalable path toward high-speed, high-fidelity wavefront control for applications such as adaptive optics, holographic displays, and optogenetics.

physics.optics↗

arXiv2025

Large-scale compressive microscopy via diffractive multiplexing across a sensor array

Microscopes face a trade-off between spatial resolution, field-of-view, and frame rate -- improving one of these properties typically requires sacrificing the others, due to the limited spatiotemporal throughput of the sensor. To overcome this, we propose a new microscope that achieves snapshot gigapixel-scale imaging with a sensor array and a diffractive optical element (DOE). We improve the spatiotemporal throughput in two ways. First, we capture data with an array of 48 sensors resulting in 48x more pixels than a single sensor. Second, we use point spread function (PSF) engineering and compressive sensing algorithms to fill in the missing information from the gaps surrounding the individual sensors in the array, further increasing the spatiotemporal throughput of the system by an additional >5.4x. The array of sensors is modeled as a single large-format "super-sensor," with erasures corresponding to the gaps between the individual sensors. The array is placed at the output of a (nearly) 4f imaging system, and we design a DOE for the Fourier plane that generates a distributed PSF that encodes information from the entire super-sensor area, including the gaps. We then computationally recover the large-scale image, assuming the object is sparse in some domain. Our calibration-free microscope can achieve ~3 μm resolution over >5.2 cm^2 FOVs at up to 120 fps, culminating in a total spatiotemporal throughput of 25.2 billion pixels per second. We demonstrate the versatility of our microscope in two different modes: structural imaging via darkfield contrast and functional fluorescence imaging of calcium dynamics across dozens of freely moving C. elegans simultaneously.

physics.optics↗

arXiv2025

Computationally Efficient Information-Driven Optical Design with Interchanging Optimization

Recent work has demonstrated that imaging systems can be evaluated through the information content of their measurements alone, enabling application-agnostic optical design that avoids computational decoding challenges. Information-Driven Encoder Analysis Learning (IDEAL) was proposed to automate this process through gradient-based optimization. In this work, we study IDEAL across diverse imaging systems and find that it suffers from high memory usage, long runtimes, and a potentially mismatched objective function due to end-to-end differentiability requirements. We introduce IDEAL with Interchanging Optimization (IDEAL-IO), a method that decouples density estimation from optical parameter optimization by alternating between fitting models to current measurements and updating optical parameters using fixed models for information estimation. This approach reduces runtime and memory usage by up to 6x while enabling more expressive density models that guide optimization toward superior designs. We validate our method on diffractive optics, lensless imaging, and snapshot 3D microscopy applications, establishing information-theoretic optimization as a practical, scalable strategy for real-world imaging system design.

eess.IV↗

arXiv2025

Ring deconvolution microscopy: exploiting symmetry for efficient spatially varying aberration correction

The most ubiquitous form of computational aberration correction for microscopy is deconvolution. However, deconvolution relies on the assumption that the point spread function is the same across the entire field-of-view. This assumption is often inadequate, but space-variant deblurring techniques generally require impractical amounts of calibration and computation. We present a new imaging pipeline that leverages symmetry to provide simple and fast spatially-varying aberration correction. Our ring deconvolution microscopy (RDM) method leverages the rotational symmetry of most microscopes and cameras, and naturally extends to sheet deconvolution in the case of lateral symmetry. We formally derive theory and algorithms for image recovery and additionally propose a neural network based on Seidel coefficients as a fast alternative, as well as extension of RDM to blind deconvolution. We demonstrate significant improvements in speed and image quality as compared to standard deconvolution and existing spatially-varying deconvolution across a diverse range of microscope modalities, including miniature microscopy, multicolor fluorescence microscopy, point-scanning multimode fiber micro-endoscopy, and light-sheet fluorescence microscopy. Our approach enables near-isotropic, subcellular resolution in each of these applications.

eess.IV↗

arXiv2025

Perturbative Fourier Ptychographic Microscopy for Fast Quantitative Phase Imaging

In computational phase imaging with a microscope equipped with an array of light emitting diodes as illumination unit, conventional Fourier ptychographic microscopy achieves high resolution and wide-field reconstructions but is constrained by a lengthy acquisition time. Conversely, differential phase contrast (DPC) offers fast imaging but is limited in resolution. Here, we introduce perturbative Fourier ptychographic microscopy (pFPM). pFPM is an extension of DPC that incorporates dark-field illumination to enable fast, high-resolution, wide-field quantitative phase imaging with few measurements. We interpret DPC as the initial iteration of a Gauss-Newton algorithm with quadratic regularization and generalize it to multiple iterations and more sophisticated regularizers. This broader framework is not restricted to bright-field measurements and allows us to overcome resolution limitations of DPC. We develop tailored annular dark-field illumination patterns that align with the perturbative interpretation and lead to an improvement in the quality of reconstruction with respect to other common illumination schemes. Consequently, our methodology combines an enhanced phase reconstruction algorithm with a specialized illumination strategy and offers significant advantages in both imaging speed and resolution.

physics.optics↗

arXiv2025

Sample Motion for Structured Illumination Fluorescence Microscopy

Structured illumination microscopy (SIM) uses a set of images captured with different illumination patterns to computationally reconstruct resolution beyond the diffraction limit. Here, we propose an alternative approach using a single speckle illumination pattern and relying on inherent sample motion to encode the super-resolved information in multiple raw images. From a set of raw fluorescence images captured as the sample moves, we jointly estimate both the sample motion and the super-resolved image. We demonstrate the feasibility of the proposed method both in simulation and in experiment.

physics.optics↗