arXiv Science⌕ Search

arXiv · 2610.19978

Interactive event-driven 4D-STEM with Timepix4 and live analytical ptychography

Abstract

Four-dimensional scanning transmission electron microscopy provides access to rich diffraction information at every probe position, but the high data rates associated with pixelated detectors remain a major challenge for interactive operation. Event-driven detectors offer an efficient alternative by representing the measurement as a sparse stream of individual incidences, substantially reducing requirements related to data handling and enabling on-the-fly processing. Here, we develop a high-throughput, real-time, 4D-STEM workflow based on the Timepix4 detector and demonstrate its operation at microsecond dwell times and standard beam currents. A common clock shared by the scan unit and detector allows the probe position of each electron event to be determined directly from its time-of-arrival, eliminating the need for inter-stream synchronization and enabling fully concurrent and independent multi-stream processing. The resulting pipeline continuously processes the detector data during acquisition, with the reconstructed images directly available. We demonstrate live virtual annular detector imaging, Real-Time Integration Center of Mass and direct electron ptychography within the guided progressive reconstructive imaging framework. The workflow sustains the high event rates of Timepix4 while maintaining zero latency for live interactive operation, thus extending event-driven 4D-STEM towards beam currents and acquisition conditions beyond those previously demonstrated with Timepix3-based systems. These results demonstrate that the combination of high-bandwidth event-driven detection, hardware-level synchronization and parallel processing can transform 4D-STEM from an offline technique into an interactive imaging modality, in which dose-efficient phase contrast and diffraction-based signals can serve directly as immediate feedback during STEM experiments.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Arno Annys, Hoelen L. Lalandec Robert, Jo Verbeeck. 2026-10-14. Interactive event-driven 4D-STEM with Timepix4 and live analytical ptychography. https://arxiv.org/abs/2610.19978

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Physics at the Edge: Benchmarking Quantisation Techniques and the Edge TPU for Neutrino Interaction Recognition

This work presents a benchmark of quantisation techniques for convolutional neural networks applied to neutrino interaction recognition, motivated by the need for low-power inference close to the detector in future liquid argon time-projection chamber (LArTPC) experiments. Using simulation of a generic LArTPC, four Keras models are trained to classify neutral-current, muon-neutrino charged-current and electron-neutrino charged-current interactions, quantised using post-training integer quantisation and quantisation-aware training, and deployed on the Google Coral Edge TPU. Latency and energy per event are compared with those of an Intel Core i7-13650HX CPU, a consumer NVIDIA RTX 4060 GPU and a data-centre NVIDIA A100 GPU, using measured energy at different batch sizes and thread counts; the energy of the Edge TPU is estimated from its nominal power. The accuracy degradation is strongly model-dependent: InceptionV3 shows no significant loss along either pipeline, whereas the other models are substantially degraded. At batch size 1, the Edge TPU is comparable to or faster than the CPU and 1.3-6.5 times slower than the A100, while requiring 5--70 times less energy per event than the other devices; with batching, the GPUs reduce this gap to a factor of 2.6-7.2. The Edge TPU is also approximately four times cheaper than the consumer GPU and more than two orders of magnitude cheaper than the A100. Its low power per device eases deployment where power and cooling are constrained, with an additional benefit in terms of environmental impact. This paper explores possible future integrations of edge AI technologies with neutrino physics.

physics.ins-det↗

Scan-Coil Delay Causes Anisotropic Signal Loss in Fast 4D-STEM

Fast pixelated detectors are driving 4D-STEM toward microsecond dwell times, a regime in which the finite response of the scan deflection coils becomes comparable to the dwell time itself. Using direct probe imaging and sub-frame diffraction analysis, we document a significant intra-dwell scan-coil delay that systematically smears the recorded signal anisotropically along the fast scan direction, with a settling timescale of several tens of microseconds. We present a phase-correlation-based sub-frame alignment procedure that measures and corrects this smearing, and we assess its impact on focused and defocused 4D-STEM reconstructions over a range of scan step sizes. The correction restores signal across a broad range of spatial frequencies, with the largest gains at the large step sizes required for low-dose biological imaging. Because it operates on existing data with no modification to the microscope, the method offers a practical route to recovering signal that would otherwise be lost to scan-coil delay.

physics.ins-det↗

Development of high-resolution timing technique in the past 25 years

This paper reviews recent progress in high-resolution timing, rate capability, and aging performance of particle detectors in the context of developments over the past 25 years. It focuses on MCP, SiPM, LGAD, 3D silicon, and SiEM detectors and compares their performance with that of gaseous timing detectors. In addition, preliminary results from a simplified simulation program, Mini-TCAD, are presented, indicating that hexagonal 3D silicon cells may provide better drift-time uniformity and timing resolution than square cells.

physics.ins-det↗