arXiv Science⌕ Search

arXiv subjects

Yueming Li

Publications and source records attributed to Yueming Li.

11 recordsLinked to original sources

Foundation Pareto Flow Policy for Multi-Objective Reinforcement Learning

The overarching goal of reinforcement learning (RL) is to efficiently optimize the agent's policy for various environments, tasks, dynamics, and even user preferences, which often consist of multiple and potentially conflicting rewards/objectives. This necessitates the learning of Pareto-optimal policies that can navigate different trade-offs among objectives. However, existing multi-objective RL (MORL) methods, whether trained online or offline, are typically limited to task- or objective-specific policy learning and do not address generalization of learned trade-offs to unseen tasks/objectives. In this work, we propose the Foundation Pareto Flow Policy (FP2) for offline MORL in continuous robotic control, inspired by the pre-mid-post-training paradigm underlying recent foundation models. Specifically, we instantiate FP2 as a multi-modal diffusion transformer equipped with a likelihood-free flow matching loss, enabling unified, scalable, and instructable learning of diverse trade-off trajectories. We further develop a three-stage training pipeline to gradually optimize the policy: (1) pre-training on a large-scale MORL dataset, (2) mid-training on a carefully curated high-quality dataset, and (3) post-training on few collected trajectory data from new tasks and trade-offs. Empirical results demonstrate that FP2 outperforms previous state-of-the-art methods on most tasks of the D4MORL benchmark, achieving superior zero-shot interpolation and extrapolation on complex Pareto manifolds as well as efficient few-shot adaptation of the learned trade-off prior to new continuous-control tasks. Code is available at https://github.com/FibonacciRabbit/FP2.

cs.LG↗

MAPF-World: Action World Model for Multi-Agent Path Finding

Multi-agent path finding (MAPF) studies the problem of planning conflict-free paths for multiple agents from given start locations to designated goals, with applications in robot-assisted logistics and social navigation. Recent decentralized learned solvers have shown promise for large-scale MAPF, particularly when leveraging foundation models and large datasets. However, most existing methods rely on reactive policies, often resulting in congestion, deadlocks, and degraded generalization in high agent-density environments. To address these limitations, we propose MAPF-World, an autoregressive action world model for MAPF that unifies short-horizon local future prediction and action generation, enabling decision-making beyond immediate local observations. MAPF-World models short-horizon local dynamics by predicting the next local observation and neighboring agents' action intentions, capturing both spatial structures and temporal interaction patterns. We further introduce a spatio-agent positional encoding that integrates spatial awareness with agent-level semantics in Transformer-based architectures, facilitating more coordinated multi-agent behaviors. In addition, we augment existing MAPF benchmarks by introducing an automated map generator grounded in real-world urban layouts, aiming to narrow the gap between synthetic simulation and practical deployment scenarios. Extensive experiments across diverse map types and interaction settings demonstrate that MAPF-World achieves strong performance compared with existing learned solvers. Notably, it exhibits robust zero-shot generalization and maintains a high success rate even as agent density increases.

cs.AI↗

Single-pulse Stimulated Raman Photothermal Microscopy and Direct Visualization of Cholesterol-rich Membrane Domains

By measuring the thermal effects resulting from stimulated Raman excitations, stimulated Raman photothermal (SRP) microscope offers a new access to spatially and temporally resolved Raman signatures across various sample types. Unlike stimulated Raman scattering (SRS) microscopy, SRP is highly compatible with noisy ultrafast laser sources, allowing the use of high peak power, low repetition rate optical parametric amplifier (OPA) lasers to boost sensitivity and imaging speed. Here, we report a single pulse SRP (spSRP) microscope system in which SRP signals are induced by individual pairs of laser pulses generated by an OPA laser. Extensive pulse chirping is used to maximize SRS excitation rate and to minimize photodamage. The single-pixel limit of detection (LOD) of spSRP on dimethyl sulfoxide (DMSO) reaches 890 μM, which is a ~44-fold improvement over SRS microscope. Versatile applications to fungi, cells, and tissues are demonstrated. Live cell spSRP imaging was carried out at speed of 10 frames per second. Particularly, the spSRP system enables direct visualization of cholesterol-rich domains, co-localized with caveolin immunofluorescence, in the plasma membrane of HeLa cells.

physics.optics↗

Miniaturized optically-generated Bessel beam ultrasound for volumetric transcranial brain stimulation

Non-invasive stimulation of small, variably shaped brain sub-regions is crucial for advancing our understanding of brain functions. Current ultrasound neuromodulation faces two significant trade-offs when targeting brain sub-regions: miniaturization versus volumetric control and spatial resolution versus transcranial capability. Here, we present an optically-generated Bessel beam ultrasound (OBUS) device designed to overcome these limitations. This 2.33 mm-diameter miniaturized device delivers a column-shaped field achieving a lateral resolution of 152 um and an axial resolution of 1.93 mm, targeting brain sub-regions with an elongated volume of tissue activation. Immunofluorescence imaging of mouse brain slices confirms its ability to stimulate cells at a depth of 2.2 mm. Additionally, OBUS outperforms conventional Gaussian ultrasound in transcranial transmission efficiency and beam shape preservation. Electrophysiological recordings and functional MRI captured rodent brain responses evoked by OBUS, demonstrating OBUS's ability to non-invasively activate neural circuits in intact brains. This technology offers new possibilities for studying brain functions with precision and volumetric control.

q-bio.NC↗

Fiber laser based stimulated Raman photothermal microscopy with long working distance optics

Stimulated Raman scattering (SRS) microscopy is a highly sensitive chemical imaging technique. However, the broader application of SRS has been limited by two key challenges: the reliance on low-noise but bulky solid-state laser sources and stringent sample requirements necessitated by high numerical aperture (NA) optics. Here, we present a fiber laser based stimulated Raman photothermal (SRP) microscope that addresses these limitations. While appreciating the portability and compactness of a noisy source, fiber laser SRP enables a two-order-of-magnitude improvement in signal to noise ratio over fiber laser SRS without balance detection. Furthermore, with the use of low NA, long working distance optics for signal collection, SRP expands the allowed sample space from millimeters to centimeters, which diversifies the sample formats to multi-well plates and thick tissues. The sensitivity and imaging depth are further amplified by using urea for both thermal enhancement and tissue clearance. Together, fiber laser SRP microscopy provides a robust, user-friendly platform for diverse applications.

physics.optics↗

Underwater Object Tracker: UOSTrack for Marine Organism Grasping of Underwater Vehicles

A visual single-object tracker is an indispensable component of underwater vehicles (UVs) in marine organism grasping tasks. Its accuracy and stability are imperative to guide the UVs to perform grasping behavior. Although single-object trackers show competitive performance in the challenge of underwater image degradation, there are still issues with sample imbalance and exclusion of similar objects that need to be addressed for application in marine organism grasping. This paper proposes Underwater OSTrack (UOSTrack), which consists of underwater image and open-air sequence hybrid training (UOHT), and motion-based post-processing (MBPP). The UOHT training paradigm is designed to train the sample-imbalanced underwater tracker so that the tracker is exposed to a great number of underwater domain training samples and learns the feature expressions. The MBPP paradigm is proposed to exclude similar objects. It uses the estimation box predicted with a Kalman filter and the candidate boxes in the response map to relocate the lost tracked object in the candidate area. UOSTrack achieves an average performance improvement of 4.41% and 7.98% maximum compared to state-of-the-art methods on various benchmarks, respectively. Field experiments have verified the accuracy and stability of our proposed UOSTrack for UVs in marine organism grasping tasks. More details can be found at https://github.com/LiYunfengLYF/UOSTrack.

cs.CV↗

Multifunctional fiber-based optoacoustic emitter for non-genetic bidirectional neural communication

A bidirectional brain interface with both "write" and "read" functions can be an important tool for fundamental studies and potential clinical treatments for neurological diseases. Here we report a miniaturized multifunctional fiber based optoacoustic emitter (mFOE) that first integrates simultaneous non-genetic optoacoustic stimulation for "write" and electrophysiology recording of neural circuits for "read". The non-genetic feature addresses the challenges of the viral transfection required by optogenetics in primates and human. The orthogonality between optoacoustic waves and electrical field provides a solution to avoid the interference between electrical stimulation and recording. We first validated the non-genetic stimulation function of the mFOE in rat cultured neurons using calcium imaging. In vivo application of mFOE for successful simultaneous optoacoustic stimulation and electrical recording of brain activities was confirmed in mouse hippocampus in both acute and chronical applications up to 1 month. Minimal brain tissue damage has been confirmed after these applications. The capability of non-genetic neural stimulation and recording enabled by mFOE opens up new possibilities for the investigation of neural circuits and brings new insights into the study of ultrasound neurostimulation.

q-bio.NC↗

Optically-generated focused ultrasound for noninvasive brain stimulation with ultrahigh precision

High precision neuromodulation is a powerful tool to decipher neurocircuits and treat neurological diseases. Current non-invasive neuromodulation methods offer limited precision at the millimeter level. Here, we report optically-generated focused ultrasound (OFUS) for non-invasive brain stimulation with ultrahigh precision. OFUS is generated by a soft optoacoustic pad (SOAP) fabricated through embedding candle soot nanoparticles in a curved polydimethylsiloxane film. SOAP generates a transcranial ultrasound focus at 15 MHz with an ultrahigh lateral resolution of 83 um, which is two orders of magnitude smaller than that of conventional transcranial-focused ultrasound (tFUS). Here, we show effective OFUS neurostimulation in vitro with a single ultrasound cycle. We demonstrate submillimeter transcranial stimulation of the mouse motor cortex in vivo. An acoustic energy of 0.6 mJ/cm^2, four orders of magnitude less than that of tFUS, is sufficient for successful OFUS neurostimulation. OFUS offers new capabilities for neuroscience studies and disease treatments by delivering a focus with ultrahigh precision non-invasively.

q-bio.NC↗

First-Generation Inference Accelerator Deployment at Facebook

In this paper, we provide a deep dive into the deployment of inference accelerators at Facebook. Many of our ML workloads have unique characteristics, such as sparse memory accesses, large model sizes, as well as high compute, memory and network bandwidth requirements. We co-designed a high-performance, energy-efficient inference accelerator platform based on these requirements. We describe the inference accelerator platform ecosystem we developed and deployed at Facebook: both hardware, through Open Compute Platform (OCP), and software framework and tooling, through Pytorch/Caffe2/Glow. A characteristic of this ecosystem from the start is its openness to enable a variety of AI accelerators from different vendors. This platform, with six low-power accelerator cards alongside a single-socket host CPU, allows us to serve models of high complexity that cannot be easily or efficiently run on CPUs. We describe various performance optimizations, at both platform and accelerator level, which enables this platform to serve production traffic at Facebook. We also share deployment challenges, lessons learned during performance optimization, as well as provide guidance for future inference hardware co-design.

cs.AR↗

Ultra-Efficient Conversion of Microwave into Ultrasound Wave through a Split Ring Resonator

Thermo-elastic conversion of electromagnetic wave into ultrasound wave has enabled diverse biomedical applications such as photoacoustic imaging. Microwave, which has ~10 cm long wavelength, can penetrate deeper into tissue than photons, heralding exciting applications such as deep tissue imaging via thermo-acoustic tomography. However, the thermo-acoustic conversion efficiency is very low even with an exogenous contrast agent such as carbon nanotube. Here, we break this low conversion limit through using a split ring resonator (SRR) to effectively collect and concentrate the microwave energy into a sub-millimeter hot spot and subsequently convert the energy into ultrasound wave. Our SRR achieves over three orders of magnitude higher thermo-acoustic conversion efficiency than commonly used thermo-acoustic contrast agents. We further harness the SRR as a wireless, battery-free ultrasound emitter placed under a breast phantom. These results promise exciting potential of SRR for precise thermo-acoustic localization and modulation of subjects in deep tissue.

physics.app-ph↗

Strong Modification of Radiative Transition Rates due to a Breit-Interaction-Induced Avoided Crossing

We present the observations of x-rays emitted from the $1s2s^{2}2p_{1/2}2p_{3/2}$ inner shell excited state of B-like W and Bi ions. The relative transition rates are obtained for two dominant radiative transitions to $1s^{2}2s^{2}2p_{1/2}$ and $1s^{2}2s^{2}2p_{3/2}$. The experimental results and the comparison with rigorous relativistic calculations show that the rates of the strong electric dipole allowed $1s^22s^22p$ -- $1s2s^22p^2$ transitions are strongly modified due to a drastic change in the wavefunction caused by the Breit interaction.

physics.atom-ph↗