arXiv subjects

Liang Li

Publications and source records attributed to Liang Li.

At least 163 records · Page 9Linked to original sources

arXiv2025

Collective Behavior Clone with Visual Attention via Neural Interaction Graph Prediction

In this paper, we propose a framework, collective behavioral cloning (CBC), to learn the underlying interaction mechanism and control policy of a swarm system. Given the trajectory data of a swarm system, we propose a graph variational autoencoder (GVAE) to learn the local interaction graph. Based on the interaction graph and swarm trajectory, we use behavioral cloning to learn the control policy of the swarm system. To demonstrate the practicality of CBC, we deploy it on a real-world decentralized vision-based robot swarm system. A visual attention network is trained based on the learned interaction graph for online neighbor selection. Experimental results show that our method outperforms previous approaches in predicting both the interaction graph and swarm actions with higher accuracy. This work offers a promising approach for understanding interaction mechanisms and swarm dynamics in future swarm robotics research. Code and data are available.

cs.RO↗

arXiv2025

Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Model

Rapid advancement of diffusion models has catalyzed remarkable progress in the field of image generation. However, prevalent models such as Flux, SD3.5 and Midjourney, still grapple with issues like model bias, limited text rendering capabilities, and insufficient understanding of Chinese cultural nuances. To address these limitations, we present Seedream 2.0, a native Chinese-English bilingual image generation foundation model that excels across diverse dimensions, which adeptly manages text prompt in both Chinese and English, supporting bilingual image generation and text rendering. We develop a powerful data system that facilitates knowledge integration, and a caption system that balances the accuracy and richness for image description. Particularly, Seedream is integrated with a self-developed bilingual large language model as a text encoder, allowing it to learn native knowledge directly from massive data. This enable it to generate high-fidelity images with accurate cultural nuances and aesthetic expressions described in either Chinese or English. Beside, Glyph-Aligned ByT5 is applied for flexible character-level text rendering, while a Scaled ROPE generalizes well to untrained resolutions. Multi-phase post-training optimizations, including SFT and RLHF iterations, further improve the overall capability. Through extensive experimentation, we demonstrate that Seedream 2.0 achieves state-of-the-art performance across multiple aspects, including prompt-following, aesthetics, text rendering, and structural correctness. Furthermore, Seedream 2.0 has been optimized through multiple RLHF iterations to closely align its output with human preferences, as revealed by its outstanding ELO score. In addition, it can be readily adapted to an instruction-based image editing model, such as SeedEdit, with strong editing capability that balances instruction-following and image consistency.

cs.CV↗

arXiv2025

WHALE-FL: Wireless and Heterogeneity Aware Latency Efficient Federated Learning over Mobile Devices via Adaptive Subnetwork Scheduling

As a popular distributed learning paradigm, federated learning (FL) over mobile devices fosters numerous applications, while their practical deployment is hindered by participating devices' computing and communication heterogeneity. Some pioneering research efforts proposed to extract subnetworks from the global model, and assign as large a subnetwork as possible to the device for local training based on its full computing and communications capacity. Although such fixed size subnetwork assignment enables FL training over heterogeneous mobile devices, it is unaware of (i) the dynamic changes of devices' communication and computing conditions and (ii) FL training progress and its dynamic requirements of local training contributions, both of which may cause very long FL training delay. Motivated by those dynamics, in this paper, we develop a wireless and heterogeneity aware latency efficient FL (WHALE-FL) approach to accelerate FL training through adaptive subnetwork scheduling. Instead of sticking to the fixed size subnetwork, WHALE-FL introduces a novel subnetwork selection utility function to capture device and FL training dynamics, and guides the mobile device to adaptively select the subnetwork size for local training based on (a) its computing and communication capacity, (b) its dynamic computing and/or communication conditions, and (c) FL training status and its corresponding requirements for local training contributions. Our evaluation shows that, compared with peer designs, WHALE-FL effectively accelerates FL training without sacrificing learning accuracy.

cs.LG↗

arXiv2025

RingAda: Pipelining Large Model Fine-Tuning on Edge Devices with Scheduled Layer Unfreezing

To enable large model (LM) based edge intelligent service provisioning, on-device fine-tuning with locally personalized data allows for continuous and privacy-preserving LM customization. In this paper, we propose RingAda, a collaborative training framework designed for fine-tuning transformer-based LMs on edge devices. Particularly, RingAda performs parameter-efficient adapter fine-tuning across a set of interconnected edge devices, forming a ring topology for per-batch training by sequentially placing frozen transformer blocks and their trainable adapter modules on the devices. RingAda follows a novel pipeline-parallel training mechanism with top-down adapter unfreezing, allowing for early-stopping of backpropagation at the lowest unfrozen adapter layer, thereby accelerating the fine-tuning process. Extensive experimental results demonstrate that RingAda significantly reduces fine-tuning time and memory costs while maintaining competitive model performance compared to its peer designs.

cs.DC↗

arXiv2025

MobiLLM: Enabling LLM Fine-Tuning on the Mobile Device via Server Assisted Side Tuning

Large Language Model (LLM) at mobile devices and its potential applications never fail to fascinate. However, on-device LLM fine-tuning poses great challenges due to extremely high memory requirements and slow training speeds. Even with parameter-efficient fine-tuning (PEFT) methods that update only a small subset of parameters, resource-constrained mobile devices cannot afford them. In this paper, we propose MobiLLM to enable memory-efficient transformer LLM fine-tuning on a mobile device via server-assisted side-tuning. Particularly, MobiLLM allows the resource-constrained mobile device to retain merely a frozen backbone model, while offloading the memory and computation-intensive backpropagation of a trainable side-network to a high-performance server. Unlike existing fine-tuning methods that keep trainable parameters inside the frozen backbone, MobiLLM separates a set of parallel adapters from the backbone to create a backpropagation bypass, involving only one-way activation transfers from the mobile device to the server with low-width quantization during forward propagation. In this way, the data never leaves the mobile device while the device can remove backpropagation through the local backbone model and its forward propagation can be paralyzed with the server-side execution. Thus, MobiLLM preserves data privacy while significantly reducing the memory and computational burdens for LLM fine-tuning. Through extensive experiments, we demonstrate that MobiLLM can enable a resource-constrained mobile device, even a CPU-only one, to fine-tune LLMs and significantly reduce convergence time and memory usage.

cs.LG↗

arXiv2025

On the dynamical Rayleigh-Taylor instability of non-homogeneous fluid in annular region with Naiver-slip boundary

This paper investigates the well-posedness and Rayleigh-Taylor (R-T) instability for a system of two-dimensional nonhomogeneous incompressible fluid, subject to the non-slip and Naiver-slip boundary conditions at the outer and inner boundaries, respectively, in an annular region. In order to effectively utilize the domain shape, we analyze this system in polar coordinates. First, for the well-posedness to this system, based on the spectral properties of Stokes operator, Sobolev embedding inequalities and Stokes' estimate in the context of the specified boundary conditions, etc, we obtain the local existence of weak and strong solutions using semi-Galerkin method and prior estimates. Second, for the density profile with the property that it is increasing along radial radius in certain region, we demonstrate that it is linear instability (R-T instability) through Fourier series and the settlement of a family of modified variational problems. Furthermore, based on the existence of the linear solutions exhibiting exponential growth over time, we confirm the nonlinear instability of this steady state in both Lipschitz and Hadamard senses by nonlinear energy estimates.

math.AP↗

arXiv2025

Energy-Efficient Split Learning for Fine-Tuning Large Language Models in Edge Networks

In this letter, we propose an energy-efficient split learning (SL) framework for fine-tuning large language models (LLMs) using geo-distributed personal data at the network edge, where LLMs are split and alternately across massive mobile devices and an edge server. Considering the device heterogeneity and channel dynamics in edge networks, a \underline{C}ut l\underline{A}yer and computing \underline{R}esource \underline{D}ecision (CARD) algorithm is developed to minimize training delay and energy consumption. Simulation results demonstrate that the proposed approach reduces the average training delay and server's energy consumption by 70.8% and 53.1%, compared to the benchmarks, respectively.

cs.LG↗

arXiv2025

Sub-2 Kelvin characterization of nitrogen-vacancy centers in silicon carbide nanopillars

The development of efficient quantum communication technologies depends on the innovation in multiple layers of its implementation, a challenge we address from the fundamental properties of the physical system at the nano-scale to the instrumentation level at the macro-scale. We select a promising near infrared quantum emitter, the nitrogen-vacancy (NV) center in 4H-SiC, and integrate it, at an ensemble level, with nanopillar structures that enhance photon collection efficiency into an objective lens. Moreover, changes in collection efficiency in pillars compared to bulk can serve as indicators of color center orientation in the lattice. To characterize NV center properties at the unprecedented sub-2 Kelvin temperatures, we incorporate compatible superconducting nanowire single photon detectors inside the chamber of an optical cryostat and create the ICECAP, the Integrated Cryogenic system for Emission, Collection And Photon-detection. ICECAP measurements show no significant linewidth broadening of NV ensemble emission and up to 14-fold enhancement in collected emission. With additional filtering, we measure emitter lifetimes of NV centers in a basal ($hk$) and an axial ($kk$) orientation unveiling their cryogenic values of 2.2 ns and 2.8 ns.

quant-ph↗

arXiv2025

Elastic properties of Cu-6wt\%Ag alloy wires for pulsed magnets investigated by ultrasonic techniques

Conductor materials with good mechanical performance as well as high electrical- and thermal-conductivities are particularly important to break through the current bottle-neck limit ($\sim 100$ T) of pulsed magnets. Here we perform systematic studies on the elastic properties of the Cu-6wt\%Ag alloy wires, a promising candidate material for the new-generation pulsed magnets, by employing two independent ultrasonic techniques - resonant ultrasound spectroscopy (RUS) and ultrasound pulse-echo experiments. Our RUS measurements manifest that the elastic properties of the Cu-6wt\%Ag alloy wires can be improved by an electroplastic drawing procedure as compared with the conventional cold drawing. We also take this chance to test the availability of our newly-built ultrasound pulse-echo facility at Wuhan National High Magnetic Field Center (WHMFC, China), and the results suggest that the elastic performance of the electroplastically-drawn Cu-6wt\%Ag alloy wire remains excellent without anomalous softening under extreme conditions, e.g., ultra-high magnetic field up to 50 T, nitrogen / helium cryogenic liquids.

cond-mat.mtrl-sci↗

arXiv2025

GRB 190114C: Fireball Energy Budget and Radiative Efficiency Revisited

The jet composition of gamma-ray bursts (GRBs), as well as how efficiently the jet converts its energy to radiation, are long-standing problems in GRB physics. Here, we reported a comprehensive temporal and spectral analysis of the TeV-emitting bright GRB 190114C. Its high fluence ($\sim$ 4.4$\times$10$^{-4}$ erg cm$^{-2}$) allows us to conduct the time-resolved spectral analysis in great detail and study their variations down to a very short time-scale ($\sim$0.1 s) while preserving a high significance. Its prompt emission consists of three well-separated pulses. The first two main pulses ($P_1$ and $P_2$) exhibit independently strong thermal components, starting from the third pulse ($P_3$) and extending to the entire afterglow, the spectra are all nonthermal, the synchrotron plus Compton upscattering model well interprets the observation. By combining the thermal ($P_1$ and $P_2$) and the nonthermal ($P_3$) observations based on two different scenarios (global and pulse properties) and following the method described in Zhang et al., we measure the fireball parameters and GRB radiative efficiency with little uncertainties for this GRB. A relevantly high GRB radiative efficiency is obtained based on both the global and pulse properties, suggesting that if GRBs are powered by fireballs, the efficiency can sometimes be high. More interestingly, though the observed parameters are individually different (e.g., the amount of mass loading $M$), the radiative efficiency obtained from $P_1$ ($η_γ=36.0\pm6.5\%$) and $P_2$ ($η_γ=41.1\pm1.9\%$) is roughly the same, which implies that the central engine of the same GRB has some common properties.

astro-ph.HE↗

arXiv2024

Time-averaging Polarimetric and Spectral Properties of Gamma-Ray Bursts

The composition and radiation mechanism of gamma-ray bursts (GRBs) within jets continue to be hotly debated. Investigating the joint polarimetric and spectral properties is crucial for understanding GRB composition and radiation mechanism. Various jet properties, such as ``kinetic-energy-dominated" (KED), ``Poynting-flux-dominated" (PFD), and ``hybrid-dominated" (HD) relativistic outflows, have been inferred from observed GRB spectra, with expectations of differing polarization levels among them. In this study, we analyzed a sample of 27 GRBs detected by the Gamma-ray Burst Monitor on board the NASA Fermi Gamma-ray Space Telescope, focusing on 26 bursts with significant polarization measurements. Our analysis revealed that 16 bursts (62\%) were predominantly associated with the ``PFD'' jet type, while 10 bursts (38\%) were classified as HD, implying that photosphere emission may also be a possible mechanism powering the high levels of polarization. Notably, no bursts were identified as KED-type. We found distinct polarization properties, with HD-type bursts exhibiting consistently higher polarization levels than PFD-type bursts. We proposed models incorporating ordered and random magnetic field configurations specific to hybrid jets.

astro-ph.HE↗

arXiv2024

High-purity valley-polarized currents induced by bichromatic optical fields in two-dimensional materials

Producing currents predominantly from a single valley, namely valley-polarized currents, at optical-cycle timescales is an important aspect of the petahertz valleytronics, yet it remains less developed. This work exhibits the feasibility of achieving this goal using bichromatic optical fields, which allow for the precise control of sub-cycle electron dynamics. The combined effect of the helical and asymmetric waveforms of the optical fields leads to highly asymmetric excitation at different valleys and displacement of the excited electrons concurrently, thereby inducing valley-polarized currents with high valley purity, on the sub-optical-cycle timescale. Inherently, the purity of the currents built up from the optical approach remains high even for materials with short decoherence time. Moreover, the direction of the currents can be precisely controlled by adjusting the relative phase of the bichromatic components. Our work offers a promising avenue for generating and modulating high-purity valley-polarized currents at the femtosecond timescale, facilitating the development of petahertz valleytronics.

physics.optics↗

arXiv2024

EvalMuse-40K: A Reliable and Fine-Grained Benchmark with Comprehensive Human Annotations for Text-to-Image Generation Model Evaluation

Recently, Text-to-Image (T2I) generation models have achieved significant advancements. Correspondingly, many automated metrics have emerged to evaluate the image-text alignment capabilities of generative models. However, the performance comparison among these automated metrics is limited by existing small datasets. Additionally, these datasets lack the capacity to assess the performance of automated metrics at a fine-grained level. In this study, we contribute an EvalMuse-40K benchmark, gathering 40K image-text pairs with fine-grained human annotations for image-text alignment-related tasks. In the construction process, we employ various strategies such as balanced prompt sampling and data re-annotation to ensure the diversity and reliability of our benchmark. This allows us to comprehensively evaluate the effectiveness of image-text alignment metrics for T2I models. Meanwhile, we introduce two new methods to evaluate the image-text alignment capabilities of T2I models: FGA-BLIP2 which involves end-to-end fine-tuning of a vision-language model to produce fine-grained image-text alignment scores and PN-VQA which adopts a novel positive-negative VQA manner in VQA models for zero-shot fine-grained evaluation. Both methods achieve impressive performance in image-text alignment evaluations. We also use our methods to rank current AIGC models, in which the results can serve as a reference source for future study and promote the development of T2I generation. The data and code will be made publicly available.

cs.CV↗

arXiv2024

Query-centric Audio-Visual Cognition Network for Moment Retrieval, Segmentation and Step-Captioning

Video has emerged as a favored multimedia format on the internet. To better gain video contents, a new topic HIREST is presented, including video retrieval, moment retrieval, moment segmentation, and step-captioning. The pioneering work chooses the pre-trained CLIP-based model for video retrieval, and leverages it as a feature extractor for other three challenging tasks solved in a multi-task learning paradigm. Nevertheless, this work struggles to learn the comprehensive cognition of user-preferred content, due to disregarding the hierarchies and association relations across modalities. In this paper, guided by the shallow-to-deep principle, we propose a query-centric audio-visual cognition (QUAG) network to construct a reliable multi-modal representation for moment retrieval, segmentation and step-captioning. Specifically, we first design the modality-synergistic perception to obtain rich audio-visual content, by modeling global contrastive alignment and local fine-grained interaction between visual and audio modalities. Then, we devise the query-centric cognition that uses the deep-level query to perform the temporal-channel filtration on the shallow-level audio-visual representation. This can cognize user-preferred content and thus attain a query-centric audio-visual representation for three tasks. Extensive experiments show QUAG achieves the SOTA results on HIREST. Further, we test QUAG on the query-based video summarization task and verify its good generalization.

cs.CV↗

arXiv2024

A Decade of Deep Learning: A Survey on The Magnificent Seven

Deep learning has fundamentally reshaped the landscape of artificial intelligence over the past decade, enabling remarkable achievements across diverse domains. At the heart of these developments lie multi-layered neural network architectures that excel at automatic feature extraction, leading to significant improvements in machine learning tasks. To demystify these advances and offer accessible guidance, we present a comprehensive overview of the most influential deep learning algorithms selected through a broad-based survey of the field. Our discussion centers on pivotal architectures, including Residual Networks, Transformers, Generative Adversarial Networks, Variational Autoencoders, Graph Neural Networks, Contrastive Language-Image Pre-training, and Diffusion models. We detail their historical context, highlight their mathematical foundations and algorithmic principles, and examine subsequent variants, extensions, and practical considerations such as training methodologies, normalization techniques, and learning rate schedules. Beyond historical and technical insights, we also address their applications, challenges, and potential research directions. This survey aims to serve as a practical manual for both newcomers seeking an entry point into cutting-edge deep learning methods and experienced researchers transitioning into this rapidly evolving domain.

cs.LG↗

arXiv2024

A Novel Method of Estimating GRB Peak Energies Beyond the \emph{Swift}/BAT Limit

The \emph{Swift} Burst Alert Telescope (BAT), operating in the 15--150 keV energy band, struggles to detect the peak energy ($E_{\rm p}$) of gamma-ray bursts (GRBs), as most GRBs have $E_{\rm p}$ values typically distributed between 200-300 keV, exceeding BAT's upper limit. To address this, we develop an innovative method to robustly estimate the lower limit of $E_{\rm p}$ for GRBs with $E_{\rm p}>150$ keV. This approach relies on the intrinsic curvature of GRB spectra, which is already evident within the BAT energy range for such GRBs. By fitting BAT spectra with a cutoff power-law model and extrapolating the spectral curvature beyond BAT's range, we, therefore, can estimate the cutoff energy ($E^{'}_{\rm c}$) beyond 150 keV and the corresponding peak energy ($E^{'}_{\rm p}$). We applied this method to 17 GRBs, categorizing them into two main groups. Group I (10 bursts) maintains $α$ within a typical range (from $\sim$ -0.8 to $\sim$ -1.20) with increasing $E_{\rm c}$; Group II (2 bursts) maintains $E_{\rm c}$ within a typical range (300-500 keV) but with varying $α$. Our results show that for $E_{\rm c}\lesssim $1000 keV, the estimated $E^{'}_{\rm c}$ aligns well with observed values. Moreover, the reliability of $E^{'}_{\rm c}$ also depends on $α$: bursts with harder $α$ (e.g., $α\gtrsim -2/3$) show reduced accuracy, while bursts with softer $α$ (e.g., $α\lesssim -2/3$) yield more precise estimates. In conclusion, this method is well-suited for GRB spectra with moderately observed $E_{\rm c}$ ($E_{\rm p}$) values and $α$ indices that are not too hard.

astro-ph.HE↗

arXiv2024

DarkSHINE Baseline Design Report: Physics Prospects and Detector Technologies

DarkSHINE is a newly proposed fixed-target experiment initiative to search for the invisible decay of Dark Photon via missing energy/momentum signatures, based on the high repetition rate electron beam to be deployed/delivered by the Shanghai High repetition rate XFEL and Extreme light facility (SHINE). This report elaborates the baseline design of DarkSHINE experiment by introducing the physics goals, experimental setups, details of each sub-detector system technical designs, signal and backgground modelings, expected search sensitivities and future prospects, which mark an important step towards the further prototyping and technical demonstrations.

physics.ins-det↗

arXiv2024

On the wave equation with Coulomb potential

Wave/Schrödinger equations with potentials naturally originates from both the quantum physics and the study of nonlinear equations. The distractive Coulomb potential is a quantum mechanical description of distractive Coulomb force between two particles with the same charge. The spectrum of the operator $-Δ+1/|x|$ is well known and there are also a few results on the Strichartz estimates, local and global well-posedness and scattering result about the nonlinear Schrödinger equation with a distractive Coulomb potential. In the contrast, much less is known for the global and asymptotic behaviour of solutions to the corresponding wave equations with a Coulomb potential. In this work we consider the wave equation with a distractive Coulomb potential in dimensions $d\geq 3$. We first describe the asymptotic behaviour of the solutions to the linear homogeneous Coulomb wave equation, especially their energy distribution property and scattering profiles, then show that the radial finite-energy solutions to suitable defocusing Coulomb wave equation are defined for all time and scatter in both two time directions, by establishing a family of radial Strichartz estimates and combining them with the decay of the potential energy.

math.AP↗