arXiv subjects

Liang Li

Publications and source records attributed to Liang Li.

At least 145 records · Page 8Linked to original sources

arXiv2025

Multi-Layer Backward Joint Model for Dynamic Prediction of Clinical Events with Multivariate Longitudinal Predictors of Mixed Types

Dynamic prediction of time-to-event outcomes using longitudinal data is highly useful in clinical research and practice. A common strategy is the joint modeling of longitudinal and time-to-event data. The shared random effect model has been widely studied for this purpose. However, it can be computationally challenging when applied to problems with a large number of longitudinal predictor variables, particularly when mixed types of continuous and categorical variables are involved. Addressing these limitations, we introduce a novel multi-layer backward joint model (MBJM). The model structure consists of multiple data layers cohesively integrated through a series of conditional distributions that involve longitudinal and time-to-event data, where the time to the clinical event is the conditioning variable. This model can be estimated with standard statistical software with rapid and robust computation, regardless of the dimension of the longitudinal predictor variables. We provide both theoretical and empirical results to show that the MBJM outperforms the static prediction model that does not fully account for the longitudinal nature of the prediction. In an empirical comparison with the shared random effects joint model, the MBJM demonstrated competitive performance with substantially faster and more robust computation. Both the simulation and real data application from a primary biliary cirrhosis study utilized seven longitudinal biomarkers, five continuous and two categorical, larger than the typically published joint modeling problems.

stat.ME↗

arXiv2025

NTIRE 2025 challenge on Text to Image Generation Model Quality Assessment

This paper reports on the NTIRE 2025 challenge on Text to Image (T2I) generation model quality assessment, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2025. The aim of this challenge is to address the fine-grained quality assessment of text-to-image generation models. This challenge evaluates text-to-image models from two aspects: image-text alignment and image structural distortion detection, and is divided into the alignment track and the structural track. The alignment track uses the EvalMuse-40K, which contains around 40K AI-Generated Images (AIGIs) generated by 20 popular generative models. The alignment track has a total of 371 registered participants. A total of 1,883 submissions are received in the development phase, and 507 submissions are received in the test phase. Finally, 12 participating teams submitted their models and fact sheets. The structure track uses the EvalMuse-Structure, which contains 10,000 AI-Generated Images (AIGIs) with corresponding structural distortion mask. A total of 211 participants have registered in the structure track. A total of 1155 submissions are received in the development phase, and 487 submissions are received in the test phase. Finally, 8 participating teams submitted their models and fact sheets. Almost all methods have achieved better results than baseline methods, and the winning methods in both tracks have demonstrated superior prediction performance on T2I model quality assessment.

cs.CV↗

arXiv2025

FedEx: Expediting Federated Learning over Heterogeneous Mobile Devices by Overlapping and Participant Selection

Training latency is critical for the success of numerous intrigued applications ignited by federated learning (FL) over heterogeneous mobile devices. By revolutionarily overlapping local gradient transmission with continuous local computing, FL can remarkably reduce its training latency over homogeneous clients, yet encounter severe model staleness, model drifts, memory cost and straggler issues in heterogeneous environments. To unleash the full potential of overlapping, we propose, FedEx, a novel \underline{fed}erated learning approach to \underline{ex}pedite FL training over mobile devices under data, computing and wireless heterogeneity. FedEx redefines the overlapping procedure with staleness ceilings to constrain memory consumption and make overlapping compatible with participation selection (PS) designs. Then, FedEx characterizes the PS utility function by considering the latency reduced by overlapping, and provides a holistic PS solution to address the straggler issue. FedEx also introduces a simple but effective metric to trigger overlapping, in order to avoid model drifts. Experimental results show that compared with its peer designs, FedEx demonstrates substantial reductions in FL training latency over heterogeneous mobile devices with limited memory cost.

cs.DC↗

arXiv2025

Scheduling of Flexible Manufacturing Systems Based on Place-Timed Petri Nets and Basis Reachability Graphs

Scheduling is a key decision-making process to improve the performance of flexible manufacturing systems. Place-timed Petri nets provide a formal method for graphically modeling and analyzing such systems. By generating reachability graphs and combining intelligent search algorithms, operation sequences from the initial state to the target state can be found for the underlying system. However, the reachability graph grows exponentially with the system size increases, which is the main challenge of existing methods for scheduling large systems. To this end, we develop an efficient improved beam search algorithm to optimize the makespan based on a compact representation of reachability graph called basis reachability graph. The key idea behind the proposed method is to form a state together with the basis markings and its corresponding transition sequences, and evaluate the cost of the state based on the resource idle time. Experimental results are conducted on several benchmark systems which show that the developed method improves the search efficiency while ensuring the quality of the solution compared with existing methods.

eess.SY↗

arXiv2025

TexPro: Text-guided PBR Texturing with Procedural Material Modeling

In this paper, we present TexPro, a novel method for high-fidelity material generation for input 3D meshes given text prompts. Unlike existing text-conditioned texture generation methods that typically generate RGB textures with baked lighting, TexPro is able to produce diverse texture maps via procedural material modeling, which enables physically-based rendering, relighting, and additional benefits inherent to procedural materials. Specifically, we first generate multi-view reference images given the input textual prompt by employing the latest text-to-image model. We then derive texture maps through rendering-based optimization with recent differentiable procedural materials. To this end, we design several techniques to handle the misalignment between the generated multi-view images and 3D meshes, and introduce a novel material agent that enhances material classification and matching by exploring both part-level understanding and object-aware material reasoning. Experiments demonstrate the superiority of the proposed method over existing SOTAs, and its capability of relighting.

cs.GR↗

arXiv2025

Harnessing self-sensitized scintillation by supramolecular engineering of CsPbBr3 nanocrystals in dense mesoporous template nanospheres

Perovskite-based nanoscintillators, such as CsPbBr3 nanocrystals (NCs), are emerging as promising candidates for ionizing radiation detection, thanks to their high emission efficiency, rapid response, and facile synthesis. However, their nanoscale dimensions - smaller than the mean free path of secondary carriers - and relatively low emitter density per unit volume, limited by their high molecular weight and reabsorption losses, restrict efficient secondary carrier conversion and hamper their practical deployment. In this work, we introduce a strategy to enhance scintillation performance by organizing NCs into densely packed domains within porous SiO2 mesospheres (MSNs). This engineered architecture achieves up to a 40-fold increase in radioluminescence intensity compared to colloidal NCs, driven by improved retention and conversion of secondary charges, as corroborated by electron release measurements. This approach offers a promising pathway toward developing next-generation nanoscintillators with enhanced performance, with potential applications in high-energy physics, medical imaging, and space technologies.

cond-mat.mtrl-sci↗

arXiv2025

Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generation

Recent progress in unified models for image understanding and generation has been impressive, yet most approaches remain limited to single-modal generation conditioned on multiple modalities. In this paper, we present Mogao, a unified framework that advances this paradigm by enabling interleaved multi-modal generation through a causal approach. Mogao integrates a set of key technical improvements in architecture design, including a deep-fusion design, dual vision encoders, interleaved rotary position embeddings, and multi-modal classifier-free guidance, which allow it to harness the strengths of both autoregressive models for text generation and diffusion models for high-quality image synthesis. These practical improvements also make Mogao particularly effective to process interleaved sequences of text and images arbitrarily. To further unlock the potential of unified models, we introduce an efficient training strategy on a large-scale, in-house dataset specifically curated for joint text and image generation. Extensive experiments show that Mogao not only achieves state-of-the-art performance in multi-modal understanding and text-to-image generation, but also excels in producing high-quality, coherent interleaved outputs. Its emergent capabilities in zero-shot image editing and compositional generation highlight Mogao as a practical omni-modal foundation model, paving the way for future development and scaling the unified multi-modal systems.

cs.CV↗

arXiv2025

Softness Ratio of SWIFT Gamma-ray Bursts and Relevant Correlations

The properties of X-ray flashes (XRFs) and X-ray rich gamma-ray bursts (XRRs) as compared with classical gamma-ray bursts (C-GRBs) have been widely discussed during the \emph{Swift} era. It has been proposed that XRFs and XRRs are low-energy extensions of the GRB population so that they should follow similar correlations. To further examine this idea, we collect a sample of $303$ GRBs detected by \emph{Swift} over the past two decades, all of which have reliable redshifts and spectral parameters. The bursts are classified into XRFs, XRRs, and C-GRBs based on their softness ratio (SR), which is calculated by dividing the $25-50$ keV fluence with the $50-100$ keV fluence. A strong correlation is found among the isotropic energy $E_{\mathrm{iso}}$, peak luminosity $L_{\mathrm{p}}$, and rest frame burst duration $T_{90, \mathrm{rest}}$, i.e., $E_{\mathrm{iso}} \propto L_{\mathrm{p}}^{0.88\pm0.02} T_{90, \mathrm{rest}}^{0.58\pm0.02}$. Additionally, two tight three-parameter correlations involving SR and the rest-frame peak energy $E_{\mathrm{p}}$ are also derived, i.e. $E_{\mathrm{p}} \propto E_{\mathrm{iso}}^{0.20\pm0.02} \mathrm{SR}^{-2.27\pm0.15}$ and $E_{\mathrm{p}} \propto L_{\mathrm{p}}^{0.17\pm0.02} \mathrm{SR}^{-2.33\pm0.14}$. It is interesting to note that XRFs, XRRs, and C-GRBs all follow the above correlations. The implications of these correlations and their potential application in cosmology are discussed.

astro-ph.HE↗

arXiv2025

Nonperiodic dynamic CT reconstruction using backward-warping INR with regularization of diffeomorphism (BIRD)

Dynamic computed tomography (CT) reconstruction faces significant challenges in addressing motion artifacts, particularly for nonperiodic rapid movements such as cardiac imaging with fast heart rates. Traditional methods struggle with the extreme limited-angle problems inherent in nonperiodic cases. Deep learning methods have improved performance but face generalization challenges. Recent implicit neural representation (INR) techniques show promise through self-supervised deep learning, but have critical limitations: computational inefficiency due to forward-warping modeling, difficulty balancing DVF complexity with anatomical plausibility, and challenges in preserving fine details without additional patient-specific pre-scans. This paper presents a novel INR-based framework, BIRD, for nonperiodic dynamic CT reconstruction. It addresses these challenges through four key contributions: (1) backward-warping deformation that enables direct computation of each dynamic voxel with significantly reduced computational cost, (2) diffeomorphism-based DVF regularization that ensures anatomically plausible deformations while maintaining representational capacity, (3) motion-compensated analytical reconstruction that enhances fine details without requiring additional pre-scans, and (4) dimensional-reduction design for efficient 4D coordinate encoding. Through various simulations and practical studies, including digital and physical phantoms and retrospective patient data, we demonstrate the effectiveness of our approach for nonperiodic dynamic CT reconstruction with enhanced details and reduced motion artifacts. The proposed framework enables more accurate dynamic CT reconstruction with potential clinical applications, such as one-beat cardiac reconstruction, cinematic image sequences for functional imaging, and motion artifact reduction in conventional CT scans.

cs.CV↗

arXiv2025

MuonSLab: A plastic scintillator based detector for muon measurement in the deep ocean

Atmospheric muons are important probes for studying primary cosmic rays and extensive air showers. Additionally, they constitute a significant background for many underground and deep-sea neutrino experiments, such as TRopIcal DEep-sea Neutrino Telescope (TRIDENT). Understanding the muon flux at various depths in the deep sea is essential for validating TRIDENT simulations and guiding the development of optimized trigger strategies. This paper introduces a novel device based on plastic scintillalors and silicon photomultipliers (SiPMs) named MuonSLab, which is designed to measure muon flux in the deep sea and has the potential to be extended to other atmospheric muon property measurements. We discuss the design and instrumentation of MuonSLab and present results from several muon flux measurements, demonstrating its sensitivity to muon detection and its stability during operations across multiple locations.

hep-ex↗

arXiv2025

EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing

Given a piece of text, a video clip, and a reference audio, the movie dubbing task aims to generate speech that aligns with the video while cloning the desired voice. The existing methods have two primary deficiencies: (1) They struggle to simultaneously hold audio-visual sync and achieve clear pronunciation; (2) They lack the capacity to express user-defined emotions. To address these problems, we propose EmoDubber, an emotion-controllable dubbing architecture that allows users to specify emotion type and emotional intensity while satisfying high-quality lip sync and pronunciation. Specifically, we first design Lip-related Prosody Aligning (LPA), which focuses on learning the inherent consistency between lip motion and prosody variation by duration level contrastive learning to incorporate reasonable alignment. Then, we design Pronunciation Enhancing (PE) strategy to fuse the video-level phoneme sequences by efficient conformer to improve speech intelligibility. Next, the speaker identity adapting module aims to decode acoustics prior and inject the speaker style embedding. After that, the proposed Flow-based User Emotion Controlling (FUEC) is used to synthesize waveform by flow matching prediction network conditioned on acoustics prior. In this process, the FUEC determines the gradient direction and guidance scale based on the user's emotion instructions by the positive and negative guidance mechanism, which focuses on amplifying the desired emotion while suppressing others. Extensive experimental results on three benchmark datasets demonstrate favorable performance compared to several state-of-the-art methods.

cs.SD↗

arXiv2025

Online Video Understanding: OVBench and VideoChat-Online

Multimodal Large Language Models (MLLMs) have significantly progressed in offline video understanding. However, applying these models to real-world scenarios, such as autonomous driving and human-computer interaction, presents unique challenges due to the need for real-time processing of continuous online video streams. To this end, this paper presents systematic efforts from three perspectives: evaluation benchmark, model architecture, and training strategy. First, we introduce OVBench, a comprehensive question-answering benchmark designed to evaluate models' ability to perceive, memorize, and reason within online video contexts. It features 6 core task types across three temporal contexts-past, current, and future-forming 16 subtasks from diverse datasets. Second, we propose a new Pyramid Memory Bank (PMB) that effectively retains key spatiotemporal information in video streams. Third, we proposed an offline-to-online learning paradigm, designing an interleaved dialogue format for online video data and constructing an instruction-tuning dataset tailored for online video training. This framework led to the development of VideoChat-Online, a robust and efficient model for online video understanding. Despite the lower computational cost and higher efficiency, VideoChat-Online outperforms existing state-of-the-art offline and online models across popular offline video benchmarks and OVBench, demonstrating the effectiveness of our model architecture and training strategy. % Our approach surpasses existing state-of-the-art offline models Qwen2-VL 7B and online models Flash-VStream, by 4.19% and 23.7% on OVBench, respectively.

cs.CV↗

arXiv2025

BO-SA-PINNs: Self-adaptive physics-informed neural networks based on Bayesian optimization for automatically designing PDE solvers

Physics-informed neural networks (PINNs) is becoming a popular alternative method for solving partial differential equations (PDEs). However, they require dedicated manual modifications to the hyperparameters of the network, the sampling methods and loss function weights for different PDEs, which reduces the efficiency of the solvers. In this paper, we pro- pose a general multi-stage framework, i.e. BO-SA-PINNs to alleviate this issue. In the first stage, Bayesian optimization (BO) is used to select hyperparameters for the training process, and based on the results of the pre-training, the network architecture, learning rate, sampling points distribution and loss function weights suitable for the PDEs are automatically determined. The proposed hyperparameters search space based on experimental results can enhance the efficiency of BO in identifying optimal hyperparameters. After selecting the appropriate hyperparameters, we incorporate a global self-adaptive (SA) mechanism the second stage. Using the pre-trained model and loss information in the second-stage training, the exponential moving average (EMA) method is employed to optimize the loss function weights, and residual-based adaptive refinement with distribution (RAR-D) is used to optimize the sampling points distribution. In the third stage, L-BFGS is used for stable training. In addition, we introduce a new activation function that enables BO-SA-PINNs to achieve higher accuracy. In numerical experiments, we conduct comparative and ablation experiments to verify the performance of the model on Helmholtz, Maxwell, Burgers and high-dimensional Poisson equations. The comparative experiment results show that our model can achieve higher accuracy and fewer iterations in test cases, and the ablation experiments demonstrate the positive impact of every improvement.

cs.CE↗

arXiv2025

Probing Temperature at Nanoscale through Thermal Vibration Characterization using Scanning Precession Electron Diffraction

Accurate, non-contact temperature measurement with high spatial resolution is essential for understanding thermal behavior in integrated nanoscale devices and heterogeneous interfaces. However, existing techniques are often limited by the need for physical contact or insufficient spatial resolution for the measurement of local temperature and mapping its distribution. Here, we showcase the direct temperature measurement of graphene with nanometer spatial resolution in transmission electron microscopy. In experiments, combining a scanning nanobeam with precession electron diffraction offers the collection of kinemetic diffraction from a local area at the nanometer scale. In analysis, we use a pre-calculated, sample-specific structure-factor-based correction method to enable the linear fitting of the diffraction intensities, allowing the determination of the Debye-Waller factor as a function of temperature at the precision of 10-4Å2/°C. With the high spatial resolution and measurement precision, the temperature and thermal vibration mapping further reveal the influence of graphene lattice parameters and thickness on the Debye-Waller factor, providing valuable insights into the vibrational properties impacted by temperature, lattice structure, and graphene layer thickness.

cond-mat.mtrl-sci↗

arXiv2025

Frequency Dynamic Convolution for Dense Image Prediction

While Dynamic Convolution (DY-Conv) has shown promising performance by enabling adaptive weight selection through multiple parallel weights combined with an attention mechanism, the frequency response of these weights tends to exhibit high similarity, resulting in high parameter costs but limited adaptability. In this work, we introduce Frequency Dynamic Convolution (FDConv), a novel approach that mitigates these limitations by learning a fixed parameter budget in the Fourier domain. FDConv divides this budget into frequency-based groups with disjoint Fourier indices, enabling the construction of frequency-diverse weights without increasing the parameter cost. To further enhance adaptability, we propose Kernel Spatial Modulation (KSM) and Frequency Band Modulation (FBM). KSM dynamically adjusts the frequency response of each filter at the spatial level, while FBM decomposes weights into distinct frequency bands in the frequency domain and modulates them dynamically based on local content. Extensive experiments on object detection, segmentation, and classification validate the effectiveness of FDConv. We demonstrate that when applied to ResNet-50, FDConv achieves superior performance with a modest increase of +3.6M parameters, outperforming previous methods that require substantial increases in parameter budgets (e.g., CondConv +90M, KW +76.5M). Moreover, FDConv seamlessly integrates into a variety of architectures, including ConvNeXt, Swin-Transformer, offering a flexible and efficient solution for modern vision tasks. The code is made publicly available at https://github.com/Linwei-Chen/FDConv.

cs.CV↗

arXiv2025

Collaborative Temporal Consistency Learning for Point-supervised Natural Language Video Localization

Natural language video localization (NLVL) is a crucial task in video understanding that aims to localize the target moment in videos specified by a given language description. Recently, a point-supervised paradigm has been presented to address this task, requiring only a single annotated frame within the target moment rather than complete temporal boundaries. Compared with the fully-supervised paradigm, it offers a balance between localization accuracy and annotation cost. However, due to the absence of complete annotation, it is challenging to align the video content with language descriptions, consequently hindering accurate moment prediction. To address this problem, we propose a new COllaborative Temporal consistEncy Learning (COTEL) framework that leverages the synergy between saliency detection and moment localization to strengthen the video-language alignment. Specifically, we first design a frame- and a segment-level Temporal Consistency Learning (TCL) module that models semantic alignment across frame saliencies and sentence-moment pairs. Then, we design a cross-consistency guidance scheme, including a Frame-level Consistency Guidance (FCG) and a Segment-level Consistency Guidance (SCG), that enables the two temporal consistency learning paths to reinforce each other mutually. Further, we introduce a Hierarchical Contrastive Alignment Loss (HCAL) to comprehensively align the video and text query. Extensive experiments on two benchmarks demonstrate that our method performs favorably against SoTA approaches. We will release all the source codes.

cs.CV↗

arXiv2025

Prosody-Enhanced Acoustic Pre-training and Acoustic-Disentangled Prosody Adapting for Movie Dubbing

Movie dubbing describes the process of transforming a script into speech that aligns temporally and emotionally with a given movie clip while exemplifying the speaker's voice demonstrated in a short reference audio clip. This task demands the model bridge character performances and complicated prosody structures to build a high-quality video-synchronized dubbing track. The limited scale of movie dubbing datasets, along with the background noise inherent in audio data, hinder the acoustic modeling performance of trained models. To address these issues, we propose an acoustic-prosody disentangled two-stage method to achieve high-quality dubbing generation with precise prosody alignment. First, we propose a prosody-enhanced acoustic pre-training to develop robust acoustic modeling capabilities. Then, we freeze the pre-trained acoustic system and design a disentangled framework to model prosodic text features and dubbing style while maintaining acoustic quality. Additionally, we incorporate an in-domain emotion analysis module to reduce the impact of visual domain shifts across different movies, thereby enhancing emotion-prosody alignment. Extensive experiments show that our method performs favorably against the state-of-the-art models on two primary benchmarks. The demos are available at https://zzdoog.github.io/ProDubber/.

cs.SD↗

arXiv2025

On the Stability and Instability of Non-Homogeneous Fluid in a Bounded Domain Under the Influence of a General Potential

We investigate the instability and stability of specific steady-state solutions of the two-dimensional non-homogeneous, incompressible, and viscous Navier-Stokes equations under the influence of a general potential $f$. This potential is commonly used to model fluid motions in celestial bodies. First, we demonstrate that the system admits only steady-state solutions of the form $\left(ρ,\mathbf{V},p\right)=\left(ρ_{0},\mathbf{0},P_{0}\right)$, where $P_0$ and $ρ_0$ satisfy the hydrostatic balance condition $\nabla P_{0}=-ρ_{0}\nabla f$. Additionally, the relationship between $ρ_0$ and the potential function $f$ is constrained by the condition $\left(\partial_{y}ρ_{0}, \partial_{x}ρ_{0}\right)\cdot\left(\partial_{x}f,\partial_{y}f\right)=0$, which allows us to express $\nablaρ_{0}$ as $h\left(x,y\right)\nabla f$. Second, when there exists a point $\left(x_{0},y_{0}\right)$ such that $h\left(x_{0},y_{0}\right)>0$, we establish the linear instability of these solutions. Furthermore, we demonstrate their nonlinear instability in both the Lipschitz and Hadamard senses through detailed nonlinear energy estimates. This instability aligns with the well-known Rayleigh-Taylor instability. Our study signficantly extends and generalizes the existing mathematical results, which have predominantly focused on the scenarios involving a uniform gravitational field characterized by $\nabla f=(0,g)$. Finally, we show that these steady states are linearly stable provided that $h\left(x,y\right)<0$ holds throughout the domain. Moreover, they exhibit nonlinear stability when $h\left(x,y\right)$ is a negative constant.

math.AP↗