arXiv Science⌕ Search

arXiv subjects

Lin Liu

Publications and source records attributed to Lin Liu.

At least 37 records · Page 2Linked to original sources
arXiv2026

LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes

We introduce LLaDA-Image, a unified framework that pairs a 6B Diffusion Transformer (DiT) trained from scratch with a frozen vision-language understanding module built on the LLaDA2.0-Mini diffusion language model backbone. Instead of relying heavily on paired image-text data from the beginning, we first build a strong visual generative prior through image-only pre-training and mid-training. The generation pipeline comprises 220M samples, 98 of which are real images. For efficient and scalable optimization, we use parameter-free RMSNorm throughout the DiT together with the Muon optimizer. The resulting unified model produces highly photorealistic images while accurately following fine-grained editing instructions. We further distill LLaDA-Image into LLaDA-Image-Turbo, enabling fast inference in 2-4 sampling steps. On Qwen-Image-Bench, LLaDA-Image achieves overall scores of 53.53 and 53.38 on the English and Chinese tracks, respectively, setting a new state-of-the-art among open-source models on both tracks. To support further research on capable and efficient generative models, we release our model weights, training code, and detailed recipes.

cs.CV↗
arXiv2026

KORD: Breaking the Key-Generation Bottleneck in Dealerless FSS via Protocol--Hardware Co-Design

Function secret sharing (FSS) has become a core primitive in privacy-preserving computation. However, each FSS invocation requires a fresh pair of function keys generated by a trusted dealer , expands the system's trust boundary and hinders practical deployment. Existing dealerless protocols eliminate this dependency, but incur substantial communication and a number of interaction rounds that grows linearly with the input bit-width, making key generation a major bottleneck. This paper present KORD, a protocol--hardware co-design that dramatically reduces the cost of dealerless FSS key generation. At its core is a pair of special-purpose chips that establish a common root of trust through mutual attestation and, within it, reconstruct FSS keys---eliminating the need for a dealer. This root of trust further forms a security boundary within which KORD restructures the generation protocol, collapsing the interaction of prior dealerless protocols into a single round, independent of GGM depth. A cross-key scheduling scheme then interleaves independent GGM-tree traversals, sustaining high computational throughput. KORD reduces per-key-generation communication by 7,633--70,274$\times$ over the state-of-the-art distributed FSS protocol across a comprehensive suite of FSS building blocks. Post-route analysis projects 12.75 million 32-bit DPF keys per second at 204 MHz using 21.5K LUTs, with 99.8% AES lane utilization. On private ResNet-18 inference, KORD cuts the share of end-to-end time spent on key generation from over 96% to 11.9%.

cs.CR↗
arXiv2026

Formulations of elastodynamic equations for anisotropic multiphase porous piezoelectric media based on global energy conservation

Multiphase porous piezoelectric media are essential for advanced transducers and smart sensors. Existing theories typically postulate Newton's second law for each phase or rely on phenomenological Hamiltonian constructions. The former forces \emph{ad hoc} virtual-mass tensors to describe interphase inertia, while the latter provides no intrinsic safeguard against thermodynamic inconsistency when piezoelectric and multiphase couplings are superposed. In this work, we establish a linear dynamic and constitutive theory for anisotropic multiphase porous piezoelectric media from global energy conservation (GEC). From an abstract energy density functional, Taylor expansion and symmetry constraints derive the standard kinetic and potential energy densities and electric enthalpy, rather than assuming them a priori. Localization of the GEC integral yields the multiphase momentum equations, Gauss's law, the coupled constitutive relations, and the boundary conditions as mathematical corollaries, without invoking Newton's law or Hamilton's principle. The framework eliminates virtual-mass parameters entirely: interphase inertial coupling emerges organically from the off-diagonal kinetic-energy coefficients $ρ_{ij}^{αβ}$. Because all coefficients derive from a single smooth potential, Schwarz's theorem automatically guarantees Maxwell reciprocity and full thermodynamic self-consistency. The formulations agree with those from Hamilton's principle and reduce exactly to Biot's poroelastic theory and Tiersten's single-phase piezoelectric theory in the respective limits. Finally, linear plane-wave analysis produces a generalized Christoffel eigenvalue equation, and numerical phase-velocity calculations for water-saturated porous PZT-2 illustrate the modal structures and reveal strongly directional electromechanical coupling.

physics.gen-ph↗
arXiv2026

On computing and the complexity of computing higher-order $U$-statistics, exactly

Higher-order $U$-statistics abound in fields such as statistics, machine learning, and computer science, but are known to be highly time-consuming to compute in practice. Despite their widespread appearance, a comprehensive study of their computational complexity is surprisingly lacking. This paper aims to fill this gap by presenting several results related to the computational aspect of $U$-statistics. First, we derive a useful decomposition from a $m$-th order $U$-statistic to a linear combination of $V$-statistics with orders not exceeding $m$, which are generally more feasible to compute. Second, we explore the connection between exactly computing $V$-statistics and Einstein summation, a tool often used in computational mathematics and quantum computing to accelerate tensor computations. Third, we provide an optimistic estimate of the time complexity for exactly computing $U$-statistics, based on the treewidth of a particular graph associated with the $U$-statistic kernel. The above ingredients lead to (1) a new, much more runtime-efficient algorithm to exactly compute general higher-order $U$-statistics, and (2) a more streamlined characterization of runtime complexity of computing $U$-statistics. We develop an accompanying open-source package called \texttt{u-stats} in both Python (https://github.com/zrq1706/U-Statistics-Python) and R (https://github.com/cxy0714/U-Statistics-R). We demonstrate through three examples in statistics that \texttt{u-stats} achieves impressive runtime performance compared to existing benchmarks. This paper also aspires to achieve two goals: (1) to capture the interest of researchers in both statistics and other related areas to further advance the algorithmic development of $U$-statistics and (2) to lift the burden of implementing higher-order $U$-statistics from practitioners.

stat.ML↗
arXiv2026

Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition

Micro-expressions are subtle facial movements that occur spontaneously when people try to conceal real emotions. Micro-expression recognition is crucial in many fields, including criminal analysis and psychotherapy. However, micro-expression recognition is challenging since micro-expressions have low intensity and public datasets are small in size. To this end, a three-stream temporal-shift attention network based on self-knowledge distillation is proposed in this paper. Firstly, to address the low intensity of muscle movements, we utilize learning-based motion magnification modules to enhance the intensity of muscle movements. Secondly, we employ efficient channel attention modules in the local-spatial stream to make the network focus on facial regions that are highly relevant to micro-expressions. In addition, temporal shift modules are used in the dynamic-temporal stream, which enables temporal modeling with no additional parameters by mixing motion information from two different temporal domains. Furthermore, we introduce self-knowledge distillation into the micro-expression recognition task by introducing auxiliary classifiers and using the deepest section of the network for supervision, encouraging all blocks to fully explore the features of the training set. Finally, extensive experiments are conducted on five publicly available micro-expression datasets. The experimental results demonstrate that our network outperforms other existing methods and achieves new state-of-the-art performance. Our code is available at https://github.com/GuanghaoZhu663/SKD-TSTSAN.

cs.CV↗
arXiv2026

Toward a Semiparametric Efficiency Theory under Equality Constraints in Nested Markov Models

Probabilistic models of Directed Acyclic Graphs (DAGs) with latent variables impose equality constraints on the observed data distribution beyond ordinary conditional independencies. These so-called Verma constraints arise in nested Markov models associated with Acyclic Directed Mixed Graphs, the latent projection of latent-variable DAGs. While nested Markov models have been extensively studied from the perspectives of graphical representation and causal identification, their implications for semiparametric efficiency theory remain less understood. We develop results toward establishing a semiparametric framework for statistical models defined by Verma constraints. Our key observation is that nested Markov constraints admit weighted conditional-moment representations under post-fixing distributions induced by graphical fixing operations. We show that fixing induces weighted orthogonality relations in L2(P), thereby converting Verma constraints into explicit tangent-space restrictions. Building on this representation, we characterize the tangent-space orthocomplement for models defined by a single nested Markov constraint through residualized weighted moment functions. This geometric formulation yields Hilbert-space characterizations of semiparametric efficient influence functions and efficiency bounds via orthogonal projection and equivalent minimum-variance formulations. We further discuss extensions to models involving multiple nested Markov constraints, for which we characterize a subspace of the orthocomplement as sums of the corresponding weighted orthogonality relations, while leaving the complete tangent-space characterization open. More broadly, our results connect nested graphical structure with semiparametric Hilbert-space geometry and provide a foundation for a general efficiency theory for nested Markov models. We illustrate the framework through several latent-variable DAGs.

stat.ME↗
arXiv2026

Average Treatment Effect Estimation with Non-binary Instrumental Variables

Non-binary instrumental variables, especially continuous ones, are common in practice. A binary recoding induces a Wald ratio but may discard useful variation and reduce efficiency. Although fully nonparametric approaches can in principle use the entire instrument, they often require high-dimensional nuisance estimation which can be unstable with rich covariates. We address this problem by developing a generalized Wald estimand for binary treatments that uses the full variation in a non-binary instrument. Under standard instrumental-variable assumptions and a homogeneity condition, the estimand yields a common identification formula for categorical and continuous instruments. We further develop its semiparametric efficiency theory and construct a locally efficient debiased estimator using risk-minimization reparameterizations and double cross-fitting to accommodate flexible machine learning while improving numerical stability. The central technical challenge is that the many Wald ratios generated by a non-binary instrument must agree, thereby imposing overidentifying restrictions on the observed-data law. In this setting, characterizing the tangent space is nonstandard: it requires a second-order parametric submodel, a construction that, to our knowledge, has not been standard in semiparametric efficiency theory. Simulations show stable performance across sample sizes and greater efficiency than estimators based on dichotomized instruments. In an application to the Princess Margaret Cancer Centre lung cancer cohort, associational analyses link excess body weight to lower two-year mortality, a seemingly protective pattern often called the obesity paradox. The proposed instrumental-variable analysis instead suggests increased mortality, pointing to residual confounding behind this paradox.

stat.ME↗
arXiv2026

Transportable Causal Effect Estimation across Networks under Interference

Estimating causal effects under network interference typically assumes that the network used for training and the network used for deployment coincide. In practice, an intervention is run on one population while the question of interest concerns a different population, and the two generally differ in topology, node-covariate composition, and spillover pathways. Transporting a causal effect across networks is therefore a data-fusion problem that no existing algorithm solves. We employ a selection diagram, extended to the network setting so that covariate shift and structural network shift enter as separate selectors, and derive from it a transport formula for the direct, spillover, and total effects in the deployment population. Each formula makes explicit which interventional mechanism is assumed invariant and which observational distribution must be reweighted. We then turn the formulas into TranCE (Transported Causal Effects), a doubly-robust algorithm combining an interventional outcome model, a domain density-ratio correction, and cross-fitted inference. Extensive experiments on two semi-synthetic benchmarks derived from real-world social networks and on a fully real weather-insurance field experiment, where the transported effects are checked against held-out randomized estimates, confirm the effectiveness of our approach. Our findings have the potential to improve intervention strategies in networked systems, particularly in social networks and public health.

cs.LG↗
arXiv2026

DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver

Video object removal frequently struggles to eliminate target objects and their associated complex physical effects (e.g., smoke and light) in real-world scenes. We attribute this challenge to a fundamental semantic--pixel conflict, which manifests at two aspects: condition-level modality dissonance and optimization-level objective entanglement. In terms of conditioning, modality dissonance emerges from single-modality information incompleteness and cross-modal dominance imbalance. During optimization, two conflicting objectives---high-level semantic erasure and pixel-level background preservation---are inextricably entangled within a single model. To address these conflicts, we propose DualEraser, a novel framework for joint video object and effect removal. First, a Bipartite Text prompt and a Multi-Conditional Capability Elicitation (MCCE) mechanism explicitly inject effect semantics and further leverage multimodal priors to address the limitations of individual modalities. Second, a Learnable Deep CFG Fusion (LD-CFG) module adaptively balances the relative dominance between the text and mask conditions. Finally, we introduce a decoupled expert architecture comprising a Locator for semantic erasure and a Preserver for background pixel alignment to break the objective entanglement. Extensive experiments demonstrate that DualEraser achieves state-of-the-art quantitative performance on standard benchmarks (e.g., gains of 2.16 dB and 1.44 dB on ROSE and VOR-Eval, respectively), while enabling robust removal of complex effects in open-world videos. https://cyqii.github.io/DualEraser.github.io/

cs.CV↗
arXiv2026

MVFM-3DAD: Multi-view Flow Matching for 3D Anomaly Detection via Density Proxy Estimation

In 3D anomaly detection (3DAD), most existing methods rely on Memory bank retrieval or reconstruction. However, memory-based methods are constrained by the coverage of stored normal features, while reconstruction-based methods may learn identity shortcuts that also reconstruct anomalous inputs well. These limitations motivate a density-oriented approach that evaluates whether a test sample follows the learned normal distribution. To this end, we propose MVFM-3DAD, a flow-based framework that reframes 3DAD as density proxy estimation over the normal data distribution. MVFM-3DAD introduces a Bidirectional Geometric Projector (BGP), whose forward process converts irregular point clouds into structured multi-view representations. The Flow-guided Density Proxy Estimator (FDPE) estimates a reference density for each view feature, after which the backward process of BGP maps these multi-view density estimates to their corresponding 3D points. Building on it, anomalous features can be identified by their terminal normality. Unlike conventional flow-based likelihood estimation, our formulation requires neither input reconstruction nor explicit Jacobian evaluation, yielding a simple and efficient anomaly-scoring mechanism. Extensive experiments show that MVFM-3DAD outperforms the strongest competing methods on Real3D-AD and MVTec3D-AD. Code is available at https://github.com/lil-wayne-0319/MV3D-AD

cs.GR↗
arXiv2026

Geometric phase-space nonseparability triggers giant optical shifts

Nonseparability among multiple degrees of freedom has enabled fundamental advances in structured light and related applications. Here we unveil a previously overlooked form of nonseparability in phase space, which we term geometric phase-space nonseparability. The latter arises solely from the wavefront curvature of a conventional wave packet, such as a fundamental Gaussian beam. This phase-space structure manifests as a position-dependent transverse-momentum distribution across the beam profile leading to the giant spatial and angular beam shifts upon reflection at a planar interface that we predict analytically and observe experimentally. Remarkably, the curvature-induced phase-space correlation remains robust against spatial-coherence degradation, allowing the giant shifts to persist even in the nearly incoherent regime. Our results establish wavefront curvature as a general mechanism for engineering beam shifts across optical, acoustic, and matter-wave systems.

physics.optics↗
arXiv2026

IDATA: Scalable Invertible Diffusion for Unrestricted Adversarial Transfer Attack

Unrestricted adversarial transfer attacks are important for evaluating the black-box robustness of deep visual models. Diffusion-based attacks have shown promising transferability and visual imperceptibility by optimizing adversarial perturbations along denoising trajectories in latent space. However, existing methods are limited by two challenges: memory-intensive multistep backpropagation and frequency-agnostic perturbation over intermediate latents. To address these issues, we propose IDATA, a memory-efficient diffusion framework for unrestricted adversarial transfer attack. IDATA consists of two key components: an Invertible Diffusion Module (IDM) and a Low-Frequency Constraint Module (LFCM). Specifically, IDM reformulates adversarial optimization over diffusion trajectories as an invertible process, enabling constant-memory backpropagation through on-demand reconstruction of intermediate states instead of storing the full denoising chain. Moreover, LFCM leverages Discrete Wavelet Transform (DWT) to decompose latent variables into low- and high-frequency components, restricting perturbations to semantically stable low-frequency subspaces, thereby improving transferability while preserving visual imperceptibility. Extensive experiments on multiple benchmarks and diverse model architectures demonstrate that IDATA consistently outperforms state-of-the-art baselines in attack success rate, memory efficiency, and visual imperceptibility. These results suggest that IDATA is a promising tool for black-box robustness evaluation of deep visual models. Code is available at https://github.com/colourful-pan/IDATA.

cs.CV↗
arXiv2026

Toward an Asymptotic Efficiency Theory on Regular Parameter Manifolds

Asymptotic efficiency theory is one of the pillars in the foundations of modern mathematical statistics. Not only does it serve as a rigorous theoretical benchmark for evaluating statistical methods, but it also sheds light on how to develop and unify novel statistical procedures. For example, the calculus of influence functions has led to many important statistical breakthroughs in the past decades. Responding to the pressing challenge of analyzing increasingly complex datasets, particularly those with non-Euclidean/nonlinear structures, many novel statistical models and methods have been proposed in recent years. However, the existing efficiency theory is not always readily applicable to these cases, as the theory was developed, for the most part, under the often neglected premise that both the sample space and the parameter space are normed linear spaces. As a consequence, efficiency results outside normed linear spaces are quite rare and isolated, obtained on a case-by-case basis. This paper aims to develop a more unified asymptotic efficiency theory, allowing the sample space, the parameter space, or both to be Riemannian manifolds satisfying certain regularity conditions. We build a vocabulary that helps translate essential concepts in efficiency theory from normed linear spaces to Riemannian manifolds, such as (locally) regular estimators, differentiable functionals, etc. Efficiency bounds are established under conditions parallel to those for normed linear spaces. We also demonstrate the conceptual advantage of the new framework by applying it to two concrete examples in statistics: the population Frechet mean and the regression coefficient vector of Single-Index Models.

math.ST↗
arXiv2026

Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length

Audio-driven avatar interaction demands real-time, streaming, and infinite-length generation -- capabilities fundamentally at odds with the sequential denoising and long-horizon drift of current diffusion models. We present Live Avatar, an algorithm-system co-designed framework that addresses both challenges for a 14-billion-parameter diffusion model. On the algorithm side, a two-stage pipeline distills a pretrained bidirectional model into a causal, few-step streaming one, while a set of complementary long-horizon strategies eliminate identity drift and visual artifacts, enabling stable autoregressive generation exceeding 10000 seconds. On the system side, Timestep-forcing Pipeline Parallelism (TPP) assigns each GPU a fixed denoising timestep, converting the sequential diffusion chain into an asynchronous spatial pipeline that simultaneously boosts throughput and improves temporal consistency. Live Avatar achieves 45 FPS with a TTFF of 1.21\,s on 5 H800 GPUs, and to our knowledge is the first to enable practical real-time streaming of a 14B diffusion model for infinite-length avatar generation. We further introduce GenBench, a standardized long-form benchmark, to facilitate reproducible evaluation. Our project page is at https://liveavatar.github.io/.

cs.CV↗
arXiv2026

BeCARE: Budgeted Cache Refresh for Diffusion Transformer Acceleration

Training-free feature caching accelerates diffusion transformer (DiT) inference by reusing or forecasting intermediate features. However, fixed schedules make compute predictable but ignore prompt- and timestep-dependent risk, whereas hand-tuned error thresholds adapt locally but leave realized compute difficult to control. To address these limitations, we present Budgeted Cache Refresh (BeCARE), a training-free framework that, given a user-specified cap on full computations, adaptively determines when to refresh the cache during accelerated inference. Specifically, we first derive an error-amplification profile from the sampler's noise schedule to characterize the varying impact of approximation errors across denoising timesteps. We then combine this profile with prompt-specific extrapolation residuals and cache age to form an accumulated risk score, triggering a refresh when continued caching becomes harmful. Meanwhile, we use the same profile to construct an analytic spending reference and adjust the refresh threshold through feedback, thereby distributing the limited refresh budget over the sampling trajectory. Finally, structural safeguards (a fixed warmup, a budget-derived late-stage reserve, and a maximum cache-reuse length) prevent unreliable extrapolation and premature budget exhaustion. These designs enable prompt-adaptive refresh placement and allow a single calibration to transfer across budget tiers without per-tier tuning. Experiments on FLUX.1-dev with 200 prompts and measured FLOPs show that our method consistently outperforms representative training-free caching baselines across speedups from 3x to 6x. At the main operating point (3.3x acceleration), it improves paired PSNR by 2.7 dB over the strongest baseline using no more compute. On SD3.5 Large, it also substantially improves the same Taylor cache engine over fixed-interval scheduling at matched compute.

cs.CV↗
arXiv2026

Residual-Guided Multi-Resolution Refinement of Foundation Models: A Case Study in Drought Forecasting

Regional climate prediction presents unique challenges for time series foundation models, which typically process temporal patterns through single-pass inference. Expert climatologists, in contrast, employ multi-scale temporal analysis and iterative refinement based on systematic error diagnosis. We present RGMR (Residual-Guided Multi-Resolution Refinement), an inference-time framework that adapts pre-trained foundation models to perform structured coarse-to-fine refinement for climate forecasting without updating backbone parameters. Applied to drought forecasting using the Standardized Precipitation Evapotranspiration Index (SPEI), RGMR is architecture-agnostic across the three TSFM backbones evaluated per site (TimesFM, TimeGPT, TabPFN) and consistently lowers test-set MSE on three South Australian sites and three additional regions outside South Australia. Applied to TimesFM, the wrapper reduces one-month-ahead SPEI MSE by up to 18.9\% across the three South Australian sites (mean reduction $\approx$18.7\%). Overall, RGMR provides a practical route for deploying frozen TSFMs in regional climate forecasting workflows.

cs.LG↗
arXiv2026

FlexRC: A Flexible Multi-Point Model Order Reduction Method for Many-Port RC Networks

Efficient model order reduction for many-port resistor-capacitor (RC) networks is essential in post-layout circuit simulation. Existing high-accuracy elimination-based methods have certain limitations, such as fixed frequency points, large reduced-order models, or high reduction cost. This paper proposes FlexRC, a flexible multi-point model order reduction method for many-port RC networks. FlexRC starts from the same elimination step as previous methods, and then constructs a nonorthogonal projection basis by a modified block rational Arnoldi process to generate a sparse banded reduced model. FlexRC features three adjustable components: user-specified frequency points, a tolerance-controlled port-reduction technique for the internal subsystem, and an optional sparsity-control strategy. We discuss passivity under port-reduction perturbations, analyze moment matching, and provide a conservative error estimate for port reduction. Numerical experiments on industrial RC examples and IBM power-grid examples demonstrate the effectiveness of FlexRC in terms of reduction time and transient simulation time.

eess.SY↗
arXiv2026

Gradient-Flow Optimization as Dynamic Random-Effects Inference: Testing and Early Stopping with Applications to Deep Learning

Gradient-flow optimization is usually viewed as an algorithmic procedure for minimizing empirical loss, with training duration selected by validation or heuristic early stopping rules. We develop a statistical inference framework for gradient-flow training. We show that whenever fitted values evolve through a time-invariant positive semidefinite training operator, the output at each time is equivalent to the best linear unbiased predictor under a corresponding random-effects model. Training time then becomes a variance-component parameter governing variance reallocation from residual noise to structured signal. This turns two training decisions into inferential problems: whether training is needed becomes a variance-component test for signal beyond initialization, and how long to train becomes restricted maximum likelihood (REML) estimation of the training-time variance component. We show that the REML-guided early stopping rule selects the time at which optimized spectral losses become decorrelated from the training-operator eigenvalues. The asymptotic prediction optimality of the REML-guided early stopping time is established for fixed-design in-sample risk and random-design out-of-sample risk. Deep learning models in fixed-kernel gradient regimes provide canonical instantiations for our results. Numerical experiments and a UK Biobank proteomics application show competitive accuracy of the REML-guided early stopping time with reduced reliance on validation splits and repeated checkpoint evaluation.

stat.ML↗