arXiv Science⌕ Search

arXiv subjects

Jie Tang

Publications and source records attributed to Jie Tang.

At least 37 records · Page 2Linked to original sources

Gaussian Belief Propagation Network for Depth Completion

Depth completion aims to predict a dense depth map from a color image with sparse depth measurements. Although deep learning methods have achieved state-of-the-art (SOTA), effectively handling the sparse and irregular nature of input depth data in deep networks remains a significant challenge, often limiting performance, especially under high sparsity. To overcome this limitation, we introduce the Gaussian Belief Propagation Network (GBPN), a novel hybrid framework synergistically integrating deep learning with probabilistic graphical models for end-to-end depth completion. Specifically, a scene-specific Markov Random Field (MRF) is dynamically constructed by the Graphical Model Construction Network (GMCN), and then inferred via Gaussian Belief Propagation (GBP) to yield the dense depth distribution. Crucially, the GMCN learns to construct not only the data-dependent potentials of MRF but also its structure by predicting adaptive non-local edges, enabling the capture of complex, long-range spatial dependencies. Furthermore, we enhance GBP with a serial \& parallel message passing scheme, designed for effective information propagation, particularly from sparse measurements. Extensive experiments demonstrate that GBPN achieves SOTA performance on the NYUv2 and KITTI benchmarks. Evaluations across varying sparsity levels, sparsity patterns, and datasets highlight GBPN's superior performance, notable robustness, and generalizable capability.

cs.CV↗

ReST-RL: Reinforcing LLM Reasoning through Unified Self-Training and Value-Guided Search

With respect to improving the reasoning accuracy of LLMs, the representative reinforcement learning (RL) method - Group Relative Policy Optimization (GRPO) - has achieved critical success, yet it still suffers from the issue of insignificant reward signals. This paper introduces ReST-RL, a unified Reinforced Self-Training (ReST) policy-value framework that reconnects policy optimization and value-guided search to improve LLM reasoning ability. Firstly, ReST-GRPO adopts an optimized ReST-style algorithm to reshape the policy-induced trajectory distribution by increasing the reward variance of GRPO sampling and exposing the policy to more informative partial states, thereby improving training efficiency and effectiveness. Then, we further introduce a decoding optimization method, VM-MCTS, which trains a Value Model (VM) from self-collected Monte-Carlo Tree Search (MCTS) targets and deploys it through an adapted MCTS algorithm to provide precise process signals and verification scores, further enhancing reasoning accuracy. These two stages are internally dependent - ReST-GRPO yields higher-quality trajectories for value learning with VM-MCTS, which in turn enables more effective inference-time search. We validate our framework on multiple coding benchmarks (e.g., APPS, BigCodeBench, and HumanEval), where it significantly outperforms other reinforcement training baselines (naive GRPO, DAPO, and ReST-DPO), as well as decoding and verification baselines (e.g., PRM-BoN and ORM-MCTS), indicating its power to strengthen LLM reasoning capability. Moreover, we further evaluate ReST-RL on out-of-domain math and science reasoning tasks, where it achieves improved performance without target-domain tuning and favorable end-to-end efficiency trade-offs, providing preliminary transfer evidence beyond our primary coding domain.

cs.AI↗

Separating Stream Stability from Long-Term Recall in Language Models

Methods for streaming language models are often discussed alongside long-context and memory systems, although they solve different problems. An attention sink can stabilize autoregressive generation over an indefinitely long stream while the model remains unable to use content that has left its recent-token cache. We argue that this distinction should be explicit in system claims and evaluation. We introduce three horizons: the stability horizon, over which predictive behavior remains well behaved; the access horizon, over which past content can still causally affect the output; and the utility horizon, over which a task retains acceptable performance. We show constructively that the stability horizon can be infinite while the access and utility horizons are finite. We then propose ThreeH, an evaluation contract that measures all three horizons under a common state and compute budget. Applying the framework to attention-sink streaming clarifies its strength, constant-memory, stable generation, without treating anchor tokens as semantic memory. The framework exposes roles for cache policies, recurrent state, retrieval, and external memory. Experiments on 128K-token streams, delayed binding recall, and delayed decisions show that attention sinks preserve local modeling but not content beyond the active cache; recurrent and retrieval state extend the semantic horizon.

cs.CL↗

Reconfiguring Sparse Apertures: Partial-Mobility Planar FAS for 2-D DOA Estimation

Classical sparse arrays enlarge the sensing aperture under limited element and radio-frequency (RF) chain budgets, but their fixed geometries impose a persistent tradeoff between wide-sector identifiability and local angular resolution. This paper converts this static design into a two-state reconfigurable sparse aperture by allowing only part of a planar fluid antenna system (FAS) to move after an initial observation. A compact, Nyquist-spaced seed first provides an ambiguity-controlled acquisition geometry. The remaining fluid ports then move or switch to information-efficient refinement positions, and the measurements collected before and after reconfiguration are jointly processed. We formulate the receiver under fixed total numbers of ports and RF chains, a movement budget, and a common total-snapshot budget. A policy-level Fisher information matrix (FIM) identity accounts for the observation-dependent refinement geometry. For a single source, a relaxed planar D-optimal analysis gives the corner-favoring aperture law, while a finite-port certificate bounds the information retained under spacing, reachability, and partial-actuation constraints. For multiple sources, an aperture-and-conditioning surrogate generates feasible sparse layouts that are ranked and locally refined using the exact frame FIM with coarray, spacing, and movement regularization. Seed multiple signal classification (MUSIC) identifies a reliable angular basin, followed by joint concentrated-likelihood refinement over both states. Equal-budget simulations show that reconfiguring a sparse aperture converts available area and movement into lower angular error and retains much of the all-movable gain with fewer actuated ports. They also identify the operating boundary: if a full sparse aperture can remain permanently deployed, avoiding movement and snapshot splitting can be preferable.

eess.SP↗

Sparse Channel Acquisition in Aging Fluid Antenna Systems: A Reliability-Calibrated Posterior Reconstruction Approach

Fluid antenna systems (FASs) exploit port-domain diversity within a compact aperture, but their gain can be lost if the receiver has to scan too many ports before data transmission. This paper studies sparse channel acquisition for aging FAS receivers, where the available information has mixed reliability: current observations are fresh but sparse, whereas historical channel state information (CSI) is dense but stale due to Doppler-induced temporal decorrelation. We formulate the problem from a communication perspective by linking aperture-field reconstruction to port-selection rate, outage, probing budget, and online inference latency. We then cast the acquisition task as reliability-calibrated posterior reconstruction, in which the sparse current observations serve as hard measurement evidence and historical CSI is reused only as soft temporal side information. The resulting reliability-controlled conditional diffusion posterior (DCP) framework conditions the denoising process on the sparse current observations, the observation mask, and the historical CSI, and refines the reverse trajectory through observation consistency, mismatch-aware temporal gating, spatial trust weighting, progressive temporal activation, and warm initialization. Analysis shows how aging and reconstruction error induce rate distortion and rate regret. Simulations across probing budgets, signal-to-noise ratios (SNRs), temporal correlations, observation patterns, ablation settings, and latency tests show consistent reconstruction gains with millisecond-level online inference latency, indicating that stale CSI can be beneficial when its strength, timing, and spatial support are explicitly controlled.

eess.SP↗

Conformalized Large Language Models under Configuration Shift

Conformal prediction (CP) is a distribution-free framework for uncertainty quantification that has recently been adapted to large language models (LLMs), providing prediction sets with finite-sample coverage guarantees under exchangeability. Yet for LLMs, nonconformity scores are often induced by an inference pipeline, not just a fixed model, making them depend not only on the data distribution but also on configurable factors such as the prompt template, decoding parameters, and deployment setting. Since such configurations are routinely modified in practice but rarely treated as a source of shift, their impact on CP validity remains poorly understood. We call this \emph{configuration shift} and study it systematically along three axes: prompt template, decoding temperature, and weight quantization. In a broad empirical study spanning $9$ LLMs, $4$ datasets, and $4$ nonconformity scores, we find that configuration shift consistently erodes CP validity, often driving empirical coverage below the target. By contrast, efficiency is largely preserved: valid prediction sets remain close in size to the i.i.d. baseline. We derive coverage lower bounds that attribute this loss to a discrepancy between calibration and test score distributions, and use their finite-sample plug-in versions as empirical diagnostics of shift severity. We further show that these findings lead to practical mitigations: bound-inspired recalibration is effective with limited test examples, while fragility-aware calibration ensembling recovers much of the lost coverage without test data.

cs.LG↗

AWM: Answerable Working Memory for Long-Document VQA Agents

Long-document visual question answering increasingly relies on VLM agents that retrieve candidate pages, inspect page images, write findings to working memory, and synthesize answers. Working memory should carry answer-supporting evidence across page inspections for later grounded answering, yet existing evaluation mainly checks final-answer correctness and evidence-page access. This creates a memory-quality blind spot: an agent may reach the right page and answer correctly while leaving behind memory too generic or incomplete to support answering once page context is removed. We introduce \emph{memory-only answerability}, a diagnostic that asks whether a reader can answer from the question and terminal working memory alone. Building on this diagnostic, \emph{Answerable Working Memory} (AWM) treats terminal working memory as an answerable evidence artifact, and AWM-GRPO incorporates this signal into the GRPO reward while preserving final-answer priority. Under GRPO, this reward assigns higher advantages to answer-correct trajectories whose terminal working memory remains answerable. On \textsc{MMLongBench-Doc}, even when gold evidence pages are provided, 42.5\% of correct answers still cannot be answered from terminal working memory alone. AWM-GRPO improves final-answer accuracy over the RAG baseline by 8.1 and 11.9 points on \textsc{MMLongBench-Doc} and \textsc{LongDocURL} and reduces the memory-missing-correct rate by 2.7 points over answer-only GRPO.

cs.CL↗

Electromagnetic Twin: From Sparse Measurements to Persistent Wireless Intelligence

Radio maps and channel knowledge maps provide reusable propagation knowledge, but a stored map can become locally outdated after persistent changes to doors, partitions, furniture, large equipment, or infrastructure. Motivated by digital-twin state synchronization, we develop an electromagnetic twin that recurrently converts sparse channel measurements into a persistent wireless state, exposes that state to communication queries, and uses its uncertainty to request subsequent measurements. The twin tracks persistent or semi-persistent propagation changes rather than transient human motion or fast fading. Each update is a constrained inverse problem that combines the previous map, a scene graph, and an imperfect physics prior. Measurement consistency with a confidence-calibrated radius and physical gain bounds enforce feasibility, while scene-aware spatial regularization and selective temporal memory preserve propagation boundaries and unchanged regions. Successive convex approximation (SCA), majorization--minimization alternating direction method of multipliers (MM-ADMM), and a low-complexity primal--dual hybrid gradient (LC-PDHG) mode realize the framework at different computational scales, and a local perturbation analysis gives an explicit multi-update tracking recursion. The updated state supports access-point association and codebook beam selection, while change-weighted A-optimal design closes the measurement--update--query loop. Over 500 realizations, the recurrent update remains stable through eight persistent scene events and raises best-beam accuracy from $76.64\%$ to $90.83\%$ as measured-location density grows from $2\%$ to $16\%$.

eess.SP↗

Electromagnetic Twin: Completing the Wireless World from Sparse Channel Evidence

Acquiring dense channel information over many locations and beams incurs considerable pilot and processing overhead. Radio maps and channel knowledge maps (CKMs) reduce this overhead by reusing site-specific channel information, but their contents must be refreshed when new measurements or environmental observations become available. This paper introduces an \emph{electromagnetic twin} as an updatable digital representation that uses sparse channel evidence to reconstruct the wireless state requested by communication queries. Rather than replacing radio maps or CKMs, the twin uses a CKM as channel memory, combines it with registered scene information, and regenerates its outputs after each evidence update. We instantiate this idea by completing a two-dimensional channel-gain field from sparse samples and an incomplete floor plan. A learned RF completion backbone recovers the main propagation structure, and a lightweight residual adapter tests whether frozen CLIP features provide useful side information. With $4\%$ measured locations and $55\%$ missing semantic objects, the RF backbone attains $4.44$ dB RMSE, compared with $8.29$ dB for CKM interpolation and $8.38$ dB for an incomplete physics prior. Residual adaptation reduces RMSE by a paired mean of $0.135$ dB (95\% confidence interval: $0.100$--$0.169$ dB), but a same-capacity random-feature control is statistically indistinguishable from the CLIP-conditioned adapter. The results therefore support the measurement--update--query loop and lightweight residual correction, while avoiding an unsupported attribution of the correction to visual semantics.

eess.SP↗

From Sparse Probes to Sum-Rate Maximization: Electromagnetic Twin Beamforming

Probing every candidate location at each wireless-map update is costly. This letter develops electromagnetic-twin (ET) beamforming that converts sparse spatial probes into a sum-rate decision. The ET stores a location-dependent angular power spectrum, updates its innovation through graph-regularized estimation, and queries user covariances for projected beam optimization. A rate-sensitivity bound selects subsequent probes by query-weighted posterior-variance reduction. With 1\% random probes, ET beamforming achieves $2.69$ bit/s/Hz versus $1.12$ for a static channel knowledge map; with 7\% query-aware probes, it reaches $3.03$ bit/s/Hz, within 3.4\% of perfect-covariance beamforming.

eess.SP↗

TideRL: Boosting Agentic RL Goodput with Readiness-Aware Scheduling

Reinforcement learning (RL) for large language models is moving toward multi-turn agentic workloads, where rollout tasks repeatedly pause for external environments, resume with growing contexts, and finish at highly variable times. In this setting, RL training goodput, measured by training throughput, matters more than raw GPU occupancy: GPU waiting and repeated prefill recomputation are pure overhead. We present TideRL, a readiness-aware elastic RL system with Continuous Task Batching, Resource-Aware Ref-Actor Pipelining, and Elastic Resource Scaling. CTB preserves useful rollout state, $\textrm{RA}^2\textrm{P}$ selects between decoupled streaming and colocated aggregation from the ready backlog and arrival interval, and ERS moves ranks between rollout and training using the same readiness signals. Across text-only and multi-modal agentic workloads, TideRL improves RL training goodput by up to 5.6$\times$ over synchronous baselines and over 33% over asynchronous baselines, while reaching similar task performance. It also improves KV cache hit rate by 1.58$\times$, reduces per-step training time by up to 44.3%, and cuts total waiting time by up to 77.6%.

cs.LG↗

Timescale-dependent Optical Variability of Turn-on Changing-look Active Galactic Nuclei

Changing-look active galactic nuclei (CL AGNs) provide a valuable opportunity to study optical variability associated with changes in accretion state. We investigate the optical variability of turn-on CL AGNs, selected through the emergence or strengthening of broad emission lines, using g-band light curves from the Zwicky Transient Facility. For a final sample of 106 objects, we measure structure-function amplitudes at three fixed rest-frame timescales, SF30, SF150 and SF300, and examine their dependence on optical luminosity, Eddington ratio, black-hole mass and rest-frame wavelength using Spearman-rank correlations and multivariate regressions. The strongest trends are found on monthly timescales. SF30 is significantly anti-correlated with both optical luminosity and Eddington ratio, with Spearman coefficients of rho = -0.39 and rho = -0.33, respectively. These negative trends remain in multivariate regressions after accounting for black-hole mass and rest-frame wavelength. The dependence weakens at longer timescales: SF150 shows only weak evidence for luminosity or Eddington-ratio dependence, while SF300 shows no robust dependence. Black-hole mass shows no robust single-parameter correlation, and its multivariate coefficients depend on the model form, indicating that its apparent role is affected by covariance with luminosity and Eddington ratio. The rest-frame wavelength term is generally negative, but cannot be separated from redshift in this single-band analysis. These results suggest that monthly optical variability in turn-on CL AGNs is more closely linked to bright-state accretion properties than variability on half-year to year-long timescales.

astro-ph.GA↗

SurveyReview: A Reviewer-Aligned Benchmark for Survey Evaluators

The rapid advancement of large language models has transformed survey writing from a months-long manual effort into an automated process. As generation scales, reliable evaluation becomes the bottleneck, and LLMs are increasingly used as survey evaluators. However, existing approaches largely rely on off-the-shelf LLM-as-a-judge methods without systematic alignment to human reviewers, and there remains a lack of systematic frameworks for quantifying alignment with human reviewers. To address this gap, we propose SurveyReview, a reviewer-aligned, multi-dimensional benchmark and dataset for survey evaluation. We collect and annotate 675 survey papers with 1,630 review reports. We structure authentic peer-review reports by converting free-form comments into four-dimensional scores (Readability, Criticalness, Comprehensiveness, Structure) paired with supporting rationales. We further release standardized train/test splits and an evaluation protocol to measure alignment between automatic evaluators and human reviewers. To validate the benchmark, we develop SurveyAlign, a strong baseline evaluator by fine-tuning Qwen3-32B with LoRA on our annotated data, augmented with external knowledge for knowledge-intensive dimensions. On the test set, SurveyAlign substantially improves reviewer alignment over prompt-based judging with GPT-5.2, reducing average MSE from 2.28 to 1.38 and MAE from 1.15 to 0.69 across all four dimensions. Our contributions are twofold: (1) we establish the first multi-dimensional, reviewer-aligned dataset with a reproducible evaluation framework for survey reviewing; (2) we develop a strong baseline evaluator that substantially improves alignment with human reviewers, providing a competitive reference for future research. Our code and data are available at https://surveyreview.github.io

cs.CL↗

SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning

Controlled character animation aims to transfer motion from a driving sequence to a reference character. Prior works heavily rely on intermediate representations, such as pose skeletons for motion and masked backgrounds for environment, inevitably resulting in information loss. In this work, we present SCAIL-2, a framework that adopts an end-to-end driving paradigm by directly concatenating latent visual information to the model's input sequence. We enable end-to-end training through a data synthesis pipeline that produces MotionPair-60K, a curated dataset for several character animation subtasks. We unify the subtasks using decoupled conditions to accommodate different driving patterns, facilitated by In-Context Mask Conditioning and Mode-Specific RoPE, which provide soft guidance beyond textual instructions and visual information. To address synthetic discrepancy in detailed regions, we propose Bias-Aware DPO to construct preference items to mitigate the errors. Extensive experiments demonstrate that our method achieves state-of-the-art performance across various character animation tasks. Code, model weights, and a large subset of the dataset are available at: https://teal024.github.io/SCAIL-2/.

cs.CV↗

Enabling Proactive Spoken Turns via a Generalized Style-Aware Full-Duplex Framework

Compared with half-duplex dialogue systems where the system waits for user turn completion before it responds, natural full-duplex dialogue systems require agents to act proactively in real time, including timely interruptions and backchannels. This creates a key challenge: improving turn timing without sacrificing response quality. To address limitations in realistic proactive turn-taking, we build a generalized style-aware full-duplex framework with three key components. Firstly, we propose LPS-TC, a Lightweight Proactive Speech Turn Controller for plug-and-play integration. It features a fine-grained action space covering both reactive and proactive turn behaviors, enabling half-duplex models with full-duplex capabilities and enhancing existing full-duplex models with superior timing control. Secondly, we construct WildTurn, a large-scale, real-world English dataset containing approximately 2,981 hours of filtered multi-turn stereo conversations from face-to-face and telephone conversations, annotated with five turn-taking and five backchanneling styles. Trained on WildTurn, LPS-TC exhibits rich spoken dynamics that are not captured by existing static full-duplex benchmarks. Thirdly, we introduce a two-tier evaluation scheme that assesses both chunk-level timing precision and turn-level interaction quality under realistic streaming constraints. Our experiments, integrating LPS-TC with half-duplex models like Qwen2.5-Omni and full-duplex models like Freeze-Omni, showcase its superior performance in timing appropriateness and response quality. Our framework also demonstrates fine-grained style controllability and strong generalizability, enabling more natural and human-like spoken interactions.

cs.CL↗

Memory for Large Language Models

Memory has evolved into a foundational architectural dimension in large language models (LLMs), shifting from an implicit byproduct of computation to a spectrum of explicit, controllable mechanisms. While recent advances introduce diverse strategies---spanning transient attention, recurrent state dynamics, parameter-efficient adaptations, and scalable lookup storage---this rapid evolution has led to a highly fragmented research landscape. In this survey, we present a systematic, architecture-centric taxonomy of memory in LLMs. Our framework characterizes memory along three orthogonal axes: representation (implicit versus explicit), update dynamics (offline versus online), and persistence (short-term versus long-term). We further formalize the granular mechanisms dictating memory writing, routing, state transitions, and consolidation. This unified perspective elucidates the conceptual boundaries between computation-coupled and independently addressable memory, effectively bridging disparate architectural paradigms. Additionally, we critically analyze hybrid memory architectures, system-level efficiency trade-offs, and multi-dimensional evaluation methodologies. By consolidating these scattered advancements into a cohesive framework, this survey charts the trajectory of memory-centric LLM design and provides a principled foundation for future innovations in scalable and adaptive language modeling.

cs.CL↗

Delving into Latent Spectral Biasing of Video VAEs for Superior Diffusability

Latent diffusion models pair VAEs with diffusion backbones, and the structure of VAE latents strongly influences the difficulty of diffusion training. However, existing video VAEs typically focus on reconstruction fidelity, overlooking latent structure. We present a statistical analysis of video VAE latent spaces and identify two spectral properties essential for diffusion training: a spatio-temporal frequency spectrum biased toward low frequencies, and a channel-wise eigenspectrum dominated by a few modes. To induce these properties, we propose two lightweight, backbone-agnostic regularizers: Local Correlation Regularization and Latent Masked Reconstruction. Experiments show that our Spectral-Structured VAE (SSVAE) achieves a $3\times$ speedup in text-to-video generation convergence and a 10\% gain in video reward, outperforming strong open-source VAEs. The code is available at https://github.com/zai-org/SSVAE.

cs.CV↗

Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verification

Recent advances in large language models have improved the capabilities of coding agents, yet systematic evaluation of complex, end-to-end website development remains limited. To address this gap, we introduce Vision2Web, a hierarchical benchmark for visual website development, spanning from static UI-to-code generation, interactive multi-page frontend reproduction, to long-horizon full-stack website development. The benchmark is constructed from real-world websites and comprises a total of 193 tasks across 16 categories, with 918 prototype images and 1,255 test cases. To support flexible, thorough and reliable evaluation, we propose workflow-based agent verification paradigm based on two complementary components: a GUI agent verifier and a VLM-based judge. We evaluate multiple visual language models instantiated under different coding-agent frameworks, revealing substantial performance gaps at all task levels, with state-of-the-art models still struggling on full-stack development.

cs.SE↗