arXiv Science⌕ Search

arXiv subjects

Yu He

Publications and source records attributed to Yu He.

At least 55 records · Page 3Linked to original sources

HyperDiT: Hyper-Connected Transformers for High-Fidelity Pixel-Space Diffusion

Pixel-space diffusion models bypass the reconstruction bottleneck of Variational Autoencoders (VAEs) but face a fundamental "granularity dilemma": capturing global semantics favors large patch scales, while generating high-fidelity details demands fine-grained inputs. To address this issue, we propose HyperDiT, a unified framework establishing Hyper-Connected Cross-Scale Interactions to bridge the semantic and pixel manifold. Diverging from injecting semantics by AdaLN, HyperDiT utilizes Cross-Attention mechanisms, enabling fine-grained tokens to query multi-level semantic anchors globally. To resolve the spatial mismatch during multi-scale interactions, we introduce Scale-Aware Rotary Position Embedding (SA-RoPE) to ensure precise geometric alignment among tokens of varying patch sizes. Furthermore, we incorporate Registers to learn the dense semantics from a pretrained Visual Foundation Model (VFM), effectively reducing generation hallucination and artifacts. Extensive experiments demonstrate that HyperDiT achieves state-of-the-art (SoTA) FID of $\mathbf{1.56}$ on ImageNet $256\times256$ directly within the pixel space. By combining the fine-grained stream with semantic guidance, HyperDiT offers a superior paradigm for high-fidelity pixel generation.

cs.CV↗

Can LLMs Reason Structurally? Benchmarking via the Lens of Data Structures

Large language models (LLMs) are deployed on increasingly complex tasks that require multi-step decision-making. Understanding their algorithmic reasoning abilities is therefore crucial. However, we lack a diagnostic benchmark for evaluating these capabilities. We propose to use data structures as a principled lens: as fundamental building blocks of algorithms, they naturally probe structural reasoning - the ability to understand and manipulate relationships such as order, hierarchy, and connectivity that underpin algorithmic reasoning. We introduce DSR-Bench (Data Structure Reasoning Benchmark), spanning 20 data structures, 35 operations, and 4,140 problem instances. DSR-Bench features hierarchical task organization, fully automated generation and evaluation, and fine-grained diagnostics. Evaluating 13 state-of-the-art LLMs reveals critical limitations: the top-performing model achieves only 0.46/1 on challenging instances. Three auxiliary probes targeting more realistic usages expose further weaknesses: models perform poorly on spatial data and context-rich scenarios, and they struggle to reason over their own code.

cs.LG↗

Check, Please: Verifiably Fair Clustering

Popular centroid-based clustering methods are typically optimized for global objectives, and may fail to adequately represent large groups of datapoints. Thus, one needs proportionality notions suited for metric settings. Ideally, such notions should admit polynomial-time algorithms for (a) finding proportional outcomes, and (b) checking if a given outcome is proportional; the latter enables evaluation of traditional algorithms without proportionality guarantees (e.g., $k$-means). A promising approach imports proportionality notions from multiwinner voting with approval ballots. In particular, mPJR, the metric version of the well-known Proportional Justified Representation (PJR) axiom, satisfies (a), but whether it satisfies (b) was open. In this work, we study the computational complexity of auditing proportional representation in clustering. In the approval setting, PJR is coNP-complete to verify; however, it admits a strengthening PJR+, which satisfies (a) and (b). We show these results translate to the metric setting: mPJR is coNP-complete to verify, we define mPJR+, a metric analog of PJR+, and argue mPJR+ satisfies (a) and (b). However, auditing mPJR+ relies on repeated submodular minimization, rendering it impractical at scale, and a natural combinatorial approach is infeasible. As a partial remedy, we propose an mPJR+ verification algorithm exponential in $k$ but quasilinear in the number of datapoints. Motivated by these hardness results, we introduce DC-mPJR+: a proportionality concept offering representation guarantees to a restricted set of coalitions around unselected centers, admitting an $O(mn \log n + mnk)$ verification algorithm. DC-mPJR+ outcomes can be computed efficiently, and any $γ$-DC-mPJR+ solution satisfies $(γ+ 2)$-mPJR+.

cs.GT↗

LiWi: Layering in the Wild

Recent advances in generative models have empowered impressive layered image generation, yet their success is largely confined to graphic design domains. The layering of in-the-wild images remains an underexplored problem, limiting fine-grained editing and applications of images in real-world scenarios. Specifically, challenges remain in scalable layered data and the modeling of object interaction in natural images, such as illumination effects and structural boundary. To address these bottlenecks, we propose a novel framework for high-fidelity natural image decomposition. First, we introduce an Agent-driven Data Decomposition (ADD) pipeline that orchestrates agents and tools to synthesize layered data without manual intervention. Utilizing this pipeline, we construct a large-scale dataset, named LiWi-100k, with over 100,000 high-quality layered in-the-wild images. Second, we present a novel framework that jointly improves photometric fidelity and alpha boundary accuracy. Specifically, shadow-guided learning explicitly models the illumination effects, and degradation-restoration objective provides boundary-correction supervision by recovering clean foreground image from degraded one. Extensive experiments demonstrate that our framework achieves state-of-the-art (SoTA) performance in natural image decomposition, outperforming existing models in RGB L1 and Alpha IoU metrics. We will soon release our code and dataset.

cs.CV↗

NasZip: Software and Hardware Co-Design to Accelerate Approximate Nearest Neighbor Search with DIMM-Based Near-Data Processing

As large language models (LLMs) continue to advance, retrieval-augmented generation (RAG) has become the key mechanism for expanding model knowledge and reducing hallucinations. Central to RAG is approximate nearest neighbor search (ANNS), which retrieves database vectors most similar to a given query. However, distance calculation over high-dimensional vectors is inherently memory-bound, causing retrieval performance to be constrained by I/O bandwidth on mainstream platforms such as CPUs and GPUs. Although many prior early exiting (EE) techniques attempt to reduce memory accesses by only computing partial dimensions, the partial distance converges too slowly to the EE threshold, which ultimately limits their performance gains. To address these challenges, we propose NASZIP, a hardware-software co-designed framework that integrates near data processing (NDP) with a novel feature-level early exiting guided by statistics-based principal component analysis (PCA). Instead of relying solely on partial distances, NASZIP incorporates estimation and correction parameters to approximate full dimensional distances accurately, enabling earlier exiting without compromising accuracy. We further introduce a bit-level NDP-aware dynamic-float scheme that significantly reduces memory access for vector data. On the hardware side, we develop a data aware neighbor list mapping strategy that reduces neighbor retrieval latency and inter-channel communication overhead, complemented by a dedicated cache that exploits data locality and enhances prefetch efficiency. With these co-optimized techniques, NASZIP delivers speedups of up to $8.4\times$ / $1.4\times$ over CPU baseline and state-of-the-art GPU implementation at equal accuracy. Relative to the state-of-the-art NDP ANNS accelerator ANSMET, NASZIP achieves $1.69\times$ performance improvement.

cs.AR↗

Dynamic-TreeRPO: Breaking the Independent Trajectory Bottleneck with Structured Sampling

The integration of Reinforcement Learning (RL) into flow matching models for text-to-image (T2I) generation has driven substantial advances in generation quality. However, these gains often come at the cost of exhaustive exploration and inefficient sampling strategies due to slight variation in the sampling group. Building on this insight, we propose Dynamic-TreeRPO, which implements the sliding-window sampling strategy as a tree-structured search with dynamic noise intensities along depth. We perform GRPO-guided optimization and constrained Stochastic Differential Equation (SDE) sampling within this tree structure. By sharing prefix paths of the tree, our design effectively amortizes the computational overhead of trajectory search. With well-designed noise intensities for each tree layer, Dynamic-TreeRPO can enhance the variation of exploration without any extra computational cost. Furthermore, we seamlessly integrate Supervised Fine-Tuning (SFT) and RL paradigm within Dynamic-TreeRPO to construct our proposed LayerTuning-RL, reformulating the loss function of SFT as a dynamically weighted Progress Reward Model (PRM) rather than a separate pretraining method. By associating this weighted PRM with dynamic-adaptive clipping bounds, the disruption of exploration process in Dynamic-TreeRPO is avoided. Benefiting from the tree-structured sampling and the LayerTuning-RL paradigm, our model dynamically explores a diverse search space along effective directions. Compared to existing baselines, our approach demonstrates significant superiority in terms of semantic consistency, visual fidelity, and human preference alignment on established benchmarks, including HPS-v2.1, PickScore, and ImageReward. In particular, our model outperforms SoTA by $4.9\%$, $5.91\%$, and $8.66\%$ on those benchmarks, respectively, while improving the training efficiency by nearly $50\%$.

cs.CV↗

Task-Semantic Graph-Driven Distributed Agent Networking for Underwater Target Tracking

Autonomous underwater vehicle (AUV) swarms are emerging as intelligent underwater networks, where each node must sense, communicate, process local data, and make decisions under severe acoustic constraints. Persistent underwater target tracking is a typical task with moving targets, changing communication topology, intermittent acoustic links, and limited observation for each AUV. Multi-agent reinforcement learning (MARL) is a natural candidate for distributed tracking, yet existing studies still lack a unified open-source platform for evaluating different MARL algorithms under six-degree-of-freedom AUV dynamics. In addition, policies trained with raw geometric states and low-level force actions often struggle to represent task phases, observation reliability, link quality, and local cooperation roles. This paper addresses these issues by developing an open-source MARL-AUV platform that integrates DI-engine with a six-degree-of-freedom underwater AUV target-tracking simulator. To the best of our knowledge, it is the first open platform that connects a public MARL training framework with physically modeled AUV swarm-based tasks, and provides a unified experimental protocol for fair training, testing, and comparison of representative RL and MARL algorithms. Based on this platform, we propose STG-MAPPO, a Semantic Task Graph-enhanced variant of Multi-Agent Proximal Policy Optimization. STG-MAPPO builds semantic policy inputs from tracking diagnostics, task phases, observation confidence, link availability, neighbor tracking quality, and local role advantage. A compact semantic task graph links communication-constrained network states to decentralized actor decisions, and a velocity-level action abstraction maps high-level cooperative decisions to executable six-degree-offreedom AUV control inputs.The code is available at https://github.com/dasjsaj/MARL-AUV.

cs.RO↗

Scalable Spin Qubit Architecture with Donor-Cluster Arrays in Silicon

Spin qubits in silicon donors offer a promising platform for quantum computing due to their long coherence times and semiconductor compatibility. However, scaling donor-based spin qubits in silicon is fundamentally challenged by frequency crowding, crosstalk, and the tight tolerances on donor placement in conventional single-donor architectures.To overcome this, we introduce a paradigm based on a two-dimensional array of phosphorus-donor clusters, in which multiple donors share a bound electron. The natural hyperfine distribution within each cluster enables individual addressability of the electron and nuclear spins, while tunable exchange interactions between clusters mediate local all-to-all connectivity. We present a universal control protocol achieving gate fidelities exceeding 99% for both intra-cluster and inter-cluster multi-qubit operations, with crosstalk effectively suppressed. The architecture natively supports efficient quantum error correction, including bias-tailored codes that exploit the intrinsic noise bias of spin qubits. Furthermore, its modular design is compatible with long-range coupling via electron shuttling for large-scale integration. This donor-cluster array architecture establishes a robust and hardware-efficient pathway towards scalable, fault-tolerant quantum computing in silicon.

quant-ph↗

Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Condition

Recent research work on fashion outfit generation focuses on promoting visual consistency of garments by leveraging key information from reference image and text prompt. However, the potential of outfit generation remains underexplored, requiring comprehensive e-commercial dataset and elaborative utilization of multi-modal condition. In this paper, we propose a brand-new e-commerce dataset, named Fashion130k, with various occasions, models, and garment types. For the consistent generation of garment, we design a framework with Unified Multi-modal Condition (UMC) to align and integrate the text and visual prompts into generation model. Specifically, we explore an embedding refiner to extract the unified embeddings of multi-modal prompts, within which a Fusion Transformer is proposed to align the multi-modal embeddings by adjusting the modality gap between text and image. Based on unified embeddings, the attention in generation model is redesigned to emphasis the correlations between prompts and noise image, inducing that the noise image can select the pivotal tokens of prompts for consistent outfit generation. Our dataset and proposed framework offer a general and nuanced exploration of multi-modal prompts for generation models. Extensive experiments on real-world applications and benchmark demonstrate the effectiveness of UMC in visual consistency, achieving promising result than that of SoTA methods.

cs.CV↗

Electronic origin of delicate antiferromagnetism in Fe$_{x}$NbS$_2$

Among the family of intercalated transition-metal dichalcogenides (TMDs), Fe$_{x}$NbS$_2$ is found to possess unique current-induced resistive switching behaviors, tunable antiferromagnetic states, and a commensurate charge order, all of which are tied to a critical Fe doping of $x_c$ = 1/3. However, the electronic origin of such extreme stoichiometry sensitivities remains unclear. Combining angle-resolved photoemission spectroscopy (ARPES) with density functional theory (DFT) calculations, we identify and characterize a dramatic eV-scale electronic restructuring that occurs across the $x_c$. Moment-carrying Fe 3$d_{z^2}$ electrons manifest as narrow bands within 200 meV of the Fermi level, distinct from other transition metal intercalated TMD magnets. These states strongly hybridize with itinerant electrons in TMD layer, rapidly lose coherence above $x_c$ due to correlation-driven effects. This sudden quasiparticle decoherence collapses the Fe-Nb hybridization, which explicitly suppresses the out-of-plane effective Fe-Fe exchange interaction, driving the transformation of the magnetic ground state from an antiferromagnetic stripe phase to a zigzag phase. These observations resemble the exceptional electronic and magnetic sensitivity of strongly correlated systems, and demonstrate that quantifying orbital-specific hybridization via ARPES offers an alternative pathway to evaluate effective magnetic exchange in metallic magnets, complementing inelastic neutron and resonant x-ray scattering probes.

cond-mat.str-el↗

JANUS: A Lightweight Framework for Jailbreaking Text-to-Image Models via Distribution Optimization

Text-to-image (T2I) models such as Stable Diffusion and DALLE remain susceptible to generating harmful or Not-Safe-For-Work (NSFW) content under jailbreak attacks despite deployed safety filters. Existing jailbreak attacks either rely on proxy-loss optimization instead of the true end-to-end objective, or depend on large-scale and costly RL-trained generators. Motivated by these limitations, we propose JANUS , a lightweight framework that formulates jailbreak as optimizing a structured prompt distribution under a black-box, end-to-end reward from the T2I system and its safety filters. JANUS replaces a high-capacity generator with a low-dimensional mixing policy over two semantically anchored prompt distributions, enabling efficient exploration while preserving the target semantics. On modern T2I models, we outperform state-of-the-art jailbreak methods, improving ASR-8 from 25.30% to 43.15% on Stable Diffusion 3.5 Large Turbo with consistently higher CLIP and NSFW scores. JANUS succeeds across both open-source and commercial models. These findings expose structural weaknesses in current T2I safety pipelines and motivate stronger, distribution-aware defenses. Warning: This paper contains model outputs that may be offensive.

cs.CV↗

MSSR: Memory-Aware Adaptive Replay for Continual LLM Fine-Tuning

Continual fine-tuning of large language models (LLMs) is becoming increasingly crucial as these models are deployed in dynamic environments where tasks and data distributions evolve over time. While strong adaptability enables rapid acquisition of new knowledge, it also exposes LLMs to catastrophic forgetting, where previously learned skills degrade during sequential training. Existing replay-based strategies, such as fixed interleaved replay, accuracy-supervised, and loss-driven scheduling, remain limited: some depend on heuristic rules and provide only partial mitigation of forgetting, while others improve performance but incur substantial computational overhead. Motivated by retention dynamics under sequential fine-tuning, we propose Memory-Inspired Sampler and Scheduler Replay (MSSR), an experience replay framework that estimates sample-level memory strength and schedules rehearsal at adaptive intervals to mitigate catastrophic forgetting while maintaining fast adaptation. Extensive experiments across three backbone models and 11 sequential tasks show that MSSR consistently outperforms state-of-the-art replay baselines, with particularly strong gains on reasoning-intensive and multiple-choice benchmarks.

cs.LG↗

The Complexity of Tullock Contests

Despite the extensive literature on Tullock contests, computational results for the general model with heterogeneous contestants remain scarce. This paper studies the algorithmic complexity of computing a pure Nash Equilibrium (PNE) in such general Tullock contests. We find that the elasticity parameters {r_i}, which govern the returns to scale of contestants' production functions, play a decisive role in the problem's complexity. Our core conceptual insight is that the computational hardness is determined specifically by the number of contestants with medium elasticity (r_i \in (1, 2]). This is illustrated by a complete set of algorithmic results under two parameter regimes: -Efficient Regime: When the number of contestants with medium elasticity is logarithmically bounded by the total number of contestants (O(log n)), we provide an algorithm that determines the existence of a PNE and computes an epsilon-PNE in polynomial time in both n and log(1/epsilon) (i.e., Poly(n,log(1/epsilon))) whenever it exists. This result generalizes classical findings for concave (r_i <= 1) and convex (r_i > 2) cases, establishing computational tractability for a broader class of mixed-elasticity contests. -Hard Regime: In contrast, we show when the number of medium elasticity contestants exceed Omega(log n), determining the existence of PNEs is NP-complete and it is impossible for any algorithm to compute an epsilon-PNE within running time Poly(n,log(1/epsilon)). We then design a Fully Polynomial-Time Approximation Scheme (FPTAS) that computes an epsilon-PNE in Poly(n,1/epsilon), guaranteeing efficient approximations for hard instances.

cs.GT↗

How Sampling Shapes LLM Alignment: From One-Shot Optima to Iterative Dynamics

Standard methods for aligning large language models with human preferences learn from pairwise comparisons among sampled candidate responses and regularize toward a reference policy. Despite their effectiveness, the effects of sampling and reference choices are poorly understood theoretically. We investigate these effects through Identity Preference Optimization, a widely used preference alignment framework, and show that proper instance-dependent sampling can yield stronger ranking guarantees, while skewed on-policy sampling can induce excessive concentration under structured preferences. We then analyze iterative alignment dynamics in which the learned policy feeds back into future sampling and reference policies, reflecting a common practice of model-generated preference data. We prove that these dynamics can exhibit persistent oscillations or entropy collapse for certain parameter choices, and characterize regimes that guarantee stability. Our theoretical insights extend to Direct Preference Optimization, indicating the phenomena we captured are common to a broader class of preference-alignment methods. Experiments on real-world preference data validate our findings.

cs.LG↗

Magnetic field-induced momentum-dependent symmetry breaking in a kagome superconductor

When multiple degrees of freedom share similar energy scales in quantum materials, intertwined electronic orders, which exhibit broken symmetries, are often strongly coupled. Recent studies on kagome superconductors such as CsV$_3$Sb$_5$ report rotational and time-reversal symmetry breaking linked to a charge density wave. Here, we observe a momentum-selective response of the electronic structure of CsV$_3$Sb$_5$ to an external magnetic field. By performing angle-resolved photoemission spectroscopy in a tuneable magnetic field, we demonstrate that the response of the electronic structure is compatible with piezomagnetism along with strong orbital selectivity. Our results show that the origin of the time-reversal symmetry breaking is associated with the vanadium Van Hove singularities at the onset of the charge density wave order. We also demonstrate the presence of fluctuations beyond the charge ordering temperature. Our results reveal that magnetic fields can be used as tuning knobs for disentangling intertwined orders in the momentum space for quantum materials.

cond-mat.str-el↗

Machine learning determines the Mg2SiO4 P-T phase diagram

Phase transitions among Mg2SiO4 and its high-pressure polymorphs (wadsleyite and ringwoodite) are central to mantle dynamics and deep-mantle material cycling. However, the locations and Pressure-Temperature (P-T) dependences of these phase boundaries remain debated, largely due to experimental limitations at extreme conditions and the high computational cost of first-principles free-energy calculations. Here, a machine-learning-potential driven workflow combining non-equilibrium thermodynamic integration (NETI) and two-phase coexistence simulations is employed to enable large-scale, long-timescale molecular dynamics sampling. Within this workflow, the melting curve of forsterite is evaluated and a complete P-T phase diagram is constructed. Relative to conventional ab initio approaches, this strategy reduces computational expense while retaining thermodynamic consistency in phase-stability assessment. The workflow is applicable to efficient evaluation of phase stability and thermodynamic properties in deep-Earth silicate systems.

physics.geo-ph↗

Photoinduced metastable cation disorder in metal halide double perovskites

Lead-free perovskites have emerged as environmentally benign alternatives to lead-halide counterparts for optoelectronics. Among them, the double perovskite Cs2AgInCl6 family exhibits remarkable white-light emission with proper composition engineering, enabled by strong electron-phonon coupling and the formation of self-trapped excitons (STEs). Despite these advantages, the fundamental photo- and structural dynamics governing their excited-state behavior remain poorly understood. Here, we report a long-lived metastable phase in the Cs2AgInCl6 double perovskite family and unravel this process and the concomitant electronic and structural evolution using a suite of tools including transient optical spectroscopy, time-resolved X-ray diffraction (TR-XRD) and X-ray absorption (TR-XAS). We show that the photoinduced, transient metastable phase is associated with B-site (Ag-In) disorder, which induces a dramatically reduced optical bandgap. Supported by TR-XRD and first-principles calculations, the Ag-In disorder drives the formation of Ag-rich and In-rich domains with millisecond lifetimes, with lifetimes increasing at lower temperatures. TR-XAS further reveals that photogenerated STEs oxidize Ag+ to Ag2+, facilitating this highly temporally asymmetric order-disorder transition. Our findings demonstrate a new mechanism, mediated by hole-localized STE formation, that enables prolongation of transient light-induced states to the multi-millisecond regime in double perovskites, opening possibilities to harvesting the functional properties of metastable phases of these materials.

cond-mat.mtrl-sci↗

Towards Efficient and Robust Linguistic Emotion Diagnosis for Mental Health via Multi-Agent Instruction Refinement

Linguistic expressions of emotions such as depression, anxiety, and trauma-related states are pervasive in clinical notes, counseling dialogues, and online mental health communities, and accurate recognition of these emotions is essential for clinical triage, risk assessment, and timely intervention. Although large language models (LLMs) have demonstrated strong generalization ability in emotion analysis tasks, their diagnostic reliability in high-stakes, context-intensive medical settings remains highly sensitive to prompt design. Moreover, existing methods face two key challenges: emotional comorbidity, in which multiple intertwined emotional states complicate prediction, and inefficient exploration of clinically relevant cues. To address these challenges, we propose APOLO (Automated Prompt Optimization for Linguistic Emotion Diagnosis), a framework that systematically explores a broader and finer-grained prompt space to improve diagnostic efficiency and robustness. APOLO formulates instruction refinement as a Partially Observable Markov Decision Process and adopts a multi-agent collaboration mechanism involving Planner, Teacher, Critic, Student, and Target roles. Within this closed-loop framework, the Planner defines an optimization trajectory, while the Teacher-Critic-Student agents iteratively refine prompts to enhance reasoning stability and effectiveness, and the Target agent determines whether to continue optimization based on performance evaluation. Experimental results show that APOLO consistently improves diagnostic accuracy and robustness across domain-specific and stratified benchmarks, demonstrating a scalable and generalizable paradigm for trustworthy LLM applications in mental healthcare.

cs.AI↗