arXiv subjects

Qi Wang

Publications and source records attributed to Qi Wang.

At least 271 records · Page 15Linked to original sources

arXiv2025

Motion Design Principles for Accessible Video-based Learning: Addressing Cognitive Challenges for Deaf and Hard of Hearing Learners

Deaf and Hard-of-Hearing (DHH) learners face unique challenges in video-based learning due to the complex interplay between visual and auditory information in videos. Traditional approaches to making video content accessible primarily focus on captioning, but these solutions often neglect the cognitive demands of processing both visual and textual information simultaneously. This paper introduces a set of \textit{Motion} design guidelines, aimed at mitigating these cognitive challenges and improving video learning experiences for DHH learners. Through a two-phase research, we identified five key challenges, including misaligned content and visual overload. We proposed five design principles accordingly. User study with 16 DHH participants showed that improving visual-audio relevance and guiding visual attention significantly enhances the learning experience by reducing physical demand, alleviating temporal pressure, and improving learning satisfaction. Our findings highlight the potential of Motion design to transform educational content for DHH learners, and we discuss implications for inclusive video learning tools.

cs.HC↗

arXiv2025

PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systems

Accurately modeling and forecasting complex systems governed by partial differential equations (PDEs) is crucial in various scientific and engineering domains. However, traditional numerical methods struggle in real-world scenarios due to incomplete or unknown physical laws. Meanwhile, machine learning approaches often fail to generalize effectively when faced with scarce observational data and the challenge of capturing local and global features. To this end, we propose the Physics-encoded Spectral Attention Network (PeSANet), which integrates local and global information to forecast complex systems with limited data and incomplete physical priors. The model consists of two key components: a physics-encoded block that uses hard constraints to approximate local differential operators from limited data, and a spectral-enhanced block that captures long-range global dependencies in the frequency domain. Specifically, we introduce a novel spectral attention mechanism to model inter-spectrum relationships and learn long-range spatial features. Experimental results demonstrate that PeSANet outperforms existing methods across all metrics, particularly in long-term forecasting accuracy, providing a promising solution for simulating complex systems with limited data and incomplete physics.

cs.LG↗

arXiv2025

Leveraging Pretrained Diffusion Models for Zero-Shot Part Assembly

3D part assembly aims to understand part relationships and predict their 6-DoF poses to construct realistic 3D shapes, addressing the growing demand for autonomous assembly, which is crucial for robots. Existing methods mainly estimate the transformation of each part by training neural networks under supervision, which requires a substantial quantity of manually labeled data. However, the high cost of data collection and the immense variability of real-world shapes and parts make traditional methods impractical for large-scale applications. In this paper, we propose first a zero-shot part assembly method that utilizes pre-trained point cloud diffusion models as discriminators in the assembly process, guiding the manipulation of parts to form realistic shapes. Specifically, we theoretically demonstrate that utilizing a diffusion model for zero-shot part assembly can be transformed into an Iterative Closest Point (ICP) process. Then, we propose a novel pushing-away strategy to address the overlap parts, thereby further enhancing the robustness of the method. To verify our work, we conduct extensive experiments and quantitative comparisons to several strong baseline methods, demonstrating the effectiveness of the proposed approach, which even surpasses the supervised learning method. The code has been released on https://github.com/Ruiyuan-Zhang/Zero-Shot-Assembly.

cs.CV↗

arXiv2025

Impact of Initial-State Nuclear and Sub-Nucleon Structures on Ultra-Central Puzzle in Heavy Ion Collisions

Hydrodynamic models fail to describe the near-equal $v_2/v_3$ ratio observed in ultra-central heavy-ion collisions, despite their success in other centrality classes. This discrepancy stems from shear viscosity suppressing higher-order geometric eccentricities, resulting in underestimated $v_3$ when using the conventional QGP viscosity coefficient. We explore two initial-state modifications to resolve this puzzle: (1) enforcing a minimum nucleon separation distance to homogenize distributions, and (2) amplifying sub-nucleon structures to reduce initial eccentricity. Using TRENTo initial conditions and 3+1D viscous hydrodynamic model CLVisc, both approaches significantly lower geometric eccentricity, reduce required viscosity, and narrow the $v_2$-$v_3$ gap in ultra-central collisions. Our results implicate initial-state nuclear and sub-nucleon structures as critical factors in addressing this puzzle. Resolving it would advance nuclear structure studies and improve precision in extracting QGP transport coefficients (e.g., shear viscosity), bridging microscopic nuclear features to macroscopic quark-gluon plasma properties.

nucl-th↗

arXiv2025

Anomalous Hall effect in antiferromagnetic RGaGe (R = Nd, Gd) single crystals

Recently, the non-centrosymmetric Weyl semimetallic candidate family RTX (R = rare-earth element, T= poor metal, X = Si and Ge) has recently attracted significant attention due to its exotic quantum states and potential applications in quantum devices. In this study, our comprehensive investigations of high-quality NdGaGe and GdGaGe single crystals reveal distinct magnetic and electrical responses. Both compounds exhibit antiferromagnetic transitions with TN - 7.6 K and 22.4 K for NdGaGe and GdGaGe, respectively. NdGaGe exhibits strong magnetic anisotropy (\c{hi}c /\c{hi}a - 70). In contrast, GdGaGe displays weak magnetic anisotropic behavior (\c{hi}c /\c{hi}a - 1) with a distinctive spin-flop transition. Below TN, NdGaGe shows significant negative magnetoresistance due to the reduced spin-disorder scattering arising from the field-induced spin alignment. GdGaGe exhibits more complex magnetoresistance behavior: positive values at low fields transitioning to negative values attributed to the reduced spin-flop scattering. Specially, NdGaGe demonstrates a large anomalous Hall conductance (AHC) of approximately 368 Ω-1 cm-1, which is dominated by the intrinsic mechanism. These reveal the pivotal role of rare-earth elements in modulating the electronic structure, magnetic properties, and transport characteristics of the RGaGe system, thereby providing valuable insights for developing next-generation spintronic devices.

cond-mat.supr-con↗

arXiv2025

Multi-class Item Mining under Local Differential Privacy

Item mining, a fundamental task for collecting statistical data from users, has raised increasing privacy concerns. To address these concerns, local differential privacy (LDP) was proposed as a privacy-preserving technique. Existing LDP item mining mechanisms primarily concentrate on global statistics, i.e., those from the entire dataset. Nevertheless, they fall short of user-tailored tasks such as personalized recommendations, whereas classwise statistics can improve task accuracy with fine-grained information. Meanwhile, the introduction of class labels brings new challenges. Label perturbation may result in invalid items for aggregation. To this end, we propose frameworks for multi-class item mining, along with two mechanisms: validity perturbation to reduce the impact of invalid data, and correlated perturbation to preserve the relationship between labels and items. We also apply these optimized methods to two multi-class item mining queries: frequency estimation and top-$k$ item mining. Through theoretical analysis and extensive experiments, we verify the effectiveness and superiority of these methods.

cs.CR↗

arXiv2025

Routing to the Right Expertise: A Trustworthy Judge for Instruction-based Image Editing

Instruction-based Image Editing (IIE) models have made significantly improvement due to the progress of multimodal large language models (MLLMs) and diffusion models, which can understand and reason about complex editing instructions. In addition to advancing current IIE models, accurately evaluating their output has become increasingly critical and challenging. Current IIE evaluation methods and their evaluation procedures often fall short of aligning with human judgment and often lack explainability. To address these limitations, we propose JUdgement through Routing of Expertise (JURE). Each expert in JURE is a pre-selected model assumed to be equipped with an atomic expertise that can provide useful feedback to judge output, and the router dynamically routes the evaluation task of a given instruction and its output to appropriate experts, aggregating their feedback into a final judge. JURE is trustworthy in two aspects. First, it can effortlessly provide explanations about its judge by examining the routed experts and their feedback. Second, experimental results demonstrate that JURE is reliable by achieving superior alignment with human judgments, setting a new standard for automated IIE evaluation. Moreover, JURE's flexible design is future-proof - modular experts can be seamlessly replaced or expanded to accommodate advancements in IIE, maintaining consistently high evaluation quality. Our evaluation data and results are available at https://github.com/Cyyyyyrus/JURE.git.

cs.AI↗

arXiv2025

Capybara-OMNI: An Efficient Paradigm for Building Omni-Modal Language Models

With the development of Multimodal Large Language Models (MLLMs), numerous outstanding accomplishments have emerged within the open-source community. Due to the complexity of creating and training multimodal data pairs, it is still a computational and time-consuming process to build powerful MLLMs. In this work, we introduce Capybara-OMNI, an MLLM that trains in a lightweight and efficient manner and supports understanding text, image, video, and audio modalities. We present in detail the framework design, the data construction, and the training recipe, to develop an MLLM step-by-step to obtain competitive performance. We also provide exclusive benchmarks utilized in our experiments to show how to properly verify understanding capabilities across different modalities. Results show that by following our guidance, we can efficiently build an MLLM that achieves competitive performance among models of the same scale on various multimodal benchmarks. Additionally, to enhance the multimodal instruction following and conversational capabilities of the model, we further discuss how to train the chat version upon an MLLM understanding model, which is more in line with user habits for tasks like real-time interaction with humans. We publicly disclose the Capybara-OMNI model, along with its chat-based version. The disclosure includes both the model weights, a portion of the training data, and the inference codes, which are made available on GitHub.

cs.CL↗

arXiv2025

Data Metabolism: An Efficient Data Design Schema For Vision Language Model

Data curation plays a crucial role in training powerful Visual Language Models (VLMs). In this work, we introduce the concept of Data Metabolism and present our data-centric framework to build VLMs throughout the development lifecycle. Starting from a standard model architecture, we discuss and provide insights into two crucial development steps: data curation and iteration, forming a closed-loop system that continuously improves model performance. We show a detailed codebook on how to process existing massive datasets and build user-specific data flywheel. As a demonstration, we release a VLM, named Capybara-VL, which excels in typical multimodal tasks (e.g. , visual question answering, scientific reasoning, and text-rich tasks). Despite its relatively compact size, Capybara-VL surpasses several open-source models that are up to 10 times larger in size. Moreover, it achieves results that are on par with those of several leading proprietary models, demonstrating its remarkable competitiveness. These results highlight the power of our data-centric framework and the potential of training smaller and more efficient VLMs.

cs.CL↗

arXiv2025

Superconductivity in trilayer nickelate La4Ni3O10 under pressure

Nickelate superconductors have attracted a great deal of attention over the past few decades due to their similar crystal and electronic structures with high-temperature cuprate superconductors. Here, we report the superconductivity in a pressurized Ruddlesden-Popper phase single crystal, La4Ni3O10 (n = 3), and its interplay with the density wave order in the phase diagram. With increasing pressure, the density wave order as indicated by the anomaly in the resistivity is progressively suppressed, followed by the emergence of the superconductivity around 25 K under I4/mmm space group. The susceptibility measurements confirm bulk superconductivity with a volume fraction exceeding 80%. Moreover, theoretical analysis unveils that antiferromagnetic (AFM) super-exchange interactions can serve as the effective pairing interaction for the emergence of superconductivity (SC) in pressurized La4Ni3O10. Our research provides a new platform for the investigation of the unconventional superconductivity mechanism in Ruddlesden-Popper trilayer perovskite nickelates.

cond-mat.supr-con↗

arXiv2025

Edge Approximation Text Detector

Pursuing efficient text shape representations helps scene text detection models focus on compact foreground regions and optimize the contour reconstruction steps to simplify the whole detection pipeline. Current approaches either represent irregular shapes via box-to-polygon strategy or decomposing a contour into pieces for fitting gradually, the deficiency of coarse contours or complex pipelines always exists in these models. Considering the above issues, we introduce EdgeText to fit text contours compactly while alleviating excessive contour rebuilding processes. Concretely, it is observed that the two long edges of texts can be regarded as smooth curves. It allows us to build contours via continuous and smooth edges that cover text regions tightly instead of fitting piecewise, which helps avoid the two limitations in current models. Inspired by this observation, EdgeText formulates the text representation as the edge approximation problem via parameterized curve fitting functions. In the inference stage, our model starts with locating text centers, and then creating curve functions for approximating text edges relying on the points. Meanwhile, truncation points are determined based on the location features. In the end, extracting curve segments from curve functions by using the pixel coordinate information brought by truncation points to reconstruct text contours. Furthermore, considering the deep dependency of EdgeText on text edges, a bilateral enhanced perception (BEP) module is designed. It encourages our model to pay attention to the recognition of edge features. Additionally, to accelerate the learning of the curve function parameters, we introduce a proportional integral loss (PI-loss) to force the proposed model to focus on the curve distribution and avoid being disturbed by text scales.

cs.CV↗

arXiv2025

Interpretable Single-View 3D Gaussian Splatting using Unsupervised Hierarchical Disentangled Representation Learning

Gaussian Splatting (GS) has recently marked a significant advancement in 3D reconstruction, delivering both rapid rendering and high-quality results. However, existing 3DGS methods pose challenges in understanding underlying 3D semantics, which hinders model controllability and interpretability. To address it, we propose an interpretable single-view 3DGS framework, termed 3DisGS, to discover both coarse- and fine-grained 3D semantics via hierarchical disentangled representation learning (DRL). Specifically, the model employs a dual-branch architecture, consisting of a point cloud initialization branch and a triplane-Gaussian generation branch, to achieve coarse-grained disentanglement by separating 3D geometry and visual appearance features. Subsequently, fine-grained semantic representations within each modality are further discovered through DRL-based encoder-adapters. To our knowledge, this is the first work to achieve unsupervised interpretable 3DGS. Evaluations indicate that our model achieves 3D disentanglement while preserving high-quality and rapid reconstruction.

cs.CV↗

arXiv2025

GR00T N1: An Open Foundation Model for Generalist Humanoid Robots

General-purpose robots need a versatile body and an intelligent mind. Recent advancements in humanoid robots have shown great promise as a hardware platform for building generalist autonomy in the human world. A robot foundation model, trained on massive and diverse data sources, is essential for enabling the robots to reason about novel situations, robustly handle real-world variability, and rapidly learn new tasks. To this end, we introduce GR00T N1, an open foundation model for humanoid robots. GR00T N1 is a Vision-Language-Action (VLA) model with a dual-system architecture. The vision-language module (System 2) interprets the environment through vision and language instructions. The subsequent diffusion transformer module (System 1) generates fluid motor actions in real time. Both modules are tightly coupled and jointly trained end-to-end. We train GR00T N1 with a heterogeneous mixture of real-robot trajectories, human videos, and synthetically generated datasets. We show that our generalist robot model GR00T N1 outperforms the state-of-the-art imitation learning baselines on standard simulation benchmarks across multiple robot embodiments. Furthermore, we deploy our model on the Fourier GR-1 humanoid robot for language-conditioned bimanual manipulation tasks, achieving strong performance with high data efficiency.

cs.RO↗

arXiv2025

MMO-IG: Multi-Class and Multi-Scale Object Image Generation for Remote Sensing

The rapid advancement of deep generative models (DGMs) has significantly advanced research in computer vision, providing a cost-effective alternative to acquiring vast quantities of expensive imagery. However, existing methods predominantly focus on synthesizing remote sensing (RS) images aligned with real images in a global layout view, which limits their applicability in RS image object detection (RSIOD) research. To address these challenges, we propose a multi-class and multi-scale object image generator based on DGMs, termed MMO-IG, designed to generate RS images with supervised object labels from global and local aspects simultaneously. Specifically, from the local view, MMO-IG encodes various RS instances using an iso-spacing instance map (ISIM). During the generation process, it decodes each instance region with iso-spacing value in ISIM-corresponding to both background and foreground instances-to produce RS images through the denoising process of diffusion models. Considering the complex interdependencies among MMOs, we construct a spatial-cross dependency knowledge graph (SCDKG). This ensures a realistic and reliable multidirectional distribution among MMOs for region embedding, thereby reducing the discrepancy between source and target domains. Besides, we propose a structured object distribution instruction (SODI) to guide the generation of synthesized RS image content from a global aspect with SCDKG-based ISIM together. Extensive experimental results demonstrate that our MMO-IG exhibits superior generation capabilities for RS images with dense MMO-supervised labels, and RS detectors pre-trained with MMO-IG show excellent performance on real-world datasets.

cs.CV↗

arXiv2025

S2CFormer: Revisiting the RD-Latency Trade-off in Transformer-based Learned Image Compression

Transformer-based Learned Image Compression (LIC) suffers from a suboptimal trade-off between decoding latency and rate-distortion (R-D) performance. Moreover, the critical role of the FeedForward Network (FFN)-based channel aggregation module has been largely overlooked. Our research reveals that efficient channel aggregation-rather than complex and time-consuming spatial operations-is the key to achieving competitive LIC models. Based on this insight, we initiate the ``S2CFormer'' paradigm, a general architecture that simplifies spatial operations and enhances channel operations to overcome the previous trade-off. We present two instances of the S2CFormer: S2C-Conv, and S2C-Attention. Both models demonstrate state-of-the-art (SOTA) R-D performance and significantly faster decoding speed. Furthermore, we introduce S2C-Hybrid, an enhanced variant that maximizes the strengths of different S2CFormer instances to achieve a better performance-latency trade-off. This model outperforms all the existing methods on the Kodak, Tecnick, and CLIC Professional Validation datasets, setting a new benchmark for efficient and high-performance LIC. The code is at \href{https://github.com/YunuoChen/S2CFormer}{https://github.com/YunuoChen/S2CFormer}.

cs.CV↗

arXiv2025

CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Driving

Trajectory planning is vital for autonomous driving, ensuring safe and efficient navigation in complex environments. While recent learning-based methods, particularly reinforcement learning (RL), have shown promise in specific scenarios, RL planners struggle with training inefficiencies and managing large-scale, real-world driving scenarios. In this paper, we introduce \textbf{CarPlanner}, a \textbf{C}onsistent \textbf{a}uto-\textbf{r}egressive \textbf{Planner} that uses RL to generate multi-modal trajectories. The auto-regressive structure enables efficient large-scale RL training, while the incorporation of consistency ensures stable policy learning by maintaining coherent temporal consistency across time steps. Moreover, CarPlanner employs a generation-selection framework with an expert-guided reward function and an invariant-view module, simplifying RL training and enhancing policy performance. Extensive analysis demonstrates that our proposed RL framework effectively addresses the challenges of training efficiency and performance enhancement, positioning CarPlanner as a promising solution for trajectory planning in autonomous driving. To the best of our knowledge, we are the first to demonstrate that the RL-based planner can surpass both IL- and rule-based state-of-the-arts (SOTAs) on the challenging large-scale real-world dataset nuPlan. Our proposed CarPlanner surpasses RL-, IL-, and rule-based SOTA approaches within this demanding dataset.

cs.RO↗

arXiv2025

Linear hypermaps--modelling linear hypergraphs on surfaces

A hypergraph is linear if each pair of distinct vertices appears in at most one common edge. We say $\varGamma=(V,E)$ is an associated graph of a linear hypergraph $\mathcal{H}=(V, X)$ if for any $x\in X$, the induced subgraph $\varGamma[x]$ is a cycle, and for any $e\in E$, there exists a unique edge $y\in X$ such that $e\subseteq y$. A linear hypermap $\mathcal{M}$ is a $2$-cell embedding of a connected linear hypergraph $\mathcal{H}$'s associated graph $\varGamma$ on a compact connected surface, such that for any edge $x\in E(\mathcal{H})$, $\varGamma[x]$ is the boundary of a $2$-cell and for any $e\in E(\varGamma)$, $e$ is incident with two distinct $2$-cells. In this paper, we introduce linear hypermaps to model linear hypergraphs on surfaces and regular linear hypermaps modelling configurations on the surfaces. As an application, we classify regular linear hypermaps on the sphere and determine the total number of proper regular linear hypermaps of genus 2 to 101.

math.CO↗

arXiv2025

From pre-Lie bialgebras to phase spaces of Lie algebras: a categorical correspondence

This paper establishes a categorical framework for phase spaces of Lie algebras, pre-Lie bialgebras, Manin triples, classical s-matrices, and relative Rota-Baxter operators by introducing the concept of coherent homomorphisms. Starting with endo pre-Lie algebras (pre-Lie algebras equipped with endomorphisms), we extend classical constructions to this enhanced setting, which leads to the notion of coherent endomorphisms for each class of structures. Through polarization, these endomorphisms naturally generalize to coherent homomorphisms, establishing well-defined categories of these algebraic objects. Furthermore, mappings between categories are elevated to functors or equivalences, formalizing interconnections among the constructions. Finally, exploiting the categorical correspondence between s-matrices and relative Rota-Baxter operators, we develop cohomology and deformation of s-matrices, thereby bridging algebraic structures with category-theoretic methods.

math.RA↗