arXiv Science⌕ Search

arXiv subjects

Cheng Lin

Publications and source records attributed to Cheng Lin.

At least 19 recordsLinked to original sources
arXiv2026

PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation

Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies, but existing approaches typically only address a specific setting, such as text-guided part segmentation or point-based interaction. In this work, we argue that these settings can be unified as an intent-conditioned generative problem, where different prompts specify the desired part decomposition. To this end, we introduce PartLLM, a unified multimodal model that formulates 3D part segmentation as autoregressive semantic decomposition. Conditioned on an input shape and a user prompt, PartLLM autoregressively generates semantic part hypotheses as queries for mask prediction and feeds them to a decomposition-aware decoder that jointly predicts coherent part masks. This unified design supports text-guided part segmentation, interactive segmentation, and full-shape semantic decomposition with controllable granularity within a single model. Extensive experiments across these task settings show that PartLLM consistently outperforms task-specific baselines, demonstrating the effectiveness of unifying 3D part segmentation under an intent-conditioned generative formulation.

cs.CV↗
arXiv2026

World2HOSI: A Multi-Expert Harness for Long-Horizon Human-Object-Scene Interaction Generation

Long-horizon human-object-scene interaction (HOSI) is central to embodied AI, animation, and game development. Existing human-object interaction (HOI) and human-scene interaction (HSI) models excel in their respective domains, but none alone covers tasks requiring multiple interaction skills. Training unified HOSI models is hindered by scarce and costly data. We introduce World2HOSI, a multi-expert orchestration harness that generates continuous HOSI data from 3D Gaussian Splatting (3DGS) scenes and natural language instructions. Our key insight is that long-horizon HOSI hinges not on a stronger single model but on orchestration. Given a shared, structured scene state and an orchestration harness grounded in it, existing experts can jointly accomplish tasks beyond the reach of any of them alone. World2HOSI realizes this insight as a closed loop around a persistent scene state built from decoupled background and object assets. A harness plans action stages over this state, invokes experts via their native conditioning interfaces, and writes each action's effects back, so that every invocation is grounded in the evolving world. To reduce physical artifacts, bounded residual optimization and contact-driven physics simulation further ensure the physical plausibility of human motion and object manipulation, respectively, while preserving interaction intent. Experiments and a perceptual user study show that World2HOSI achieves the best task completion and interaction quality on the evaluated HOSI tasks, while generating more diverse data.

cs.CV↗
arXiv2026

TKCAM: Text and Keyframe to Camera Trajectory Generation

Generating high-quality and controllable camera motion is essential for AI-assisted cinematography, video synthesis, and 3D scene understanding. We introduce TKCAM, a Text- and Keyframe-conditioned CAMera-motion synthesis framework based on generative masked modeling. We represent camera dynamics using a 12-dimensional kinematic feature comprising position, velocity, and a continuous rotation representation and discretize them into hierarchical motion tokens via a Residual Vector Quantizer (RVQ). A two-stage masked transformer architecture then learns to reconstruct and refine these tokens, utilizing explicit self- and cross-attention modules for multimodal conditioning. A central feature of our framework is sparse visual keyframe conditioning: users can provide free-form text prompts together with RGB observations at selected timestamps, which provide temporally localized visual guidance for generating coherent in-between trajectories. Furthermore, to advance evaluation standards, we curate RealEstate10K-Cap, a large-scale text-camera dataset, and establish a cross-domain benchmark with a Universal CLaTr Evaluator. Extensive experiments demonstrate that TKCAM surpasses recent state-of-the-art baselines on Fréchet distance (FID), text-motion matching scores, and retrieval metrics (R@K), while additional analyses evaluate temporal smoothness and cross-domain generalization. Code is available at https://github.com/linearalgebrayhz/TKCAM.

cs.CV↗
arXiv2026

ForcingBooster: Adaptive Patch-wise Denoising for Fast Autoregressive Video Diffusion

Autoregressive video diffusion models have become a leading approach to real-time interactive video generation and video world modeling. However, existing methods typically allocate computation uniformly across space when generating the next video chunk, updating all patches with the same denoising schedule and number of function evaluations. This ignores the spatial heterogeneity of video content: static, simple, or recurring regions are often easier to denoise, while other regions require further refinement or additional context. A uniform budget thus leads to redundant computation on easy patches, whereas reducing the fixed step count can leave difficult patches insufficiently refined. We introduce \methodname{}, a general framework that dynamically allocates denoising steps to individual patches: easy patches stop early to improve efficiency, while difficult patches receive more refinement steps. This design accelerates generation with negligible quality degradation. Our method is compatible with most existing few-step autoregressive diffusion models, requiring only a lightweight routing module with modest training. Experiments demonstrate that \methodname{} reduces the total number of denoising steps applied across video patches by about 50\% while maintaining visual quality comparable to the four-step baseline.

cs.CV↗
arXiv2026

QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning

The generation of production-ready quad-dominant meshes is a cornerstone of modern 3D content creation. Generating anisotropic quad-dominant meshes from point clouds is challenging, as existing methods are typically limited to producing either pure triangular meshes or pure quadrilateral meshes with isotropic densities. In this paper, we present QuadLink, a unified framework consisting of three stages for quad-dominant mesh generation by linking points into structured faces. QuadLink formulates polygonal mesh generation as a hybrid centroid-conditioned vertex linking model: it first predicts a unified set of anchors (vertices and face centroids), then learns centroid-conditioned links that associate vertices with face centroids, and finally assembles polygonal faces with a quad-first strategy guided by robust geometric verification strategies. This link-based formulation enables efficient generation of sparse and anisotropic quad-dominant meshes with coherent edge flow and meanwhile supporting hybrid polygonal topology. To construct training data for this model, we further introduce a Tri-to-Quad Operator that converts artistic triangle meshes into quad-dominant training data via global merge selection. Extensive experiments show that QuadLink produces production-ready quad-dominant meshes from point clouds and achieves improved geometric fidelity and topological quality compared to prior baselines. Our method natively supports hybrid polygonal topology, generalizing to arbitrary n-gon meshes without architectural changes.

cs.GR↗
arXiv2026

MoSAT: Human Motion Generation from Spatial Audio and Textual Description

Human motion is shaped by both external acoustic events and behavioral intent: spatial audio conveys environmental cues that elicit or guide a response, while text specifies the desired action and how it should be performed. In this paper, we study the novel task of human motion synthesis jointly conditioned on spatial audio and natural language, a problem that has been largely overlooked in previous research. To support this task, We introduce STAM, a dataset of motion sequences paired with spatial audio and detailed textual annotations whose rich vocabulary affords precise and nuanced specification of human motions. We further introduce MoSAT, a latent flow-matching framework for full-body motion generation jointly conditioned on natural-language intent and directional spatial-audio cues through hierarchical cross-attention before generating motion. Such a hierarchical design enhances temporally coherent and semantically aligned motion sequences. We also develop tri-modal evaluators for comprehensive evaluation on this novel task. Extensive experiments show that MoSAT achieves the SOTA performance by leveraging spatial audio's intrinsic motion-shaping properties alongside textual semantics, enabling precise and diverse motion in various scenarios.

cs.GR↗
arXiv2026

S4R: Scaling for Rigid-Body Interpenetration Resolution

Rigid-body interpenetration frequently occurs in procedurally assembled and generated scenes and must be removed before downstream applications such as physical simulation. We present S4R (Scaling for Rigid-Body Interpenetration Resolution), a scale-continuation method for static interpenetration repair. S4R first uniformly shrinks each body about a fixed reference center to a small initial scale, at which the layout is penetration-free, and then restores full scale through a sequence of minimum-norm convex contact quadratic programs (QPs) that target the linearized separation margin during continuation. Resolution thereby replaces one deep correction with a sequence of shallow-contact subproblems. A conservative scale-event bound and frozen-witness gap predictions cut the number of exact mesh queries; the continuation then ends with a full-scale evaluator check and bounded tail refinement. We evaluate S4R on Kubric, HY3D-Bench, and Thingi10K using a shared mesh-level evaluator and a unified per-scene timing protocol. In the main comparisons on all three benchmarks, up to N=5000 bodies, S4R reaches zero reported penetration with displacement that stays small and nearly independent of scene size, and at the lowest wall time within each hardware tier among the compared methods. A GPU implementation extends these results to large-scale scenes. Our code and data can be found on our project page: https://frank-zy-dou.github.io/projects/S4R/index.html.

cs.GR↗
arXiv2026

GaussiAnimate: Rig Animatable Categories with Level of Dynamics

We propose Skelebones, a Scaffold-Skin Rigging System built on three steps: (1) Bones compress temporally consistent Gaussian or mesh sequences into free-form bones with smooth skinning weights, approximating non-rigid deformations via linear blend skinning (LBS); (2) Skeleton extracts the Mean Curvature Skeleton (MCS) from the canonical shape and temporally refines its topology and kinematics into a compact skeletal structure; and (3) Binding connects the skeleton and bones through non-parametric Partwise Motion Matching (PartMM), which synthesizes novel bone motions by matching, retrieving, and blending existing ones. Together, these steps compress the dynamics of 4D shapes into compact skelebones that are simultaneously controllable and expressive. The resulting representation is category-agnostic, meaning template-free; motion-adaptive, with dynamic topology; and topology-correct, with a skeleton consistent with the surface geometry. PartMM requires no learning. We validate our method on both synthetic and real-world datasets, achieving substantial reanimation improvements on unseen poses: a 17.3 dB PSNR gain over LBS on DNA-Rendering and a 45.6 dB gain over Bag-of-Bones on ActorsHQ, while preserving high rendering fidelity for characters with complex non-rigid dynamics. PartMM generalizes robustly to both Gaussian and mesh representations, excelling in low-data regimes of approximately 1,000 frames, with a 48.4 RMSE improvement over LBS and improvements of more than 20 over GRU- and MLP-based methods. Code will be publicly released at https://cookmaker.cn/gaussianimate/.

cs.CV↗
arXiv2026

C2Dex: Contact-Consistent Reconstruction and Retargeting for Dexterous Manipulation from Monocular Video

High-quality demonstrations for dexterous robot manipulation are costly and difficult to collect, whereas monocular human videos provide a scalable source of diverse manipulation behaviors. However, transferring such demonstrations to dexterous robots remains challenging: monocular hand-object interaction (HOI) reconstruction often produces temporally unstable contacts and physically implausible interactions, while conventional retargeting methods struggle to preserve task-relevant contacts and local interaction geometry across different hand embodiments. We present C2Dex, a video-to-dexterous-manipulation framework built around a shared interaction representation: stable object-side contacts recovered by aggregating noisy frame-wise observations in the canonical object space. These stable contacts serve a dual role: as trajectory-level constraints that guide reconstruction toward temporally coherent and physically plausible human HOI trajectories, and as explicit transfer targets for the dexterous hand, where Laplacian interaction optimization preserves the local hand-object geometry across embodiments and residual reinforcement learning refines the trajectory in simulation. Experiments on DexYCB and TACO show that C2Dex achieves end-to-end trajectory success rates of 57.78% and 26.67%, respectively, substantially outperforming the strongest baselines (17.78% and 10.00%) under identical evaluation criteria. Real-robot replay experiments further demonstrate physical feasibility across diverse contact-rich manipulation tasks. Project page: https://k-jie.github.io/C2Dex/

cs.RO↗
arXiv2026

HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Images

Recovering high-fidelity 3D hand geometry from images is a critical task in computer vision, holding significant value for domains such as robotics, animation and VR/AR. Crucially, scalable applications demand both accuracy and deployment flexibility, requiring the ability to leverage massive amounts of unstructured image data from the internet or enable deployment on consumer-grade RGB cameras without complex calibration. However, current methods face a dilemma. While single-view approaches are easy to deploy, they suffer from depth ambiguity and occlusion. Conversely, multi-view systems resolve these uncertainties but typically demand fixed, calibrated setups, limiting their real-world utility. To bridge this gap, we draw inspiration from 3D foundation models that learn explicit geometry directly from visual data. By reformulating hand reconstruction from arbitrary views as a visual-geometry grounded task, we propose a feed-forward architecture that, for the first time in literature, jointly infers 3D hand meshes and camera poses from uncalibrated views. Extensive evaluations show that our approach outperforms state-of-the-art benchmarks and demonstrates strong generalization to uncalibrated, in-the-wild scenarios. Here is the link of our project page: https://lym29.github.io/HGGT/.

cs.CV↗
arXiv2026

RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space

Sparse-view 3D modeling represents a fundamental tension between reconstruction fidelity and generative plausibility. While feed-forward reconstruction excels in efficiency and input alignment, it often lacks the global priors needed for structural completeness. Conversely, diffusion-based generation provides rich geometric details but struggles with multi-view consistency. We present RecGen3D, a framework that combines these two paradigms into a cooperative system. To overcome inherent conflicts in coordinate spaces, 3D representations, and training objectives, we align both models within a shared canonical space. We employ decoupled cooperative learning, which maintains stable training while enabling seamless collaboration during inference. Specifically, the reconstruction module is adapted to provide canonical geometric anchors, while the diffusion generator leverages latent-augmented conditioning to refine and complete the geometric structure. Experimental results demonstrate that RecGen3D achieves superior fidelity and robustness, outperforming existing methods in creating complete and consistent 3D models from sparse observations.

cs.CV↗
arXiv2026

An affirmative solution to the generalized Busemann--Petty problem with subspace dimensions $2$ and $3$

The generalized Busemann--Petty problem asks whether origin-symmetric convex bodies in $\mathbb{R}^n$ having larger volume of all $m$-dimensional sections necessarily have larger volume. When $m\geq 4$, this is known to be false, but the cases $m=2, 3$ for $n\geq 5$ have remained open since the 1990s. In this paper, we resolve these cases. Together with the known results, the generalized Busemann--Petty problem is completely solved: the answer is affirmative for $m=1, 2, 3$, and negative for $m\geq 4$.

math.FA↗
arXiv2026

FlexAM: Flexible Appearance-Motion Decomposition for Versatile Video Generation Control

Effective and generalizable control in video generation remains a significant challenge. While many methods rely on ambiguous or task-specific signals, we argue that a fundamental disentanglement of "appearance" and "motion" provides a more robust and scalable pathway. We propose FlexAM, a unified framework built upon a novel 3D control signal. This signal represents video dynamics as a point cloud, introducing three key enhancements: multi-frequency positional encoding to distinguish fine-grained motion, depth-aware encoding, and a flexible control signal for balancing precision and generalization. This representation allows FlexAM to effectively disentangle appearance and motion, enabling a wide range of tasks including I2V/V2V editing, camera control, and spatial object editing. Extensive experiments demonstrate that FlexAM achieves superior performance across all evaluated tasks.

cs.CV↗
arXiv2026

Topological Rainbow Trapping for Spatial-frequency Demultiplexing of Underwater Acoustic Signals

Efficient separation and localization of multifrequency acoustic waves are essential for underwater target recognition and acoustic energy harvesting. The underwater implementation of topological rainbow trapping remains challenging because of complex fluid-solid interactions and the difficulty of integrating long-range transport with frequency-selective localization in an open system. Here, we theoretically develop and experimentally demonstrate two underwater spatial-frequency demultiplexing mechanisms based on the acoustic analogues of the QVHE and QSHE. Both mechanisms employ SSAWs, whose fields are confined near a structured surface and decay evanescently into the surrounding water, enabling experiments without an enclosed waveguide. In the QVHE mechanism, a spatial gradient along a valley-Hall edge channel shifts the local edge-state dispersion, causing different frequency components to become localized at distinct positions and thereby realizing spectral and spatial demultiplexing. In the QSHE mechanism, one-dimensional topological edge states are coupled to frequency-selective zero-dimensional higher-order corner states. Multifrequency signals first propagate robustly along a common boundary and are then transferred to prescribed remote corners according to frequency, producing a transport-then-confinement process. This mechanism combines defect-tolerant edge transport, frequency-selective corner localization, and remote rainbow trapping. Numerical simulations and experiments verify the frequency-dependent localization and the persistence of the designed transport pathways in the presence of structural defects. The proposed open SSAW platform performs robust frequency demultiplexing at the physical layer, reducing reliance on digital signal processing and offering potential for underwater target recognition and frequency-selective acoustic energy harvesting.

physics.app-ph↗
arXiv2026

Elastic Trapped States at Dislocation Defects in Scaled Coupling and Hofstadter Models

Elastic topological dislocations provide a pathway for trapping elastic wave energy at internal defects, rather than being confined solely to external boundaries or corners, which are typically associated with topological insulators (TIs). However, two practical constraints persist. First, highly confined dislocation states based on conventional Su-Schrieffer-Heeger (SSH) dimerization usually require a large coupling contrast and a correspondingly enlarged bandgap, which may be challenging to realize. Second, some Hamiltonians with richer topological physics often contain complex hopping terms, synthetic gauge fields or nonlocal couplings, which substantially increase the geometric complexity of experimental samples. Here, dislocation-induced trapped states are demonstrated in both a scaled coupling (SC) model and a Hofstadter model (HM) within an elastic platform. In the SC model, the trapped mode is treated as a higher localized state in the continuum rather than an in-gap mode in the SSH model. Consequently, the SC-induced dislocation can trap an enhanced mode without the requirement of an enlarged bandgap. For the HM, Householder tridiagonalization is used to map the original tight-binding Hamiltonian with complex hopping terms onto a tridiagonal matrix with only positive-real-valued nearest-neighbour (NN) hopping terms. Truncation at a weak-hopping position preserves the topological phenomena and allows a dislocation defect to be constructed from the shortened aperiodic chain. The results establish a practical route for designing highly localized modes without relying solely on bandgap enlargement or complex couplings, which advance the topological physics of elastic wave systems and promise enhanced possibilities for elastic functional devices.

physics.app-ph↗
arXiv2026

Chiral Landau levels induced by two in-plane pseudomagnetic fields in underwater acoustic metamaterials

The chiral zeroth Landau levels (LLs) constitute topologically protected bulk states that enable robust control of acoustic wave propagation. Given the central role of underwater acoustics in marine engineering, realizing such Landau-level physics in underwater acoustic systems is highly desirable. Nevertheless, existing studies have primarily been limited to airborne acoustic systems, and the implementation of chiral zeroth LLs in underwater acoustics remains a challenge due to the unavoidable fluid-solid interactions. In this study, we realize two kinds of chiral LLs in an open underwater spoof surface acoustic wave (SSAW) platform by introducing two perpendicular in-plane artificial pseudomagnetic fields (PMFs), oriented along the x and y directions, respectively, and reveal that scalar acoustic fields in water and vectorial elastic vibrations in solids can be jointly manipulated within a unified framework. Specifically, by strategically opening bandgaps at the Dirac points, position-dependent effective mass terms are introduced into the Dirac Hamiltonians, thereby synthesizing two in-plane PMFs. This results in the emergence of chiral LLs, which is confirmed both numerically and experimentally. The unidirectional propagation of the chiral LLs and their robustness against defects are also demonstrated. In addition, we achieve flexible manipulation of underwater ultrasonic energy carried by SSAWs, including beam splitting and arbitrary wave steering. Dual-band chiral LLs are also observed in small-scale underwater topological metamaterials. Our work provides a new route toward SSAW-based underwater ultrasonic control, opening opportunities for multiband underwater acoustic signal processing and detection, as well as underwater acoustic energy harvesting.

physics.app-ph↗
arXiv2026

Experimental Realization of Type-II Quadrupole Topological Insulator

The discovery of quadrupole topological insulators (QTIs) has spurred extensive research into higher-order topological phases. Recently proposed type-II QTIs exhibit unconventional topological behaviors with 1/2 edge polarization \operatorname{p}_x and zero edge polarization \operatorname{p}_y, due to the inequivalence between Wannier-band and edge-spectrum gap closures, yet their experimental realization remains challenging owing to the long-range and complex off-site hopping terms in their tight-binding model (TBM). Here, we circumvent this difficulty via an optimized Householder tridiagonalization (OHT) mapping that reduces the complex two-dimensional lattices to one-dimensional chains with only negative-real-valued nearest-neighbor hopping terms, greatly facilitating experimental sample fabrication. Using this strategy, we experimentally verify the type-II QTI phase, type-I QTI phase and trivial phase in elastic wave platforms via simple aperiodic plate-beam chain structures, where the plates reflect the on-site potential terms and beams correspond to the off-site hopping terms in the TBM. Our approach provides a versatile route for experimentally exploring more complex and richer topological phenomena based on TBM.

physics.app-ph↗
arXiv2026

CelloCut: Constructive Watertight Remeshing via Tetrahedral Cell Cuts

Watertight remeshing aims to recover a surface that induces a globally consistent interior--exterior partition of 3D space. However, for meshes with complex topology, single-layer structures, or large missing regions, inferring such a partition from local surface geometry is inherently ambiguous. As a result, existing methods often produce surface-accurate yet volumetrically inconsistent reconstructions, e.g., closely spaced double shells. The key insight of this work is that watertight remeshing should be treated as a volumetric partitioning problem rather than a surface-level repair task. To this end, we propose CelloCut, a constructive framework that formulates watertight conversion as a binary labeling problem over a Delaunay tetrahedral partition of space. We solve this via graph-cut energy minimization with one-sided constraints that preserve proxy-supported interior evidence and weighted interface penalties that discourage unsupported newly introduced boundaries. By computing a globally consistent volumetric partition, CelloCut guarantees a strictly watertight output by construction and strongly suppresses pseudo-watertight artifacts such as double shells, even under severe topological defects. Experimental results on two newly introduced challenging benchmarks, CelloScan and CelloFill, as well as standard ModelNet10 dataset, demonstrate that CelloCut significantly outperforms state-of-the-art methods, particularly in handling complex topologies and single-layer structures, producing compact and volumetrically consistent solid reconstructions. The project page is available at https://rangeryx-66.github.io/CelloCut/.

cs.GR↗