arXiv Science⌕ Search

arXiv subjects

Tao Liu

Publications and source records attributed to Tao Liu.

At least 181 records · Page 10Linked to original sources

FastGrasp: Efficient Grasp Synthesis with Diffusion

Effectively modeling the interaction between human hands and objects is challenging due to the complex physical constraints and the requirement for high generation efficiency in applications. Prior approaches often employ computationally intensive two-stage approaches, which first generate an intermediate representation, such as contact maps, followed by an iterative optimization procedure that updates hand meshes to capture the hand-object relation. However, due to the high computation complexity during the optimization stage, such strategies often suffer from low efficiency in inference. To address this limitation, this work introduces a novel diffusion-model-based approach that generates the grasping pose in a one-stage manner. This allows us to significantly improve generation speed and the diversity of generated hand poses. In particular, we develop a Latent Diffusion Model with an Adaptation Module for object-conditioned hand pose generation and a contact-aware loss to enforce the physical constraints between hands and objects. Extensive experiments demonstrate that our method achieves faster inference, higher diversity, and superior pose quality than state-of-the-art approaches. Code is available at \href{https://github.com/wuxiaofei01/FastGrasp}{https://github.com/wuxiaofei01/FastGrasp.}

cs.RO↗

High-Speed Cornering Control and Real-Vehicle Deployment for Autonomous Electric Vehicles

Executing drift maneuvers during high-speed cornering presents significant challenges for autonomous vehicles, yet offers the potential to minimize turning time and enhance driving dynamics. While reinforcement learning (RL) has shown promising results in simulated environments, discrepancies between simulations and real-world conditions have limited its practical deployment. This study introduces an innovative control framework that integrates trajectory optimization with drift maneuvers, aiming to improve the algorithm's adaptability for real-vehicle implementation. We leveraged Bezier-based pre-trajectory optimization to enhance rewards and optimize the controller through Twin Delayed Deep Deterministic Policy Gradient (TD3) in a simulated environment. For real-world deployment, we implement a hybrid RL-MPC fusion mechanism, , where TD3-derived maneuvers serve as primary inputs for a Model Predictive Controller (MPC). This integration enables precise real-time tracking of the optimal trajectory, with MPC providing corrective inputs to bridge the gap between simulation and reality. The efficacy of this method is validated through real-vehicle tests on consumer-grade electric vehicles, focusing on drift U-turns and drift right-angle turns. The control outcomes of these real-vehicle tests are thoroughly documented in the paper, supported by supplementary video evidence (https://youtu.be/5wp67FcpfL8). Notably, this study is the first to deploy and apply an RL-based transient drift cornering algorithm on consumer-grade electric vehicles.

cs.RO↗

Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference

One of the main drawback of diffusion models is the slow inference time for image generation. Among the most successful approaches to addressing this problem are distillation methods. However, these methods require considerable computational resources. In this paper, we take another approach to diffusion model acceleration. We conduct a comprehensive study of the UNet encoder and empirically analyze the encoder features. This provides insights regarding their changes during the inference process. In particular, we find that encoder features change minimally, whereas the decoder features exhibit substantial variations across different time-steps. This insight motivates us to omit encoder computation at certain adjacent time-steps and reuse encoder features of previous time-steps as input to the decoder in multiple time-steps. Importantly, this allows us to perform decoder computation in parallel, further accelerating the denoising process. Additionally, we introduce a prior noise injection method to improve the texture details in the generated image. Besides the standard text-to-image task, we also validate our approach on other tasks: text-to-video, personalized generation and reference-guided generation. Without utilizing any knowledge distillation technique, our approach accelerates both the Stable Diffusion (SD) and DeepFloyd-IF model sampling by 41$\%$ and 24$\%$ respectively, and DiT model sampling by 34$\%$, while maintaining high-quality generation performance.

cs.CV↗

Instrumental Variable Approach to Estimating Individual Causal Effects in N-of-1 Trials: Application to ISTOP Study

An N-of-1 trial is a multiple crossover trial conducted in a single individual to provide evidence to directly inform personalized treatment decisions. Advancements in wearable devices greatly improved the feasibility of adopting these trials to identify optimal individual treatment plans, particularly when treatments differ among individuals and responses are highly heterogeneous. Our work was motivated by the I-STOP-AFib Study, which examined the impact of different triggers on atrial fibrillation (AF) occurrence. We described a causal framework for 'N-of-1' trial using potential treatment selection paths and potential outcome paths. Two estimands of individual causal effect were defined:(a) the effect of continuous exposure, and (b) the effect of an individual observed behavior. We addressed three challenges: (a) imperfect compliance to the randomized treatment assignment; (b) binary treatments and binary outcomes which led to the 'non-collapsibility' issue of estimating odds ratios; and (c) serial inference in the longitudinal observations. We adopted the Bayesian IV approach where the study randomization was the IV as it impacted the choice of exposure of a subject but not directly the outcome. Estimations were through a system of two parametric Bayesian models to estimate the individual causal effect. Our model got around the non-collapsibility and non-consistency by modeling the confounding mechanism through latent structural models and by inferring with Bayesian posterior of functionals. Autocorrelation present in the repeated measurements was also accounted for. The simulation study showed our method largely reduced bias and greatly improved the coverage of the estimated causal effect, compared to existing methods (ITT, PP, and AT). We applied the method to I-STOP-AFib Study to estimate the individual effect of alcohol on AF occurrence.

stat.ME↗

GPU Acceleration of Numerical Atomic Orbitals-Based Density Functional Theory Algorithms within the ABACUS package

With the fast developments of high-performance computing, first-principles methods based on quantum mechanics play a significant role in materials research, serving as fundamental tools for predicting and analyzing various properties of materials. However, the inherent complexity and substantial computational demands of first-principles algorithms, such as density functional theory, limit their use in larger systems. The rapid development of heterogeneous computing, particularly General-Purpose Graphics Processing Units (GPGPUs), has heralded new prospects for enhancing the performance and cost-effectiveness of first-principles algorithms. We utilize GPGPUs to accelerate the electronic structure algorithms in Atomic-orbital Based Ab-initio Computation at USTC (ABACUS), a first-principles computational package based on the linear combination of atomic orbitals (LCAO) basis set. We design algorithms on GPGPU to efficiently construct and diagonalize the Hamiltonian of a given system, including the related force and stress calculations. The effectiveness of this computational acceleration has been demonstrated through calculations on twisted bilayer graphene with the system size up to 10,444 atoms.

cond-mat.mtrl-sci↗

GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splatting

Reliable self-localization is a foundational skill for many intelligent mobile platforms. This paper explores the use of event cameras for motion tracking thereby providing a solution with inherent robustness under difficult dynamics and illumination. In order to circumvent the challenge of event camera-based mapping, the solution is framed in a cross-modal way. It tracks a map representation that comes directly from frame-based cameras. Specifically, the proposed method operates on top of gaussian splatting, a state-of-the-art representation that permits highly efficient and realistic novel view synthesis. The key of our approach consists of a novel pose parametrization that uses a reference pose plus first order dynamics for local differential image rendering. The latter is then compared against images of integrated events in a staggered coarse-to-fine optimization scheme. As demonstrated by our results, the realistic view rendering ability of gaussian splatting leads to stable and accurate tracking across a variety of both publicly available and newly recorded data sequences.

cs.CV↗

Irreversible Diagonalization of Mechanical Quantities and the EPR Paradox

The closure relation of quantum mechanical projection operators is not entirely true; it can be strictly falsified under unitary transformations in Fock states. The angular momentum $J_x$, $J_y$ and $J_z$ are simultaneously diagonalized under the orthonormal set $\{|ϕ_n\rangle\}$ of continuous rotation transformations in Fock states. $\{|ϕ_n\rangle\}$'s time reversal $\{ \mathcal{T} |ϕ_n\rangle \}$ is the zero point of coordinates q and momentum p, and its arbitrary translation transformation $\{ \mathcal{D} \mathcal{T} |ϕ_n\rangle \}$ diagonalizes both coordinates and momentum simultaneously. The abstract representation of the Dirac state vector implies the symmetry breaking of the non-Abelian group unit matrix $\{ \mathcal{U}^ \mathcal{H} \mathcal{U} \neq \mathcal{U} \mathcal{U} ^\mathcal{H} \}$. The EPR paradox is merely a fallacy under the reversible diagonalization of physical reality, it is resolved under irreversible diagonalization.

quant-ph↗

Multi-robot Task Allocation and Path Planning with Maximum Range Constraints

This letter presents a novel multi-robot task allocation and path planning method that considers robots' maximum range constraints in large-sized workspaces, enabling robots to complete the assigned tasks within their range limits. Firstly, we developed a fast path planner to solve global paths efficiently. Subsequently, we propose an innovative auction-based approach that integrates our path planner into the auction phase for reward computation while considering the robots' range limits. This method accounts for extra obstacle-avoiding travel distances rather than ideal straight-line distances, resolving the coupling between task allocation and path planning. Additionally, to avoid redundant computations during iterations, we implemented a lazy auction strategy to speed up the convergence of the task allocation. Finally, we validated the proposed method's effectiveness and application potential through extensive simulation and real-world experiments. The implementation code for our method will be available at https://github.com/wuuya1/RangeTAP.

cs.RO↗

Commensurate and Incommensurate Chern Insulators in Magic-angle Bilayer Graphene

The interplay between strong electron-electron interaction and symmetry breaking can have profound influence on the topological properties of materials. In magic angle twisted bilayer graphene (MATBG), the flat band with a single SU(4) flavor associated with the spin and valley degrees of freedom gains non-zero Chern number when C2z symmetry or C2zT symmetry is broken. Electron-electron interaction can further lift the SU(4) degeneracy, leading to the Chern insulator states. Here we report a complete sequence of zero-field Chern insulators at all odd integer fillings (v = +-1, +-3) with different chirality (C = 1 or -1) in hBN aligned MATBG which structurally breaks C2z symmetry. The Chern states at hole fillings (v = -1, -3), which are firstly observed in this work, host an opposite chirality compared with the electron filling scenario. By slightly doping the v = +-3 states, we have observed new correlated insulating states at incommensurate moiré fillings which is highly suggested to be intrinsic Wigner crystals according to our theoretical calculations. Remarkably, we have observed prominent Streda-formula violation around v = -3 state. By doping the Chern gap at v = -3 with notable number of electrons at finite magnetic field, the Hall resistance Ryx robustly quantizes to ~ h/e2 whereas longitudinal resistance Rxx vanishes, indicating that the chemical potential is pinned within a Chern gap, forming an incommensurate Chern insulator. By providing the first experimental observation of zero-field Chern insulators in the flat valence band, our work fills up the overall topological framework of MATBG with broken C2z symmetry. Our findings also demonstrate that doped topological flat band is an ideal platform to investigate exotic incommensurate correlated topological states.

cond-mat.mes-hall↗

FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Rendering

This work introduces FlashGS, an open-source CUDA Python library, designed to facilitate the efficient differentiable rasterization of 3D Gaussian Splatting through algorithmic and kernel-level optimizations. FlashGS is developed based on the observations from a comprehensive analysis of the rendering process to enhance computational efficiency and bring the technique to wide adoption. The paper includes a suite of optimization strategies, encompassing redundancy elimination, efficient pipelining, refined control and scheduling mechanisms, and memory access optimizations, all of which are meticulously integrated to amplify the performance of the rasterization process. An extensive evaluation of FlashGS' performance has been conducted across a diverse spectrum of synthetic and real-world large-scale scenes, encompassing a variety of image resolutions. The empirical findings demonstrate that FlashGS consistently achieves an average 4x acceleration over mobile consumer GPUs, coupled with reduced memory consumption. These results underscore the superior performance and resource optimization capabilities of FlashGS, positioning it as a formidable tool in the domain of 3D rendering.

cs.CV↗

CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Models

What a large language model (LLM) would respond in ethically relevant context? In this paper, we curate a large benchmark CMoralEval for morality evaluation of Chinese LLMs. The data sources of CMoralEval are two-fold: 1) a Chinese TV program discussing Chinese moral norms with stories from the society and 2) a collection of Chinese moral anomies from various newspapers and academic papers on morality. With these sources, we aim to create a moral evaluation dataset characterized by diversity and authenticity. We develop a morality taxonomy and a set of fundamental moral principles that are not only rooted in traditional Chinese culture but also consistent with contemporary societal norms. To facilitate efficient construction and annotation of instances in CMoralEval, we establish a platform with AI-assisted instance generation to streamline the annotation process. These help us curate CMoralEval that encompasses both explicit moral scenarios (14,964 instances) and moral dilemma scenarios (15,424 instances), each with instances from different data sources. We conduct extensive experiments with CMoralEval to examine a variety of Chinese LLMs. Experiment results demonstrate that CMoralEval is a challenging benchmark for Chinese LLMs. The dataset is publicly available at \url{https://github.com/tjunlp-lab/CMoralEval}.

cs.CL↗

Learning Based Toolpath Planner on Diverse Graphs for 3D Printing

This paper presents a learning based planner for computing optimized 3D printing toolpaths on prescribed graphs, the challenges of which include the varying graph structures on different models and the large scale of nodes & edges on a graph. We adopt an on-the-fly strategy to tackle these challenges, formulating the planner as a Deep Q-Network (DQN) based optimizer to decide the next `best' node to visit. We construct the state spaces by the Local Search Graph (LSG) centered at different nodes on a graph, which is encoded by a carefully designed algorithm so that LSGs in similar configurations can be identified to re-use the earlier learned DQN priors for accelerating the computation of toolpath planning. Our method can cover different 3D printing applications by defining their corresponding reward functions. Toolpath planning problems in wire-frame printing, continuous fiber printing, and metallic printing are selected to demonstrate its generality. The performance of our planner has been verified by testing the resultant toolpaths in physical experiments. By using our planner, wire-frame models with up to 4.2k struts can be successfully printed, up to 93.3% of sharp turns on continuous fiber toolpaths can be avoided, and the thermal distortion in metallic printing can be reduced by 24.9%.

cs.RO↗

EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimization

Event cameras are an interesting visual exteroceptive sensor that reacts to brightness changes rather than integrating absolute image intensities. Owing to this design, the sensor exhibits strong performance in situations of challenging dynamics and illumination conditions. While event-based simultaneous tracking and mapping remains a challenging problem, a number of recent works have pointed out the sensor's suitability for prior map-based tracking. By making use of cross-modal registration paradigms, the camera's ego-motion can be tracked across a large spectrum of illumination and dynamics conditions on top of accurate maps that have been created a priori by more traditional sensors. The present paper follows up on a recently introduced event-based geometric semi-dense tracking paradigm, and proposes the addition of inertial signals in order to robustify the estimation. More specifically, the added signals provide strong cues for pose initialization as well as regularization during windowed, multi-frame tracking. As a result, the proposed framework achieves increased performance under challenging illumination conditions as well as a reduction of the rate at which intermediate event representations need to be registered in order to maintain stable tracking across highly dynamic sequences. Our evaluation focuses on a diverse set of real world sequences and comprises a comparison of our proposed method against a purely event-based alternative running at different rates.

cs.CV↗

Deep Learning Meets OBIA: Tasks, Challenges, Strategies, and Perspectives

Deep learning has gained significant attention in remote sensing, especially in pixel- or patch-level applications. Despite initial attempts to integrate deep learning into object-based image analysis (OBIA), its full potential remains largely unexplored. In this article, as OBIA usage becomes more widespread, we conducted a comprehensive review and expansion of its task subdomains, with or without the integration of deep learning. Furthermore, we have identified and summarized five prevailing strategies to address the challenge of deep learning's limitations in directly processing unstructured object data within OBIA, and this review also recommends some important future research directions. Our goal with these endeavors is to inspire more exploration in this fascinating yet overlooked area and facilitate the integration of deep learning into OBIA processing workflows.

cs.CV↗

Bistability in spatiotemporal mode-locking with dynamic multimode gain

Three-dimensional (3D) dissipative soliton existed in spatiotemporal mode-locked (STML) multimode fiber laser has been demonstrated to be a promising formalism for generating high-energy femtosecond pulses, which unfortunately exhibit diverse spatiotemporal dynamics that have not been fully understood. Completely modeling the STML multimode fiber lasers can shed new light on the underlying physics of the spatiotemporal dynamics and thus better manipulate the generation of high-quality energic femtosecond pulses, which however is still largely unmet. To this end, here we theoretically investigate a dynamic multimode gain model of the STML multimode fiber laser by exploring the multimode rate equation (MMRE) in the framework of generalized multimode nonlinear Schrödinger equation. Using this dynamic multimode gain model, the attractor dissection theory is revisited to understand the dominant effects that determine the modal composition of 3D dissipative soliton. Specifically, by varying the numerical aperture of the multimode gain fiber (MMGF), different gain dynamics that correspond to distinct types of gain attractors are observed. As a result, two distinguishing STML operation regimes, respectively governed by the multimode gain effect and spatiotemporal saturable absorption, are identified. In the latter regime, especially, 3D dissipative solitons present bistability that there exist bifurcated solutions with two different linearly polarized (LP) mode compositions. To verify the theoretical findings, the experimental implementation shows that the state of STML can be switched between different LP modes, and confirms the presence of bistability. Particularly, the 3D-soliton shaping mechanism that is governed by the multimode gain effect is testified for the first time, to the best of our knowledge.

physics.optics↗

Applications of Bound States in the Continuum in Photonics

Bound states in the continuum (BICs) have attracted attention in photonics owing to their interesting properties. For example, BICs can effectively confine light in a counter-intuitive way and the far-field radiation of photonic structures that exhibit BICs manifests fascinating topological characteristics. Early research into photonic BICs was primarily focused on designing artificial structures to produce BICs. However, since the mid-2010s, exploring the potential applications of BICs has been a growing trend in research. In this Review, we detail the unique properties of BICs, including the ability to achieve enhanced light confinement, sharp Fano resonances, and topological characteristics. We also explore phenomena derived from BICs including the generation of circularly polarized states and unidirectional guided resonances and the impact of BICs on various applications such as lasing, nonlinear frequency conversion, waveguiding, sensing and wavefront control. We also discuss the insights provided by BICs in several emerging research frontiers, such as parity-time symmetric systems, higher-order topology, exciton-photon coupling, and moiré superlattices.

physics.optics↗

Towards Open Domain Text-Driven Synthesis of Multi-Person Motions

This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it remains challenging to synthesize motions for more than one or two subjects from in-the-wild prompts, mainly due to the lack of available datasets. In this work, we curate human pose and motion datasets by estimating pose information from large-scale image and video datasets. Our models use a transformer-based diffusion framework that accommodates multiple datasets with any number of subjects or frames. Experiments explore both generation of multi-person static poses and generation of multi-person motion sequences. To our knowledge, our method is the first to generate multi-subject motion sequences with high diversity and fidelity from a large variety of textual prompts.

cs.CV↗

Unveiling mussel plaque core ductility: the role of pore distribution and hierarchical structure

The mussel thread-plaque system exhibits strong adhesion and high ductility, allowing it to adhere to various surfaces. While the microstructure of plaques has been thoroughly studied, the effect of their unique porous structure on ductility remains unclear. This study firstly investigated the porous structure of mussel plaque cores using scanning electron microscopy (SEM). Two-dimensional (2D) porous representative volume elements (RVEs) with scaled distribution parameters were generated, and the calibrated phase-field modelling method was applied to analyse the effect of the pore distribution and multi-scale porous structure on the failure mechanism of porous RVEs. The SEM analysis revealed that large-scale pores exhibited a lognormal size distribution and a uniform spatial distribution. Simulations showed that increasing the normalised mean radius value of the large-scale pore distribution can statistically lead to a decreasing trend in ductility, strength and strain energy, but cannot solely determine their values. The interaction between pores can lead to two different failure modes under the same pore distribution: progressive failure mode and sudden failure mode. Additionally, the hierarchical structure of multi-scale porous RVEs can further increase ductility by 40%-60% compared to single-scale porous RVEs by reducing stiffness, highlighting the hierarchical structure could be another key factor contributing to the high ductility. These findings deepen our understanding of how the pore distribution and multi-scale porous structure in mussel plaques contribute to their high ductility and affect other mechanical properties, providing valuable insights for the future design of highly ductile biomimetic materials.

physics.app-ph↗