arXiv subjects

Chao Xu

Publications and source records attributed to Chao Xu.

At least 289 records · Page 16Linked to original sources

arXiv2022

PartAfford: Part-level Affordance Discovery from 3D Objects

Understanding what objects could furnish for humans-namely, learning object affordance-is the crux to bridge perception and action. In the vision community, prior work primarily focuses on learning object affordance with dense (e.g., at a per-pixel level) supervision. In stark contrast, we humans learn the object affordance without dense labels. As such, the fundamental question to devise a computational model is: What is the natural way to learn the object affordance from visual appearance and geometry with humanlike sparse supervision? In this work, we present a new task of part-level affordance discovery (PartAfford): Given only the affordance labels per object, the machine is tasked to (i) decompose 3D shapes into parts and (ii) discover how each part of the object corresponds to a certain affordance category. We propose a novel learning framework for PartAfford, which discovers part-level representations by leveraging only the affordance set supervision and geometric primitive regularization, without dense supervision. The proposed approach consists of two main components: (i) an abstraction encoder with slot attention for unsupervised clustering and abstraction, and (ii) an affordance decoder with branches for part reconstruction, affordance prediction, and cuboidal primitive regularization. To learn and evaluate PartAfford, we construct a part-level, cross-category 3D object affordance dataset, annotated with 24 affordance categories shared among >25, 000 objects. We demonstrate that our method enables both the abstraction of 3D objects and part-level affordance discovery, with generalizability to difficult and cross-category examples. Further ablations reveal the contribution of each component.

cs.CV↗

arXiv2022

Detailed chemistry modelling of rotating detonations with dilute n-heptane sprays and preheated air

Utilization of liquid fuels is crucial to enabling commercialization of rotating detonation engines in the near future. In this study, Eulerian-Lagrangian simulations are conducted for rotating detonative combustion with dilute n-heptane sprays and preheated air. Two-dimensional flattened configuration is used and a skeletal chemical mechanism with 44 species and 112 elementary reactions for n-heptane combustion is adopted. The flow structure, droplet distribution, and thermochemical parameters in the refill zone are first analyzed. It is shown that the mixture in the refill zone is heterogeneous, including evaporating droplets, vapor, and air. When the total temperature is below 950 K, the average equivalence ratio increases with the total temperature. When it is higher than 950 K, the average equivalence ratio is almost constant. Subsequently, the chemical explosive mode analysis is applied to identify the controlling reactions and dominant combustion modes in the fuel refill zone and reaction fronts. Results demonstrate that the initiation reaction and low-temperature reaction are dominant in the upstream and downstream of the refill zone, respectively. The intermediate species from low-temperature chemistry is found to be important for the chemical explosive mode in the undetonated mixture. The influence of species diffusion and dispersed droplets is further analyzed. Results show that vapor autoignition facilitated by droplet evaporation occurs in the refill zone. Finally, the effects of the air total temperature on the detonation propagation speed and RDE propulsion performance are investigated. It is found that the detonation propagation speed and specific impulse increase with air total temperature.

physics.flu-dyn↗

arXiv2022

GPA-Teleoperation: Gaze Enhanced Perception-aware Safe Assistive Aerial Teleoperation

Gaze is an intuitive and direct way to represent the intentions of an individual. However, when it comes to assistive aerial teleoperation which aims to perform operators' intention, rare attention has been paid to gaze. Existing methods obtain intention directly from the remote controller (RC) input, which is inaccurate, unstable, and unfriendly to non-professional operators. Further, most teleoperation works do not consider environment perception which is vital to guarantee safety. In this paper, we present GPA-Teleoperation, a gaze enhanced perception-aware assistive teleoperation framework, which addresses the above issues systematically. We capture the intention utilizing gaze information, and generate a topological path matching it. Then we refine the path into a safe and feasible trajectory which simultaneously enhances the perception awareness to the environment operators are interested in. Additionally, the proposed method is integrated into a customized quadrotor system. Extensive challenging indoor and outdoor real-world experiments and benchmark comparisons verify that the proposed system is reliable, robust and applicable to even unskilled users. We will release the source code of our system to benefit related researches.

cs.RO↗

arXiv2022

SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-Resolution

In the practical application of restoring low-resolution gray-scale images, we generally need to run three separate processes of image colorization, super-resolution, and dows-sampling operation for the target device. However, this pipeline is redundant and inefficient for the independent processes, and some inner features could have been shared. Therefore, we present an efficient paradigm to perform {S}imultaneously Image {C}olorization and {S}uper-resolution (SCS) and propose an end-to-end SCSNet to achieve this goal. The proposed method consists of two parts: colorization branch for learning color information that employs the proposed plug-and-play \emph{Pyramid Valve Cross Attention} (PVCAttn) module to aggregate feature maps between source and reference images; and super-resolution branch for integrating color and texture information to predict target images, which uses the designed \emph{Continuous Pixel Mapping} (CPM) module to predict high-resolution images at continuous magnification. Furthermore, our SCSNet supports both automatic and referential modes that is more flexible for practical application. Abundant experiments demonstrate the superiority of our method for generating authentic images over state-of-the-art methods, e.g., averagely decreasing FID by 1.8$\downarrow$ and 5.1 $\downarrow$ compared with current best scores for automatic and referential modes, respectively, while owning fewer parameters (more than $\times$2$\downarrow$) and faster running speed (more than $\times$3$\uparrow$).

cs.CV↗

arXiv2022

Numerical investigation of the scale effects of rock bridges

The concept of joint persistence has been widely used to study the mechanics and failure processes of rock masses benefitting from the simplicity of statistical linear weighing of the discontinuity. Nevertheless, this term neglects the scale effects of rock bridges, meaning that the same joint persistence may refer to different numbers and spacings of rock bridges, leading to erroneous equivalent rock mass responses. To fill in this gap, an intact rock bridge was dispersed as multi rock bridges while maintaining a constant joint persistence, subjected to direct shear by conducting numerical simulations employing Universal Distinct Element Code (UDEC). In this way, scale effects of rock bridges were investigated from the perspective of load-displacement curves, stress and displacement fields, crack propagations and AE characterizations. Results revealed that the shear resistance and the area and value of stress-concentration decreased with increasing dispersion. Furthermore, uneven distribution of displacement fields in an arc manner moving and degrading away from the load was first observed, indicating the sequential failure of multi rock bridges. It was also found that the propagation of wing cracks was insensitive to scale, while the asperity of macro shear fracture mainly formed by secondary cracks decreased with increasing dispersion. In addition, increasing dispersion of rock bridges would overlap the failure precursors identified by intense AE activities. Based on the abovementioned results, we evaluated existing methods to characterize the joint persistence, and a threshold was observed to possibly define a rock bridge.

physics.geo-ph↗

arXiv2022

Autonomous and Adaptive Navigation for Terrestrial-Aerial Bimodal Vehicles

Terrestrial-aerial bimodal vehicles bloom in both academia and industry because they incorporate both the high mobility of aerial vehicles and the long endurance of ground vehicles. In this work, we present an autonomous and adaptive navigation framework to bring complete autonomy to this class of vehicles. The framework mainly includes 1) a hierarchical motion planner that generates safe and low-power terrestrial-aerial trajectories in unknown environments and 2) a unified motion controller which dynamically adjusts energy consumption in terrestrial locomotion. Extensive real-world experiments and benchmark comparisons are conducted on a customized robot platform to validate the proposed framework's robustness and performance. During the tests, the robot safely traverses complex environments with terrestrial-aerial integrated mobility, and achieves $7\times$ energy savings in terrestrial locomotion. Finally, we will release our code and hardware configuration for the reference of the community.

cs.RO↗

arXiv2021

An automatic approach to explore multi-reaction mechanism for medium-sized bimolecular reactions via collision dynamics simulations and transition state searches

We develop a broadly-applicable computational method for the automatic exploration of the bimolecular multi-reaction mechanism. The current methodology mainly involves the high-energy Born-Oppenheimer molecular dynamics (BOMD) simulation and the successive reaction pathway construction. Several computational tricks are introduced, which include the selection of the reactive regions based on the electronic-structure calculations and the employment of the virtual collision-dynamics simulations with monitoring atomic distance before BOMD. These prescreening steps largely reduce the number of trajectories in the BOMD simulations and significantly save computational cost. The hidden Markov model combined with modified atomic connectivity matrix is taken for the detection of reaction events in each BOMD trajectory. Starting from several geometries close to reaction events, the further intermediate optimization and transition-state searches are conducted. The proposed method allows us to build the complicated multi-reaction mechanism of medium-sized bimolecular systems automatically. Here we examine the feasibility and efficiency of the current method by its performance in searching the mechanisms of two prototype reactions in environmental science, which are the penicillin G anion + H2O and the penicillin G anion + OH radical reactions. The result indicates that the proposed theoretical method is a powerful protocol for the automatic searching of the bimolecular reaction mechanisms for medium-sized compounds.

physics.chem-ph↗

arXiv2021

DTVNet+: A High-Resolution Scenic Dataset for Dynamic Time-lapse Video Generation

This paper presents a novel end-to-end dynamic time-lapse video generation framework, named DTVNet, to generate diversified time-lapse videos from a single landscape image conditioned on normalized motion vectors. The proposed DTVNet consists of two submodules: \emph{Optical Flow Encoder} (OFE) and \emph{Dynamic Video Generator} (DVG). The OFE maps a sequence of optical flow maps to a \emph{normalized motion vector} that encodes the motion information of the generated video. The DVG contains motion and content streams to learn from the motion vector and the single landscape image. Besides, it contains an encoder to learn shared content features and a decoder to construct video frames with corresponding motion. Specifically, the \emph{motion stream} introduces multiple \emph{adaptive instance normalization} (AdaIN) layers to integrate multi-level motion information for controlling the object motion. In the testing stage, videos with the same content but various motion information can be generated by different \emph{normalized motion vectors} based on only one input image. Also, we propose a high-resolution scenic time-lapse video dataset, named Quick-Sky-Time, to evaluate different approaches, which can be viewed as a new benchmark for high-quality scenic image and video generation tasks. We further conduct experiments on Sky Time-lapse, Beach, and Quick-Sky-Time datasets. The results demonstrate the superiority of our approach over state-of-the-art methods for generating high-quality and various dynamic videos.

cs.CV↗

arXiv2021

Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model

Inspired by biological evolution, we explain the rationality of Vision Transformer by analogy with the proven practical Evolutionary Algorithm (EA) and derive that both of them have consistent mathematical representation. Analogous to the dynamic local population in EA, we improve the existing transformer structure and propose a more efficient EAT model, and design task-related heads to deal with different tasks more flexibly. Moreover, we introduce the spatial-filling curve into the current vision transformer to sequence image data into a uniform sequential format. Thus we can design a unified EAT framework to address multi-modal tasks, separating the network architecture from the data format adaptation. Our approach achieves state-of-the-art results on the ImageNet classification task compared with recent vision transformer works while having smaller parameters and greater throughput. We further conduct multi-modal tasks to demonstrate the superiority of the unified EAT, e.g., Text-Based Image Retrieval, and our approach improves the rank-1 by +3.7 points over the baseline on the CSS dataset.

cs.CV↗

arXiv2021

Hire-MLP: Vision MLP via Hierarchical Rearrangement

Previous vision MLPs such as MLP-Mixer and ResMLP accept linearly flattened image patches as input, making them inflexible for different input sizes and hard to capture spatial information. Such approach withholds MLPs from getting comparable performance with their transformer-based counterparts and prevents them from becoming a general backbone for computer vision. This paper presents Hire-MLP, a simple yet competitive vision MLP architecture via \textbf{Hi}erarchical \textbf{re}arrangement, which contains two levels of rearrangements. Specifically, the inner-region rearrangement is proposed to capture local information inside a spatial region, and the cross-region rearrangement is proposed to enable information communication between different regions and capture global context by circularly shifting all tokens along spatial directions. Extensive experiments demonstrate the effectiveness of Hire-MLP as a versatile backbone for various vision tasks. In particular, Hire-MLP achieves competitive results on image classification, object detection and semantic segmentation tasks, e.g., 83.8% top-1 accuracy on ImageNet, 51.7% box AP and 44.8% mask AP on COCO val2017, and 49.9% mIoU on ADE20K, surpassing previous transformer-based and MLP-based models with better trade-off for accuracy and throughput. Code is available at https://github.com/ggjy/Hire-Wave-MLP.pytorch.

cs.CV↗

arXiv2021

Pre-Trained Image Processing Transformer

As the computing power of modern hardware is increasing strongly, pre-trained deep learning models (e.g., BERT, GPT-3) learned on large-scale datasets have shown their effectiveness over conventional methods. The big progress is mainly contributed to the representation ability of transformer and its variant architectures. In this paper, we study the low-level computer vision task (e.g., denoising, super-resolution and deraining) and develop a new pre-trained model, namely, image processing transformer (IPT). To maximally excavate the capability of transformer, we present to utilize the well-known ImageNet benchmark for generating a large amount of corrupted image pairs. The IPT model is trained on these images with multi-heads and multi-tails. In addition, the contrastive learning is introduced for well adapting to different image processing tasks. The pre-trained model can therefore efficiently employed on desired task after fine-tuning. With only one pre-trained model, IPT outperforms the current state-of-the-art methods on various low-level benchmarks. Code is available at https://github.com/huawei-noah/Pretrained-IPT and https://gitee.com/mindspore/mindspore/tree/master/model_zoo/research/cv/IPT

cs.CV↗

arXiv2021

Ultrafast Internal Conversion Dynamics Through the on-the-fly Simulation of Transient Absorption Pump-Probe Spectra with Different Electronic Structure Methods

The ultrafast nonadiabatic internal conversion in azomethane is explored by the on-the-fly trajectory surface-hopping simulations of photoinduced dynamics and femtosecond transient absorption (TA) pump-probe (PP) spectra at three electronic-structure theory levels, OM2/MRCI, SA-CASSCF, and XMS-CASPT2. All these dynamics simulations predict ultrafast internal conversion. On the one hand, the OM2/MRCI and SA-CASSCF methods yield similar excited-state dynamics, while the XMS-CASPT2 method predicts a much slower population decay. On the other hand, the TA PP signals simulated at the SA-CASSCF and XMS-CASPT2 levels show the similar spectral features, particularly for the similar stimulated emission contributions, while the OM2/MRCI signals are quite different. This demonstrates that the nonadiabatic population dynamics and time-resolved stimulated emission signals may reflect different aspects of photoinduced processes. The combination of the dynamical and spectral simulations definitely provides more accurate and detailed information which sheds light on the microscopic mechanisms of photophysical and photochemical processes.

physics.chem-ph↗

arXiv2021

The Optimal Pilot Power Allocation Strategy for Multi-IRS Assisted Communication Systems

Intelligent reflecting surface (IRS) is a promising technology that enables the precise control of the electromagnetic environment in future wireless communication networks. To leverage the IRS effectively, the acquisition of channel state information (CSI) is crucial in IRS-assisted communication systems, which, however, is challenging. In this paper, we propose the optimal pilot power allocation strategy for the channel estimation of IRS-assisted communication systems, which is capable of further improving the achievable rate performance with imperfect CSI. More specifically, first of all, we introduce a multi-IRS-assisted communication system in the face of practical channel estimation errors. Furthermore, the ergodic capacity with imperfect CSI is derived in an explicit closed-form expression under the single-input single-output (SISO) consideration. Secondly, we formulate the optimization problem of maximizing the ergodic capacity with imperfect CSI, subject to the constraint of the average uplink pilot power. Thirdly, the method of Lagrange multipliers is invoked to solve the ergodic rate maximizing problem and thus to obtain the optimal pilot power allocation strategy. The resultant pilot power allocation solution suggests allocating more amount of power to the pilots for estimating the weak reflection channels. Besides, we also elaborate on the expense of the proposed pilot power allocation strategy upon analyzing the peak-to-average-power ratio (PAPR) increase quantitatively. Finally, the extensive simulation results verify our analysis and reveal some interesting results. For example, for the user in the vicinity of a large IRS, it is suggested to switch off other IRSs and only switch on the IRS nearest the user; For the user near a small IRS, it is better to switch on all IRSs and perform the optimal pilot power allocation for enhancing the achievable rate performance.

cs.IT↗

arXiv2021

Reconfigurable Intelligent Surface-Enhanced OFDM Communications via Delay Adjustable Metasurface

Reconfigurable intelligent surface (RIS) is a promising technology for establishing spectral- and energy-efficient wireless networks. In this paper, we study RIS-enhanced orthogonal frequency division multiplexing (OFDM) communications, which generalize the existing RIS-driven context focusing only on frequency-flat channels. Firstly, we introduce the delay adjustable metasurface (DAM) relying on varactor diodes. In contrast to existing reflecting elements, each one in DAM is capable of storing and retrieving the impinging electromagnetic waves upon dynamically controlling its electromagnetically induced transparency (EIT) properties, thus additionally imposing an extra delay onto the reflected incident signals. Secondly, we formulate the rate-maximization problem by jointly optimizing the transmit power allocation and the RIS reflection coefficients as well as the RIS delays. Furthermore, to address the coupling among optimization variables, we propose an efficient algorithm to achieve a high-quality solution for the formulated non-convex design problem by alternately optimizing the transmit power allocation and the RIS reflection pattern, including the reflection coefficients and the delays. Thirdly, to circumvent the high complexity for optimizing the RIS reflection coefficients, we conceive a low-complexity scheme upon aligning the strongest taps of all reflected channels, while ensuring that the maximum delay spread after introducing extra RIS delays does not exceed the length of the cyclic prefix (CP). Finally, simulation results demonstrate that the proposed design significantly improves the OFDM rate performance as well as the RIS's adaptability to wideband signals compared to baseline schemes without employing DAM.

cs.IT↗

arXiv2021

Age of Changed Information: Content-Aware Status Updating in the Internet of Things

In Internet of Things (IoT), the freshness of status updates is crucial for mission-critical applications. In this regard, it is suggested to quantify the freshness of updates by using Age of Information (AoI) from the receiver's perspective. Specifically, the AoI measures the freshness over time. However, the freshness in the content is neglected. In this paper, we introduce an age-based utility, named as Age of Changed Information (AoCI), which captures both the passage of time and the change of information content. By modeling the underlying physical process as a discrete time Markov chain, we investigate the AoCI in a time-slotted status update system, where a sensor samples the physical process and transmits the update packets to the destination. With the aim of minimizing the weighted sum of the AoCI and the update cost, we formulate an infinite horizon average cost Markov Decision Process. We show that the optimal updating policy has a special structure with respect to the AoCI and identify the condition under which the special structure exists. By exploiting the special structure, we provide a low complexity relative policy iteration algorithm that finds the optimal updating policy. We further investigate the optimal policy for two special cases. In the first case where the state of the physical process transits with equiprobability, we show that optimal policy is of threshold type and derive the closed-form of the optimal threshold. We then study a more generalized periodic Markov model of the physical process in the second case. Lastly, simulation results are laid out to exhibit the performance of the optimal updating policy and its superiority over the zero-wait baseline policy.

cs.IT↗

arXiv2021

External Forces Resilient Safe Motion Planning for Quadrotor

Adaptive autonomous navigation with no prior knowledge of extraneous disturbance is of great significance for quadrotors in a complex and unknown environment. The mainstream that considers external disturbance is to implement disturbance-rejected control and path tracking. However, the robust control to compensate for tracking deviations is not well-considered regarding energy consumption, and even the reference path will become risky and intractable with disturbance. As recent external forces estimation advances, it is possible to incorporate a real-time force estimator to develop more robust and safe planning frameworks. This paper proposes a systematic (re)planning framework that can resiliently generate safe trajectories under volatile conditions. Firstly, a front-end kinodynamic path is searched with force-biased motion primitives. Then we develop a nonlinear model predictive control (NMPC) as a local planner with Hamilton-Jacobi (HJ) forward reachability analysis for error dynamics caused by external forces. It guarantees collision avoidance by constraining the ellipsoid of the quadrotor body expanded with the forward reachable sets (FRSs) within safe convex polytopes. Our method is validated in simulations and real-world experiments with different sources of external forces.

cs.RO↗

arXiv2021

Robust Trajectory Planning for Spatial-Temporal Multi-Drone Coordination in Large Scenes

In this paper, we describe a robust multi-drone planning framework for high-speed trajectories in large scenes. It uses a free-space-oriented map to free the optimization from cumbersome environment data. A capsule-like safety constraint is designed to avoid reciprocal collisions when vehicles deviate from their nominal flight progress under disturbance. We further show the minimum-singularity differential flatness of our drone dynamics with nonlinear drag effects involved. Leveraging the flatness map, trajectory optimization is efficiently conducted on the flat outputs while still subject to physical limits considering drag forces at high speeds. The robustness and effectiveness of our framework are both validated in large-scale simulations. It can compute collision-free trajectories satisfying high-fidelity vehicle constraints for hundreds of drones in a few minutes.

cs.RO↗

arXiv2021

STD-Trees: Spatio-temporal Deformable Trees for Multirotors Kinodynamic Planning

In constrained solution spaces with a huge number of homotopy classes, stand-alone sampling-based kinodynamic planners suffer low efficiency in convergence. Local optimization is integrated to alleviate this problem. In this paper, we propose to thrive the trajectory tree growing by optimizing the tree in the forms of deformation units, and each unit contains one tree node and all the edges connecting it. The deformation proceeds both spatially and temporally by optimizing the node state and edge time durations efficiently. The unit only changes the tree locally yet improves the overall quality of a corresponding sub-tree. Further, variants to deform different tree parts considering the computation burden and optimizing level are studied and compared, all showing much faster convergence. The proposed deformation is compatible with different RRT-based kinodynamic planning methods, and numerical experiments show that integrating the spatio-temporal deformation greatly accelerates the convergence and outperforms the spatial-only deformation.

cs.RO↗