arXiv subjects

Yu Liu

Publications and source records attributed to Yu Liu.

At least 685 records · Page 38Linked to original sources

arXiv2023

GeoMIM: Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D Understanding

Multi-view camera-based 3D detection is a challenging problem in computer vision. Recent works leverage a pretrained LiDAR detection model to transfer knowledge to a camera-based student network. However, we argue that there is a major domain gap between the LiDAR BEV features and the camera-based BEV features, as they have different characteristics and are derived from different sources. In this paper, we propose Geometry Enhanced Masked Image Modeling (GeoMIM) to transfer the knowledge of the LiDAR model in a pretrain-finetune paradigm for improving the multi-view camera-based 3D detection. GeoMIM is a multi-camera vision transformer with Cross-View Attention (CVA) blocks that uses LiDAR BEV features encoded by the pretrained BEV model as learning targets. During pretraining, GeoMIM's decoder has a semantic branch completing dense perspective-view features and the other geometry branch reconstructing dense perspective-view depth maps. The depth branch is designed to be camera-aware by inputting the camera's parameters for better transfer capability. Extensive results demonstrate that GeoMIM outperforms existing methods on nuScenes benchmark, achieving state-of-the-art performance for camera-based 3D object detection and 3D segmentation. Code and pretrained models are available at https://github.com/Sense-X/GeoMIM.

cs.CV↗

arXiv2023

Modeling Heat Capacity of Supercritical Fluids: A Phonon Theory Approach

Recent research shows that liquids and dense supercritical fluids support high frequency shear waves. Here, we proposed a general heat capacity model of supercritical fluids using the latest theoretical findings (the liquid phonon theory). In this theory, heat capacity cv of supercritical fluids is only related to the infinite-frequency shear modulus, Debye relaxation time and minimal length of the longitudinal mode in supercritical fluids rather than the system-specific structure and interactions. The present model quantitatively explains the heat capacities in the liquid-like region and the gas-like region above the critical point. At the same time, the heat capacities of 6 supercritical fluids (including monatomic fluids Ar, Ne and molecular fluids N2, CO, CO2, CH4) over a wide range of temperatures and pressures were calculated using the present model, yielding a high accuracy with no free-fitting parameters. This model has two advantages: (1) The contribution of intramolecular vibrations was considered, which makes the model applicable to molecular fluids and high temperature region; (2) This method starts from the quasi-harmonic Debye model. Thus, it does not require any adjustable parameters and thermal expansion coefficients. Furthermore, the present cv model of the rigid liquid-like supercritical region in this paper can be extended to liquid phase of molecular fluids.

cond-mat.other↗

arXiv2023

3D Semantic Subspace Traverser: Empowering 3D Generative Model with Shape Editing Capability

Shape generation is the practice of producing 3D shapes as various representations for 3D content creation. Previous studies on 3D shape generation have focused on shape quality and structure, without or less considering the importance of semantic information. Consequently, such generative models often fail to preserve the semantic consistency of shape structure or enable manipulation of the semantic attributes of shapes during generation. In this paper, we proposed a novel semantic generative model named 3D Semantic Subspace Traverser that utilizes semantic attributes for category-specific 3D shape generation and editing. Our method utilizes implicit functions as the 3D shape representation and combines a novel latent-space GAN with a linear subspace model to discover semantic dimensions in the local latent space of 3D shapes. Each dimension of the subspace corresponds to a particular semantic attribute, and we can edit the attributes of generated shapes by traversing the coefficients of those dimensions. Experimental results demonstrate that our method can produce plausible shapes with complex structures and enable the editing of semantic attributes. The code and trained models are available at https://github.com/TrepangCat/3D_Semantic_Subspace_Traverser

cs.CV↗

arXiv2023

Software refactoring and rewriting: from the perspective of code transformations

To refactor already working code while keeping reliability, compatibility and perhaps security, we can borrow ideas from micropass/nanopass compilers. By treating the procedure of software refactoring as composing code transformations, and compressing repetitive transformations with automation tools, we can often obtain representations of refactoring processes short enough that their correctness can be analysed manually. Unlike in compilers, in refactoring we usually only need to consider the codebase in question, so regular text processing can be extensively used, fully exploiting patterns only present in the codebase. Aside from the direct application of code transformations from compilers, many other kinds of equivalence properties may also be exploited. In this paper, two refactoring projects are given as the main examples, where 10-100 times simplification has been achieved with the application of a few kinds of useful transformations.

cs.SE↗

arXiv2023

DETRs with Collaborative Hybrid Assignments Training

In this paper, we provide the observation that too few queries assigned as positive samples in DETR with one-to-one set matching leads to sparse supervision on the encoder's output which considerably hurt the discriminative feature learning of the encoder and vice visa for attention learning in the decoder. To alleviate this, we present a novel collaborative hybrid assignments training scheme, namely $\mathcal{C}$o-DETR, to learn more efficient and effective DETR-based detectors from versatile label assignment manners. This new training scheme can easily enhance the encoder's learning ability in end-to-end detectors by training the multiple parallel auxiliary heads supervised by one-to-many label assignments such as ATSS and Faster RCNN. In addition, we conduct extra customized positive queries by extracting the positive coordinates from these auxiliary heads to improve the training efficiency of positive samples in the decoder. In inference, these auxiliary heads are discarded and thus our method introduces no additional parameters and computational cost to the original detector while requiring no hand-crafted non-maximum suppression (NMS). We conduct extensive experiments to evaluate the effectiveness of the proposed approach on DETR variants, including DAB-DETR, Deformable-DETR, and DINO-Deformable-DETR. The state-of-the-art DINO-Deformable-DETR with Swin-L can be improved from 58.5% to 59.5% AP on COCO val. Surprisingly, incorporated with ViT-L backbone, we achieve 66.0% AP on COCO test-dev and 67.9% AP on LVIS val, outperforming previous methods by clear margins with much fewer model sizes. Codes are available at \url{https://github.com/Sense-X/Co-DETR}.

cs.CV↗

arXiv2023

PandA(Box) flies on Bluesky: maintainable and user-friendly fly scans with Mamba at HEPS

Purpose: Fly scans are indispensible in many experiments at the High Energy Photon Source (HEPS). PandABox, the main platform to implement fly scans at HEPS, needs to be integrated into Mamba, the experiment control system developed at HEPS based on Bluesky. Methods: In less than 600 lines of easily customisable and extensible backend code, provided are full control of PandABox's TCP server in native ophyd, automated configuration (also including wiring) of "PandA blocks" for constant-speed mapping experiments of various dimensions, as well as generation of scans deliberately fragmented to deal with hardware limits in numbers of exposure frames or sequencer table entries. Results: The upper-level control system for PandABox has been ported to Bluesky, enabling the combination of both components' flexibility in fly-scan applications. Based on this backend, a user-friendly Mamba frontend is developed for X-ray fluorescence (XRF) mapping experiments, which provides fully online visual feedback.

physics.ins-det↗

arXiv2023

A Satellite Imagery Dataset for Long-Term Sustainable Development in United States Cities

Cities play an important role in achieving sustainable development goals (SDGs) to promote economic growth and meet social needs. Especially satellite imagery is a potential data source for studying sustainable urban development. However, a comprehensive dataset in the United States (U.S.) covering multiple cities, multiple years, multiple scales, and multiple indicators for SDG monitoring is lacking. To support the research on SDGs in U.S. cities, we develop a satellite imagery dataset using deep learning models for five SDGs containing 25 sustainable development indicators. The proposed dataset covers the 100 most populated U.S. cities and corresponding Census Block Groups from 2014 to 2023. Specifically, we collect satellite imagery and identify objects with state-of-the-art object detection and semantic segmentation models to observe cities' bird's-eye view. We further gather population, nighttime light, survey, and built environment data to depict SDGs regarding poverty, health, education, inequality, and living environment. We anticipate the dataset to help urban policymakers and researchers to advance SDGs-related studies, especially applying satellite imagery to monitor long-term and multi-scale SDGs in cities.

cs.CV↗

arXiv2023

Strong tunable coupling between two distant superconducting spin qubits

Superconducting (or Andreev) spin qubits have recently emerged as an alternative qubit platform with realizations in semiconductor-superconductor hybrid nanowires. In these qubits, the spin degree of freedom is intrinsically coupled to the supercurrent across a Josephson junction via the spin-orbit interaction, which facilitates fast, high-fidelity spin readout using circuit quantum electrodynamics techniques. Moreover, this spin-supercurrent coupling has been predicted to facilitate inductive multi-qubit coupling. In this work, we demonstrate a strong supercurrent-mediated coupling between two distant Andreev spin qubits. This qubit-qubit interaction is of the longitudinal type and we show that it is both gate- and flux-tunable up to a coupling strength of 178 MHz. Finally, we find that the coupling can be switched off in-situ using a magnetic flux. Our results demonstrate that integrating microscopic spin states into a superconducting qubit architecture can combine the advantages of both semiconductors and superconducting circuits and pave the way to fast two-qubit gates between remote spins.

quant-ph↗

arXiv2023

Electronic transport and thermoelectricity in selenospinel Cu$_{6-x}$Fe$_{4+x}$Sn$_{12}$Se$_{32}$

We report a study of selenospinel Cu$_{6-x}$Fe$_{4+x}$Sn$_{12}$Se$_{32}$ ($x$ = 0, 1, 2) single crystals, which crystalize in a cubic structure with the $Fd\overline{3}m$ space group, and show typical semiconducting behavior. The large discrepancy between the activation energy for electrical conductivity $E_ρ$ (32.3 $\sim$ 69.8 meV), and for thermopower $E_\textrm{S}$ (3.2 $\sim$ 11.5 meV), indicates a polaronic transport mechanism between 350 and 50 K. With decreasing temperature, it evolves into variable-range hopping conduction. Furthermore, the heat capacity shows a hump around 25(5) K and diverges from the Debye $T^3$ law at low temperatures, indicating the observation of structural glassy features in these crystalline solids.

cond-mat.mtrl-sci↗

arXiv2023

Theoretically Guaranteed Policy Improvement Distilled from Model-Based Planning

Model-based reinforcement learning (RL) has demonstrated remarkable successes on a range of continuous control tasks due to its high sample efficiency. To save the computation cost of conducting planning online, recent practices tend to distill optimized action sequences into an RL policy during the training phase. Although the distillation can incorporate both the foresight of planning and the exploration ability of RL policies, the theoretical understanding of these methods is yet unclear. In this paper, we extend the policy improvement step of Soft Actor-Critic (SAC) by developing an approach to distill from model-based planning to the policy. We then demonstrate that such an approach of policy improvement has a theoretical guarantee of monotonic improvement and convergence to the maximum value defined in SAC. We discuss effective design choices and implement our theory as a practical algorithm -- Model-based Planning Distilled to Policy (MPDP) -- that updates the policy jointly over multiple future time steps. Extensive experiments show that MPDP achieves better sample efficiency and asymptotic performance than both model-free and model-based planning algorithms on six continuous control benchmark tasks in MuJoCo.

cs.AI↗

arXiv2023

HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encoding

Encoding a driving scene into vector representations has been an essential task for autonomous driving that can benefit downstream tasks e.g. trajectory prediction. The driving scene often involves heterogeneous elements such as the different types of objects (agents, lanes, traffic signs) and the semantic relations between objects are rich and diverse. Meanwhile, there also exist relativity across elements, which means that the spatial relation is a relative concept and need be encoded in a ego-centric manner instead of in a global coordinate system. Based on these observations, we propose Heterogeneous Driving Graph Transformer (HDGT), a backbone modelling the driving scene as a heterogeneous graph with different types of nodes and edges. For heterogeneous graph construction, we connect different types of nodes according to diverse semantic relations. For spatial relation encoding, the coordinates of the node as well as its in-edges are in the local node-centric coordinate system. For the aggregation module in the graph neural network (GNN), we adopt the transformer structure in a hierarchical way to fit the heterogeneous nature of inputs. Experimental results show that HDGT achieves state-of-the-art performance for the task of trajectory prediction, on INTERACTION Prediction Challenge and Waymo Open Motion Challenge.

cs.AI↗

arXiv2023

A Physics-Informed Data-Driven Fault Location Method for Transmission Lines Using Single-Ended Measurements with Field Data Validation

Data driven transmission line fault location methods have the potential to more accurately locate faults by extracting fault information from available data. However, most of the data driven fault location methods in the literature are not validated by field data for the following reasons. On one hand, the available field data during faults are very limited for one specific transmission line, and using field data for training is close to impossible. On the other hand, if simulation data are utilized for training, the mismatch between the simulation system and the practical system will cause fault location errors. To this end, this paper proposes a physics-informed data-driven fault location method. The data from a practical fault event are first analyzed to extract the ranges of system and fault parameters such as equivalent source impedances, loading conditions, fault inception angles (FIA) and fault resistances. Afterwards, the simulation system is constructed with the ranges of parameters, to generate data for training. This procedure merges the gap between simulation and practical power systems, and at the same time considers the uncertainty of system and fault parameters in practice. The proposed data-driven method does not require system parameters, only requires instantaneous voltage and current measurements at the local terminal, with a low sampling rate of several kHz and a short fault time window of half a cycle before and after the fault occurs. Numerical experiments and field data experiments clearly validate the advantages of the proposed method over existing data driven methods.

eess.SY↗

arXiv2023

Doubly screened Coulomb correction approach for strongly correlated systems

Strongly correlated systems containing d/f-electrons present a challenge to conventional density functional theory (DFT), such as the widely used local density approximation (LDA) or generalized gradient approximation (GGA). In this work, we developed a doubly screened Coulomb correction (DSCC) approach to perform on-site Coulomb interaction correction for strongly correlated materials. The on-site Coulomb interaction between localized d/f-electrons is determined from a model dielectric function that includes both the static dielectric and the Thomas-Fermi screening. All parameters of the dielectric model are efficiently obtained from self-consistent calculations. We applied DSCC to simulate the electronic and magnetic properties of typical 3d, 4f and 5f strongly correlated systems. The results show that the accuracy of DSCC is comparable to hybrid functionals, but an order of magnitude faster. In addition, DSCC can reflect the difference in the Coulomb interaction of the same element between metallic and insulating situations, similar to the popular but computationally expensive constrained random phase approximation (cRPA) approach. This feature suggests that DSCC is also a promising method for simulating Coulomb interaction parameters.

cond-mat.str-el↗

arXiv2023

Largest exact structures and almost split sequences on hearts of twin cotorsion pairs

Hearts of cotorsion pairs on extriangulated categories are abelian categories. On the other hand, hearts of twin cotorsion pairs are not always abelian. They were shown to be semi-abelian by Liu and Nakaoka. Moreover, Hassoun and Shah proved that they are quasi-abelian under certain conditions. In this article, we first show that the heart of any twin cotorsion pair has a largest exact category structure and is always quasi-abelian. We also provide a sufficient and necessary condition for the heart of a twin cotorsion pair being abelian. Then by using the results we have got, we investigate the almost split sequences in the hearts of twin cotorsion pairs. Finally, as an application, we show that a Krull-Schmidt, Hom-finite triangulated category has a Serre functor whenever it has a cluster tilting object.

math.RT↗

arXiv2023

Quantum simulation of topological zero modes on a 41-qubit superconducting processor

Quantum simulation of different exotic topological phases of quantum matter on a noisy intermediate-scale quantum (NISQ) processor is attracting growing interest. Here, we develop a one-dimensional 43-qubit superconducting quantum processor, named as Chuang-tzu, to simulate and characterize emergent topological states. By engineering diagonal Aubry-Andr$\acute{\mathrm{e}}$-Harper (AAH) models, we experimentally demonstrate the Hofstadter butterfly energy spectrum. Using Floquet engineering, we verify the existence of the topological zero modes in the commensurate off-diagonal AAH models, which have never been experimentally realized before. Remarkably, the qubit number over 40 in our quantum processor is large enough to capture the substantial topological features of a quantum system from its complex band structure, including Dirac points, the energy gap's closing, the difference between even and odd number of sites, and the distinction between edge and bulk states. Our results establish a versatile hybrid quantum simulation approach to exploring quantum topological systems in the NISQ era.

quant-ph↗

arXiv2023

Endotaxial Stabilization of 2D Charge Density Waves with Long-range Order

Charge density waves are emergent quantum states that spontaneously reduce crystal symmetry, drive metal-insulator transitions, and precede superconductivity. In low-dimensions, distinct quantum states arise, however, thermal fluctuations and external disorder destroy long-range order. Here we stabilize ordered two-dimensional (2D) charge density waves through endotaxial synthesis of confined monolayers of 1T-TaS$_2$. Specifically, an ordered incommensurate charge density wave (oIC-CDW) is realized in 2D with dramatically enhanced amplitude and resistivity. By enhancing CDW order, the hexatic nature of charge density waves becomes observable. Upon heating via in-situ TEM, the CDW continuously melts in a reversible hexatic process wherein topological defects form in the charge density wave. From these results, new regimes of the CDW phase diagram for 1T-TaS$_2$ are derived and consistent with the predicted emergence of vestigial quantum order.

cond-mat.mtrl-sci↗

arXiv2023

Dimension Reduction and MARS

The multivariate adaptive regression spline (MARS) is one of the popular estimation methods for nonparametric multivariate regressions. However, as MARS is based on marginal splines, to incorporate interactions of covariates, products of the marginal splines must be used, which leads to an unmanageable number of basis functions when the order of interaction is high and results in low estimation efficiency. In this paper, we improve the performance of MARS by using linear combinations of the covariates which achieve sufficient dimension reduction. The special basis functions of MARS facilitate calculation of gradients of the regression function, and estimation of the linear combinations is obtained via eigen-analysis of the outer-product of the gradients. Under some technical conditions, the asymptotic theory is established for the proposed estimation method. Numerical studies including both simulation and empirical applications show its effectiveness in dimension reduction and improvement over MARS and other commonly-used nonparametric methods in regression estimation and prediction.

stat.ME↗

arXiv2023

OpenSiteRec: An Open Dataset for Site Recommendation

As a representative information retrieval task, site recommendation, which aims at predicting the optimal sites for a brand or an institution to open new branches in an automatic data-driven way, is beneficial and crucial for brand development in modern business. However, there is no publicly available dataset so far and most existing approaches are limited to an extremely small scope of brands, which seriously hinders the research on site recommendation. Therefore, we collect, construct and release an open comprehensive dataset, namely OpenSiteRec, to facilitate and promote the research on site recommendation. Specifically, OpenSiteRec leverages a heterogeneous graph schema to represent various types of real-world entities and relations in four international metropolises. To evaluate the performance of the existing general methods on the site recommendation task, we conduct benchmarking experiments of several representative recommendation models on OpenSiteRec. Furthermore, we also highlight the potential application directions to demonstrate the wide applicability of OpenSiteRec. We believe that our OpenSiteRec dataset is significant and anticipated to encourage the development of advanced methods for site recommendation. OpenSiteRec is available online at https://OpenSiteRec.github.io/.

cs.IR↗