arXiv subjects

Yu Liu

Publications and source records attributed to Yu Liu.

At least 775 records · Page 43Linked to original sources

arXiv2022

Inline Tests

Unit tests are widely used to check source code quality, but they can be too coarse-grained or ill-suited for testing individual program statements. We introduce inline tests to make it easier to check for faults in statements. We motivate inline tests through several language features and a common testing scenario in which inline tests could be beneficial. For example, inline tests can allow a developer to test a regular expression in place. We also define language-agnostic requirements for inline testing frameworks. Lastly, we implement I-Test, the first inline testing framework. I-Test works for Python and Java, and it satisfies most of the requirements. We evaluate I-Test on open-source projects by using it to test 144 statements in 31 Python programs and 37 Java programs. We also perform a user study. All nine user study participants say that inline tests are easy to write and that inline testing is beneficial. The cost of running inline tests is negligible, at 0.007x--0.014x, and our inline tests helped find two faults that have been fixed by the developers.

cs.SE↗

arXiv2022

Self-slimmed Vision Transformer

Vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks. However, such powerful transformers bring a huge computation burden, because of the exhausting token-to-token comparison. The previous works focus on dropping insignificant tokens to reduce the computational cost of ViTs. But when the dropping ratio increases, this hard manner will inevitably discard the vital tokens, which limits its efficiency. To solve the issue, we propose a generic self-slimmed learning approach for vanilla ViTs, namely SiT. Specifically, we first design a novel Token Slimming Module (TSM), which can boost the inference efficiency of ViTs by dynamic token aggregation. As a general method of token hard dropping, our TSM softly integrates redundant tokens into fewer informative ones. It can dynamically zoom visual attention without cutting off discriminative token relations in the images, even with a high slimming ratio. Furthermore, we introduce a concise Feature Recalibration Distillation (FRD) framework, wherein we design a reverse version of TSM (RTSM) to recalibrate the unstructured token in a flexible auto-encoder manner. Due to the similar structure between teacher and student, our FRD can effectively leverage structure knowledge for better convergence. Finally, we conduct extensive experiments to evaluate our SiT. It demonstrates that our method can speed up ViTs by 1.7x with negligible accuracy drop, and even speed up ViTs by 3.6x while maintaining 97% of their performance. Surprisingly, by simply arming LV-ViT with our SiT, we achieve new state-of-the-art performance on ImageNet. Code is available at https://github.com/Sense-X/SiT.

cs.CV↗

arXiv2022

UniNet: Unified Architecture Search with Convolution, Transformer, and MLP

Recently, transformer and multi-layer perceptron (MLP) architectures have achieved impressive results on various vision tasks. However, how to effectively combine those operators to form high-performance hybrid visual architectures still remains a challenge. In this work, we study the learnable combination of convolution, transformer, and MLP by proposing a novel unified architecture search approach. Our approach contains two key designs to achieve the search for high-performance networks. First, we model the very different searchable operators in a unified form, and thus enable the operators to be characterized with the same set of configuration parameters. In this way, the overall search space size is significantly reduced, and the total search cost becomes affordable. Second, we propose context-aware downsampling modules (DSMs) to mitigate the gap between the different types of operators. Our proposed DSMs are able to better adapt features from different types of operators, which is important for identifying high-performance hybrid architectures. Finally, we integrate configurable operators and DSMs into a unified search space and search with a Reinforcement Learning-based search algorithm to fully explore the optimal combination of the operators. To this end, we search a baseline network and scale it up to obtain a family of models, named UniNets, which achieve much better accuracy and efficiency than previous ConvNets and Transformers. In particular, our UniNet-B5 achieves 84.9% top-1 accuracy on ImageNet, outperforming EfficientNet-B7 and BoTNet-T7 with 44% and 55% fewer FLOPs respectively. By pretraining on the ImageNet-21K, our UniNet-B6 achieves 87.4%, outperforming Swin-L with 51% fewer FLOPs and 41% fewer parameters. Code is available at https://github.com/Sense-X/UniNet.

cs.CV↗

arXiv2022

Unifying Visual Perception by Dispersible Points Learning

We present a conceptually simple, flexible, and universal visual perception head for variant visual tasks, e.g., classification, object detection, instance segmentation and pose estimation, and different frameworks, such as one-stage or two-stage pipelines. Our approach effectively identifies an object in an image while simultaneously generating a high-quality bounding box or contour-based segmentation mask or set of keypoints. The method, called UniHead, views different visual perception tasks as the dispersible points learning via the transformer encoder architecture. Given a fixed spatial coordinate, UniHead adaptively scatters it to different spatial points and reasons about their relations by transformer encoder. It directly outputs the final set of predictions in the form of multiple points, allowing us to perform different visual tasks in different frameworks with the same head design. We show extensive evaluations on ImageNet classification and all three tracks of the COCO suite of challenges, including object detection, instance segmentation and pose estimation. Without bells and whistles, UniHead can unify these visual tasks via a single visual head design and achieve comparable performance compared to expert models developed for each task.We hope our simple and universal UniHead will serve as a solid baseline and help promote universal visual perception research. Code and models are available at https://github.com/Sense-X/UniHead.

cs.CV↗

arXiv2022

Towards Robust Face Recognition with Comprehensive Search

Data cleaning, architecture, and loss function design are important factors contributing to high-performance face recognition. Previously, the research community tries to improve the performance of each single aspect but failed to present a unified solution on the joint search of the optimal designs for all three aspects. In this paper, we for the first time identify that these aspects are tightly coupled to each other. Optimizing the design of each aspect actually greatly limits the performance and biases the algorithmic design. Specifically, we find that the optimal model architecture or loss function is closely coupled with the data cleaning. To eliminate the bias of single-aspect research and provide an overall understanding of the face recognition model design, we first carefully design the search space for each aspect, then a comprehensive search method is introduced to jointly search optimal data cleaning, architecture, and loss function design. In our framework, we make the proposed comprehensive search as flexible as possible, by using an innovative reinforcement learning based approach. Extensive experiments on million-level face recognition benchmarks demonstrate the effectiveness of our newly-designed search space for each aspect and the comprehensive search. We outperform expert algorithms developed for each single research track by large margins. More importantly, we analyze the difference between our searched optimal design and the independent design of the single factors. We point out that strong models tend to optimize with more difficult training datasets and loss functions. Our empirical study can provide guidance in future research towards more robust face recognition systems.

cs.CV↗

arXiv2022

Spectroscopy of spin-split Andreev levels in a quantum dot with superconducting leads

We use a hybrid superconductor-semiconductor transmon device to perform spectroscopy of a quantum dot Josephson junction tuned to be in a spin-1/2 ground state with an unpaired quasiparticle. Due to spin-orbit coupling, we resolve two flux-sensitive branches in the transmon spectrum, depending on the spin of the quasi-particle. A finite magnetic field shifts the two branches in energy, favoring one spin state and resulting in the anomalous Josephson effect. We demonstrate the excitation of the direct spin-flip transition using all-electrical control. Manipulation and control of the spin-flip transition enable the future implementation of charging energy protected Andreev spin qubits.

cond-mat.mes-hall↗

arXiv2022

Spin-phonon interaction and short range order in $\mathrm{Mn_3Si_{2}Te_6}$

The vibrational properties of ferrimagnetic $\mathrm{Mn_3Si_{2}Te_6}$ single crystals are investigated using Raman spectroscopy and density functional theory calculations. Eighteen Raman-active modes are identified, fourteen of which are assigned according to with the trigonal symmetry. Four additional peaks, obeying the $A_{1g}$ selection rules, are attributed to the overtones. The unconventional temperature evolution of the $A_{1g}^5$ mode self-energy suggests a competition between different short-range magnetic correlations that significantly impact the spin-phonon interaction in $\mathrm{Mn_3Si_{2}Te_6}$. The research provides a comprehensive insight to the lattice properties, studies their temperature dependence and shows the arguments for existence of competing short-range magnetic phases in $\mathrm{Mn_3Si_{2}Te_6}$.

cond-mat.mtrl-sci↗

arXiv2022

Direct manipulation of a superconducting spin qubit strongly coupled to a transmon qubit

Spin qubits in semiconductors are currently one of the most promising architectures for quantum computing. However, they face challenges in realizing multi-qubit interactions over extended distances. Superconducting spin qubits provide a promising alternative by encoding a qubit in the spin degree of freedom of an Andreev level. Such an Andreev spin qubit could leverage the advantages of circuit quantum electrodynamic, enabled by an intrinsic spin-supercurrent coupling. The first realization of an Andreev spin qubit encoded the qubit in the excited states of a semiconducting weak-link, leading to frequent decay out of the computational subspace. Additionally, rapid qubit manipulation was hindered by the need for indirect Raman transitions. Here, we exploit a different qubit subspace, using the spin-split doublet ground state of an electrostatically-defined quantum dot Josephson junction with large charging energy. Additionally, we use a magnetic field to enable direct spin manipulation over a frequency range of 10 GHz. Using an all-electric microwave drive we achieve Rabi frequencies exceeding 200 MHz. We furthermore embed the Andreev spin qubit in a superconducting transmon qubit, demonstrating strong coherent qubit-qubit coupling. These results are a crucial step towards a hybrid architecture that combines the beneficial aspects of both superconducting and semiconductor qubits.

quant-ph↗

arXiv2022

Suppression of Superconductivity and Nematic Order in Fe$_{1-y}$Se$_{1-x}$S$_x$ (0$\leq$$x$$\leq$1, $y$$\leq$0.1) Crystals by Anion Height Disorder

Connections between crystal chemistry and critical temperature $T_c$ have been in the focus of superconductivity, one of the most widely studied phenomena in physics, chemistry and materials science alike. In most Fe-based superconductors, materials chemistry and physics conspire so that $T_c$ correlates with the average anion height above the Fe plane, i. e. with the geometry of the FeAs4 or FeCh4 (Ch = Te, Se, or S) tetrahedron. By synthesizing Fe$_{1-y}$Se$_{1-x}$S$_x$ (0$\leq$$x$$\leq$1, $y$$\leq$0.1), we find that in alloyed crystals $T_c$ is not correlated with the anion height like it is for most other Fe superconductors. Instead, changes in $T_c$($x$) and tetragonal-to-orthorombic (nematic) transition $T_s$($x$) upon cooling are correlated with disorder in Fe vibrations in the direction orthogonal to Fe planes, along the crystallographic c-axis. The disorder stems from the random nature of S substitution, causing deformed Fe(Se,S)4 tetrahedra with different Fe-Se and Fe-S bond distances. Our results provide evidence of $T_c$ and $T_s$ suppression by disorder in anion height. The connection to local crystal chemistry may be exploited in computational prediction of new superconducting materials with Fe/S building blocks.

cond-mat.supr-con↗

arXiv2022

Disordered Hyperuniform Quasi-1D Materials

Carbon nanotubes are quasi-one-dimensional systems that possess superior transport, mechanical, optical, and chemical properties. In this work, we generalize the notion of disorder hyperuniformity, a recently discovered exotic state of matter with hidden long-range order, to quasi-one-dimensional materials. As a proof of concept, we then apply the generalized framework to quantify the density fluctuations in amorphous carbon nanotubes containing randomly distributed Stone-Wales defects. We demonstrate that all of these amorphous nanotubes are hyperuniform, i.e., the infinite-wavelength density fluctuations of these systems are completely suppressed, regardless of the diameter, rolling axis, number of rolling sheets, and defect fraction of the nanotubes. We find that these amorphous nanotubes are energetically more stable than nanotubes with periodically distributed Stone-Wales defects. Moreover, certain semiconducting defect-free carbon nanotubes become metallic as sufficiently large amounts of defects are randomly introduced. This structural study of amorphous nanotubes strengthens our fundamental understanding of these systems, and suggests possible exotic physical properties, as endowed by their disordered hyperuniformity. Our findings also shed light on the effect of dimensionality reduction on the hyperuniformity property of materials.

cond-mat.stat-mech↗

arXiv2022

Role of Local Ru Hexamers in Superconductivity of Ruthenium Phosphide

Superconductivity in binary ruthenium pnictides occurs proximal to and upon suppression of a mysterious non-magnetic ground state, preceded by a pseudogap phase associated with Fermi surface instability, and its critical temperature, T$_{c}$, is maximized around the pseudogap quantum critical point. By analogy with isoelectronic iron based counterparts, antiferromagnetic fluctuations became "usual suspects" as putative mediators of superconducting pairing. Here we report on a high temperature local symmetry breaking in RuP, the parent of the maximum-Tc branch of these novel superconductors, revealed by combined nanostructure-sensitive powder and single crystal X-ray total scattering experiments. Large local Ru$_{6}$ hexamer distortions associated with orbital-charge trimerization form above the two-stage electronic transition in RuP. While hexamer ordering enables the nonmagnetic ground state and presumed complex oligomerization, the relevance of pseudogap fluctuations for superconductivity emerges as a distinct prospect. As a transition metal system in which partial d-manifold filling combined with high crystal symmetry promotes electronic instabilities, this represents a further example of local electronic precursors underpinning the macroscopic collective behavior of quantum materials.

cond-mat.supr-con↗

arXiv2022

Giant thermoelectric power factor anisotropy in PtSb$_{1.4}$Sn$_{0.6}$

We report giant anisotropy in thermoelectric power factor ($S^2σ$) of marcasite structure-type PtSb$_{1.4}$Sn$_{0.6}$. PtSb$_{1.4}$Sn$_{0.6}$, synthesized using ambient pressure flux growth method upon mixing Sb and Sn on the same atomic site, is a new phase different from both PtSb$_2$ and PtSn$_2$ that crystallize in the cubic $Pa\bar{3}$ pyrite and $Fm\bar{3}m$ fluorite unit cell symmetry, respectively. Giant difference in $S^2σ$ for heat flow applied along different principal directions of the orthorhombic unit cell mostly stems from anisotropic Seebeck coefficients.

cond-mat.mtrl-sci↗

arXiv2022

Short-range Crystalline Order-Tuned Conductivity in Cr$_2$Si$_2$Te$_6$ van der Waals Magnetic Crystals

Two-dimensional magnetic materials (2DMM) are significant for studies on the nature of 2D long range magnetic order but also for future spintronic devices. Of particular interest are 2DMM where spins can be manipulated by electrical conduction. Whereas Cr$_2$Si$_2$Te$_6$ exhibits magnetic order in few-layer crystals, its large band gap inhibits electronic conduction. Here we show that the defect-induced short-range crystal order in Cr$_2$Si$_2$Te$_6$ on the length scale below 0.6 nm induces substantially reduced band gap and robust semiconducting behavior down to 2 K that turns to metallic above 10 GPa. Our results will be helpful to design conducting state in 2DMM and call for spin-resolved measurement of the electronic structure in exfoliated ultrathin crystals.

cond-mat.str-el↗

arXiv2022

Quantifying navigation complexity in transportation networks

The complexity of navigation in cities has increased with the expansion of urban areas, creating challenging transportation problems that drive many studies on the navigability of networks. However, due to the lack of individual mobility data, large-scale empirical analysis of the wayfinder's real-world navigation is rare. Here, using 225 million subway trips from three major cities in China, we quantify navigation difficulty from an information perspective. Our results reveal that 1) people conserve a small number of repeatedly used routes, and 2) the navigation information in the subnetworks formed by those routes is much smaller than the theoretical value in the global network, suggesting that the decision cost for actual trips is significantly smaller than the theoretical upper limit found in previous studies. By modeling routing behaviors in growing networks, we show that while the global network becomes difficult to navigate, navigability can be improved in subnetworks. We further present a universal linear relationship between the empirical and theoretical search information, which allows the two metrics to predict each other. Our findings demonstrate how large-scale observations can quantify real-world navigation behaviors and aid in evaluating transportation planning.

physics.soc-ph↗

arXiv2022

Rethinking Robust Representation Learning Under Fine-grained Noisy Faces

Learning robust feature representation from large-scale noisy faces stands out as one of the key challenges in high-performance face recognition. Recent attempts have been made to cope with this challenge by alleviating the intra-class conflict and inter-class conflict. However, the unconstrained noise type in each conflict still makes it difficult for these algorithms to perform well. To better understand this, we reformulate the noise type of each class in a more fine-grained manner as N-identities|K^C-clusters. Different types of noisy faces can be generated by adjusting the values of \nkc. Based on this unified formulation, we found that the main barrier behind the noise-robust representation learning is the flexibility of the algorithm under different N, K, and C. For this potential problem, we propose a new method, named Evolving Sub-centers Learning~(ESL), to find optimal hyperplanes to accurately describe the latent space of massive noisy faces. More specifically, we initialize M sub-centers for each class and ESL encourages it to be automatically aligned to N-identities|K^C-clusters faces via producing, merging, and dropping operations. Images belonging to the same identity in noisy faces can effectively converge to the same sub-center and samples with different identities will be pushed away. We inspect its effectiveness with an elaborate ablation study on the synthetic noisy dataset with different N, K, and C. Without any bells and whistles, ESL can achieve significant performance gains over state-of-the-art methods on large-scale noisy faces

cs.CV↗

arXiv2022

Tunable plasmonic devices by integrating graphene with ferroelectric nanocavity

Graphene plasmons are able to become the fundermental of novel conceptual photonic devices, resulting from their unique characteristics containing excitation at room temperature and tunable spectral selectivity in different frequencies. The pursuit of efficiently exciting and manipulating graphene plasmons is necessary and significant for high-performance devices. Here, we investigate graphene plasmon wave propagating in ferroelectric nanocavity array. We experimentally show that the the periodic ferroelectric polarizations could be used for doping graphene into desired spatial carrier density patterns. Based on a theoretical model that considers periodic ununiform conductivity across graphene sheet, the simulation results show surface plasmon polaritons (SPP) in graphene can be excited by an incident light in a similar way to the excitation of photonic crystal resonant modes. The graphene SPP resonance can be tuned from ~720 to ~1 000 cm-1 by rescaling the ferroelectric nanocavity array, and from ~540 to ~780 cm-1 by dynamically changing the applied gate voltage. Our strategy of graphene carrier engineering to excite SPP offers a promissing way for large-scale, non-destructive fabrication of novel graphene photonic devices.

physics.optics↗

arXiv2022

Mitigation of quasiparticle loss in superconducting qubits by phonon scattering

Quantum error correction will be an essential ingredient in realizing fault-tolerant quantum computing. However, most correction schemes rely on the assumption that errors are sufficiently uncorrelated in space and time. In superconducting qubits this assumption is drastically violated in the presence of ionizing radiation, which creates bursts of high energy phonons in the substrate. These phonons can break Cooper-pairs in the superconductor and, thus, create quasiparticles over large areas, consequently reducing qubit coherence across the quantum device in a correlated fashion. A potential mitigation technique is to place large volumes of normal or superconducting metal on the device, capable of reducing the phonon energy to below the superconducting gap of the qubits. To investigate the effectiveness of this method we fabricate a quantum device with four nominally identical nanowire-based transmon qubits. On the device, half of the niobium-titanium-nitride ground plane is replaced with aluminum (Al), which has a significantly lower superconducting gap. We deterministically inject high energy phonons into the substrate by voltage biasing a galvanically isolated Josephson junction. In the presence of the low gap material, we find a factor of 2-5 less degradation in the injection-dependent qubit lifetimes, and observe that undesired excited qubit state population is mitigated by a similar factor. We furthermore turn the Al normal with a magnetic field, finding no change in the phonon-protection. This suggests that the efficacy of the protection in our device is not limited by the size of the superconducting gap in the Al ground plane. Our results provide a promising foundation for protecting superconducting qubit processors against correlated errors from ionizing radiation.

quant-ph↗

arXiv2022

HoVer-Trans: Anatomy-aware HoVer-Transformer for ROI-free Breast Cancer Diagnosis in Ultrasound Images

Ultrasonography is an important routine examination for breast cancer diagnosis, due to its non-invasive, radiation-free and low-cost properties. However, the diagnostic accuracy of breast cancer is still limited due to its inherent limitations. It would be a tremendous success if we can precisely diagnose breast cancer by breast ultrasound images (BUS). Many learning-based computer-aided diagnostic methods have been proposed to achieve breast cancer diagnosis/lesion classification. However, most of them require a pre-define ROI and then classify the lesion inside the ROI. Conventional classification backbones, such as VGG16 and ResNet50, can achieve promising classification results with no ROI requirement. But these models lack interpretability, thus restricting their use in clinical practice. In this study, we propose a novel ROI-free model for breast cancer diagnosis in ultrasound images with interpretable feature representations. We leverage the anatomical prior knowledge that malignant and benign tumors have different spatial relationships between different tissue layers, and propose a HoVer-Transformer to formulate this prior knowledge. The proposed HoVer-Trans block extracts the inter- and intra-layer spatial information horizontally and vertically. We conduct and release an open dataset GDPH&SYSUCC for breast cancer diagnosis in BUS. The proposed model is evaluated in three datasets by comparing with four CNN-based models and two vision transformer models via five-fold cross validation. It achieves state-of-the-art classification performance with the best model interpretability. In the meanwhile, our proposed model outperforms two senior sonographers on the breast cancer diagnosis when only one BUS image is given.

eess.IV↗