arXiv Science⌕ Search

arXiv subjects

Zhen Zhao

Publications and source records attributed to Zhen Zhao.

At least 91 records · Page 5Linked to original sources
arXiv2024

Tunable vortex bound states in multiband CsV3Sb5-derived kagome superconductors

Vortices and bound states offer an effective means of comprehending the electronic properties of superconductors. Recently, surface dependent vortex core states have been observed in the newly discovered kagome superconductors CsV3Sb5. Although the spatial distribution of the sharp zero energy conductance peak appears similar to Majorana bound states arising from the superconducting Dirac surface states, its origin remains elusive. In this study, we present observations of tunable vortex bound states (VBSs) in two chemically doped kagome superconductors Cs(V1-xTrx)3Sb5 (Tr=Ta or Ti), using low temperature scanning tunneling microscopy/spectroscopy. The CsV3Sb5-derived kagome superconductors exhibit full gap pairing superconductivity accompanied by the absence of long range charge orders, in contrast to pristine CsV3Sb5. Zero energy conductance maps demonstrate a field-driven continuous reorientation transition of the vortex lattice, suggesting multiband superconductivity. The Ta doped CsV3Sb5 displays the conventional cross shaped spatial evolution of Caroli de Gennes Matricon bound states, while the Ti doped CsV3Sb5 exhibits a sharp, non split zero bias conductance peak (ZBCP) that persists over a long distance across the vortex. The spatial evolution of the non split ZBCP is robust against surface effects and external magnetic field but is related to the doping concentrations. Our study reveals the tunable VBSs in multiband chemically doped CsV3Sb5 system and offers fresh insights into previously reported Y shaped ZBCP in a non quantum limit condition at the surface of kagome superconductor.

cond-mat.supr-con↗
arXiv2024

Quantum Oscillations in kagome metals CsTi3Bi5 and RbTi3Bi5

We report quantum oscillation measurements on the kagome compounds ATi$_3$Bi$_5$ (A=Rb, Cs) in magnetic fields up to 41.5 T and temperatures down to 350 mK. In addition to the frequencies observed in previous studies, we have observed multiple unreported frequencies above 2000 T in CsTi$_3$Bi$_5$ using a tunnel diode oscillator technique. We compare these results against density functional theory calculations and find good agreement with the calculations in the number of peaks observed, frequency, and the dimensionality of the Fermi surface. For RbTi$_3$Bi$_5$ we have obtained a different quantum oscillation spectrum, although calculated quantum oscillation frequencies for the Rb compound are remarkably similar to the Cs compound, calling for further studies.

cond-mat.str-el↗
arXiv2024

SM$^3$: Self-Supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objects

Reconstructing real-world objects and estimating their movable joint structures are pivotal technologies within the field of robotics. Previous research has predominantly focused on supervised approaches, relying on extensively annotated datasets to model articulated objects within limited categories. However, this approach falls short of effectively addressing the diversity present in the real world. To tackle this issue, we propose a self-supervised interaction perception method, referred to as SM$^3$, which leverages multi-view RGB images captured before and after interaction to model articulated objects, identify the movable parts, and infer the parameters of their rotating joints. By constructing 3D geometries and textures from the captured 2D images, SM$^3$ achieves integrated optimization of movable part and joint parameters during the reconstruction process, obviating the need for annotations. Furthermore, we introduce the MMArt dataset, an extension of PartNet-Mobility, encompassing multi-view and multi-modal data of articulated objects spanning diverse categories. Evaluations demonstrate that SM$^3$ surpasses existing benchmarks across various categories and objects, while its adaptability in real-world scenarios has been thoroughly validated.

cs.CV↗
arXiv2023

Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions

Speech emotion recognition (SER) performance deteriorates significantly in the presence of noise, making it challenging to achieve competitive performance in noisy conditions. To this end, we propose a multi-level knowledge distillation (MLKD) method, which aims to transfer the knowledge from a teacher model trained on clean speech to a simpler student model trained on noisy speech. Specifically, we use clean speech features extracted by the wav2vec-2.0 as the learning goal and train the distil wav2vec-2.0 to approximate the feature extraction ability of the original wav2vec-2.0 under noisy conditions. Furthermore, we leverage the multi-level knowledge of the original wav2vec-2.0 to supervise the single-level output of the distil wav2vec-2.0. We evaluate the effectiveness of our proposed method by conducting extensive experiments using five types of noise-contaminated speech on the IEMOCAP dataset, which show promising results compared to state-of-the-art models.

cs.SD↗
arXiv2023

Roll With the Punches: Expansion and Shrinkage of Soft Label Selection for Semi-supervised Fine-Grained Learning

While semi-supervised learning (SSL) has yielded promising results, the more realistic SSL scenario remains to be explored, in which the unlabeled data exhibits extremely high recognition difficulty, e.g., fine-grained visual classification in the context of SSL (SS-FGVC). The increased recognition difficulty on fine-grained unlabeled data spells disaster for pseudo-labeling accuracy, resulting in poor performance of the SSL model. To tackle this challenge, we propose Soft Label Selection with Confidence-Aware Clustering based on Class Transition Tracking (SoC) by reconstructing the pseudo-label selection process by jointly optimizing Expansion Objective and Shrinkage Objective, which is based on a soft label manner. Respectively, the former objective encourages soft labels to absorb more candidate classes to ensure the attendance of ground-truth class, while the latter encourages soft labels to reject more noisy classes, which is theoretically proved to be equivalent to entropy minimization. In comparisons with various state-of-the-art methods, our approach demonstrates its superior performance in SS-FGVC. Checkpoints and source code are available at https://github.com/NJUyued/SoC4SS-FGVC.

cs.LG↗
arXiv2023

Clean Label Disentangling for Medical Image Segmentation with Noisy Labels

Current methods focusing on medical image segmentation suffer from incorrect annotations, which is known as the noisy label issue. Most medical image segmentation with noisy labels methods utilize either noise transition matrix, noise-robust loss functions or pseudo-labeling methods, while none of the current research focuses on clean label disentanglement. We argue that the main reason is that the severe class-imbalanced issue will lead to the inaccuracy of the selected ``clean'' labels, thus influencing the robustness of the model against the noises. In this work, we come up with a simple but efficient class-balanced sampling strategy to tackle the class-imbalanced problem, which enables our newly proposed clean label disentangling framework to successfully select clean labels from the given label sets and encourages the model to learn from the correct annotations. However, such a method will filter out too many annotations which may also contain useful information. Therefore, we further extend our clean label disentangling framework to a new noisy feature-aided clean label disentangling framework, which takes the full annotations into utilization to learn more semantics. Extensive experiments have validated the effectiveness of our methods, where our methods achieve new state-of-the-art performance. Our code is available at https://github.com/xiaoyao3302/2BDenoise.

cs.CV↗
arXiv2023

Training for Open-Ended Drilling through a Virtual Reality Simulation

Virtual Reality (VR) can support effective and scalable training of psychomotor skills in manufacturing. However, many industry training modules offer experiences that are close-ended and do not allow for human error. We aim to address this gap in VR training tools for psychomotor skills training by exploring an open-ended approach to the system design. We designed a VR training simulation prototype to perform open-ended practice of drilling using a 3-axis milling machine. The simulation employs near "end-to-end" instruction through a safety module, a setup and drilling tutorial, open-ended practice complete with warnings of mistakes and failures, and a function to assess the geometries and locations of drilled holes against an engineering drawing. We developed and conducted a user study within an undergraduate-level introductory fabrication course to investigate the impact of open-ended VR practice on learning outcomes. Study results reveal positive trends, with the VR group successfully completing the machining task of drilling at a higher rate (75% vs 64%), with fewer mistakes (1.75 vs 2.14 score), and in less time (17.67 mins vs 21.57 mins) compared to the control group. We discuss our findings and limitations and implications for the design of open-ended VR training systems for learning psychomotor skills.

cs.HC↗
arXiv2023

Enhancing Sample Utilization through Sample Adaptive Augmentation in Semi-Supervised Learning

In semi-supervised learning, unlabeled samples can be utilized through augmentation and consistency regularization. However, we observed certain samples, even undergoing strong augmentation, are still correctly classified with high confidence, resulting in a loss close to zero. It indicates that these samples have been already learned well and do not provide any additional optimization benefits to the model. We refer to these samples as ``naive samples". Unfortunately, existing SSL models overlook the characteristics of naive samples, and they just apply the same learning strategy to all samples. To further optimize the SSL model, we emphasize the importance of giving attention to naive samples and augmenting them in a more diverse manner. Sample adaptive augmentation (SAA) is proposed for this stated purpose and consists of two modules: 1) sample selection module; 2) sample augmentation module. Specifically, the sample selection module picks out {naive samples} based on historical training information at each epoch, then the naive samples will be augmented in a more diverse manner in the sample augmentation module. Thanks to the extreme ease of implementation of the above modules, SAA is advantageous for being simple and lightweight. We add SAA on top of FixMatch and FlexMatch respectively, and experiments demonstrate SAA can significantly improve the models. For example, SAA helped improve the accuracy of FixMatch from 92.50% to 94.76% and that of FlexMatch from 95.01% to 95.31% on CIFAR-10 with 40 labels.

cs.CV↗
arXiv2023

Rethinking Data Perturbation and Model Stabilization for Semi-supervised Medical Image Segmentation

Studies on semi-supervised medical image segmentation (SSMIS) have seen fast progress recently. Due to the limited labelled data, SSMIS methods mainly focus on effectively leveraging unlabeled data to enhance the segmentation performance. However, despite their promising performance, current state-of-the-art methods often prioritize integrating complex techniques and loss terms rather than addressing the core challenges of semi-supervised scenarios directly. We argue that the key to SSMIS lies in generating substantial and appropriate prediction disagreement on unlabeled data. To this end, we emphasize the crutiality of data perturbation and model stabilization in semi-supervised segmentation, and propose a simple yet effective approach to boost SSMIS performance significantly, dubbed DPMS. Specifically, we first revisit SSMIS from three distinct perspectives: the data, the model, and the loss, and conduct a comprehensive study of corresponding strategies to examine their effectiveness. Based on these examinations, we then propose DPMS, which adopts a plain teacher-student framework with a standard supervised loss and unsupervised consistency loss. To produce appropriate prediction disagreements, DPMS perturbs the unlabeled data via strong augmentations to enlarge prediction disagreements considerably. On the other hand, using EMA teacher when strong augmentation is applied does not necessarily improve performance. DPMS further utilizes a forwarding-twice and momentum updating strategies for normalization statistics to stabilize the training on unlabeled data effectively. Despite its simplicity, DPMS can obtain new state-of-the-art performance on the public 2D ACDC and 3D LA datasets across various semi-supervised settings, e.g. obtaining a remarkable 22.62% improvement against previous SOTA on ACDC with 5% labels.

cs.CV↗
arXiv2023

Towards Semi-supervised Learning with Non-random Missing Labels

Semi-supervised learning (SSL) tackles the label missing problem by enabling the effective usage of unlabeled data. While existing SSL methods focus on the traditional setting, a practical and challenging scenario called label Missing Not At Random (MNAR) is usually ignored. In MNAR, the labeled and unlabeled data fall into different class distributions resulting in biased label imputation, which deteriorates the performance of SSL models. In this work, class transition tracking based Pseudo-Rectifying Guidance (PRG) is devised for MNAR. We explore the class-level guidance information obtained by the Markov random walk, which is modeled on a dynamically created graph built over the class tracking matrix. PRG unifies the historical information of class distribution and class transitions caused by the pseudo-rectifying procedure to maintain the model's unbiased enthusiasm towards assigning pseudo-labels to all classes, so as the quality of pseudo-labels on both popular classes and rare classes in MNAR could be improved. Finally, we show the superior performance of PRG across a variety of MNAR scenarios, outperforming the latest SSL approaches combining bias removal solutions by a large margin. Code and model weights are available at https://github.com/NJUyued/PRG4SSL-MNAR.

cs.LG↗
arXiv2023

Anharmonic Strong-Coupling Effects at the Origin of the Charge Density Wave in CsV$_3$Sb$_5$

The formation of charge density waves (CDW) is a long-standing open problem particularly in dimensions higher than one. Various observations in the vanadium antimonides discovered recently, such as the missing Kohn anomaly in the acoustic phonons or the latent heat at the transition $T_{\rm CDW}$ = 95 K , further underpin this notion. Here, we study the Kagome metal CsV$_3$Sb$_5$ using polarized inelastic light scattering. The electronic energy gap $2Δ$ as derived from the redistribution of the continuum is much larger than expected from mean-field theory and reaches values above 20 for $2Δ/k_{\rm B}T_{\rm CDW}$. The A$_{1g}$ phonon has a discontinuity at $T_{\rm CDW}$ and a precursor starting 20 K above $T_{\rm CDW}$. Density functional theory qualitatively reproduces the redistribution of the electronic continuum at the CDW transition and the phonon energies of the pristine and distorted structures. The linewidths of all A$_{1g}$ and E$_{2g}$ phonon lines including those emerging below $T_{\rm CDW}$ were analyzed in terms of anharmonic symmetric decay revealing strong phonon-phonon coupling. In addition, we observe two CDW amplitude modes (AMs): one in A$_{1g}$ symmetry and one in E$_{2g}$ symmetry. The temperature dependence of both modes deviates from the prediction of mean-field theory. The A$_{1g}$ AM displays an asymmetric Fano-type lineshape, suggestive of strong electron-phonon coupling. The asymmetric A$_{1g}$ AM, along with the discontinuity of the A$_{1g}$ phonon, the large phonon-phonon coupling parameters and the large gap ratio, indicate the importance of anharmonic strong phonon-phonon and electron-phonon coupling for the CDW formation in CsV$_3$Sb$_5$.

cond-mat.supr-con↗
arXiv2023

Shrinking Class Space for Enhanced Certainty in Semi-Supervised Learning

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. To mitigate potentially incorrect pseudo labels, recent frameworks mostly set a fixed confidence threshold to discard uncertain samples. This practice ensures high-quality pseudo labels, but incurs a relatively low utilization of the whole unlabeled set. In this work, our key insight is that these uncertain samples can be turned into certain ones, as long as the confusion classes for the top-1 class are detected and removed. Invoked by this, we propose a novel method dubbed ShrinkMatch to learn uncertain samples. For each uncertain sample, it adaptively seeks a shrunk class space, which merely contains the original top-1 class, as well as remaining less likely classes. Since the confusion ones are removed in this space, the re-calculated top-1 confidence can satisfy the pre-defined threshold. We then impose a consistency regularization between a pair of strongly and weakly augmented samples in the shrunk space to strive for discriminative representations. Furthermore, considering the varied reliability among uncertain samples and the gradually improved model during training, we correspondingly design two reweighting principles for our uncertain loss. Our method exhibits impressive performance on widely adopted benchmarks. Code is available at https://github.com/LiheYoung/ShrinkMatch.

cs.CV↗
arXiv2023

DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field

Estimating 6D poses and reconstructing 3D shapes of objects in open-world scenes from RGB-depth image pairs is challenging. Many existing methods rely on learning geometric features that correspond to specific templates while disregarding shape variations and pose differences among objects in the same category. As a result, these methods underperform when handling unseen object instances in complex environments. In contrast, other approaches aim to achieve category-level estimation and reconstruction by leveraging normalized geometric structure priors, but the static prior-based reconstruction struggles with substantial intra-class variations. To solve these problems, we propose the DTF-Net, a novel framework for pose estimation and shape reconstruction based on implicit neural fields of object categories. In DTF-Net, we design a deformable template field to represent the general category-wise shape latent features and intra-category geometric deformation features. The field establishes continuous shape correspondences, deforming the category template into arbitrary observed instances to accomplish shape reconstruction. We introduce a pose regression module that shares the deformation features and template codes from the fields to estimate the accurate 6D pose of each object in the scene. We integrate a multi-modal representation extraction module to extract object features and semantic masks, enabling end-to-end inference. Moreover, during training, we implement a shape-invariant training strategy and a viewpoint sampling method to further enhance the model's capability to extract object pose features. Extensive experiments on the REAL275 and CAMERA25 datasets demonstrate the superiority of DTF-Net in both synthetic and real scenes. Furthermore, we show that DTF-Net effectively supports grasping tasks with a real robot arm.

cs.CV↗
arXiv2023

Radio Sources Segmentation and Classification with Deep Learning

Modern large radio continuum surveys have high sensitivity and resolution, and can resolve previously undetected extended and diffuse emissions, which brings great challenges for the detection and morphological classification of extended sources. We present HeTu-v2, a deep learning-based source detector that uses the combined networks of Mask Region-based Convolutional Neural Networks (Mask R-CNN) and a Transformer block to achieve high-quality radio sources segmentation and classification. The sources are classified into 5 categories: Compact or point-like sources (CS), Fanaroff-Riley Type I (FRI), Fanaroff-Riley Type II (FRII), Head-Tail (HT), and Core-Jet (CJ) sources. HeTu-v2 has been trained and validated with the data from the Faint Images of the Radio Sky at Twenty-one centimeters (FIRST). We found that HeTu-v2 has a high accuracy with a mean average precision ($AP_{\rm @50:5:95}$) of 77.8%, which is 15.6 points and 11.3 points higher than that of HeTu-v1 and the original Mask R-CNN respectively. We produced a FIRST morphological catalog (FIRST-HeTu) using HeTu-v2, which contains 835,435 sources and achieves 98.6% of completeness and up to 98.5% of accuracy compared to the latest 2014 data release of the FIRST survey. HeTu-v2 could also be employed for other astronomical tasks like building sky models, associating radio components, and classifying radio galaxies.

astro-ph.IM↗
arXiv2023

Dynamical exchange-correlation potential formalism for spin-$\frac{1}{2}$ Heisenberg and Hubbard chains: the antiferromagnetic/half-filled case

The exchange-correlation potential formalism previously introduced and applied to the one-dimensional Hubbard model has been extended to spin systems and applied to the case of the one-dimensional antiferromagnetic spin$-\frac{1}{2}$ Heisenberg model. Within the spin exchange-correlation potential formulation, a new sum rule for spin-systems is derived. The exchange-correlation potential for the Heisenberg model is extrapolated from exact diagonalization results of small antiferromagnetic Heisenberg clusters. This procedure is also employed to revisit and computationally improve the previous investigation of the exchange-correlation potential of the half-filled Hubbard model, which was based on the exchange-correlation potential of the dimer. Numerical comparisons with exact benchmark calculations for both the Heisenberg and the Hubbard models indicate that, starting from the exchange-correlation potential of a finite cluster, the extrapolation procedure yields a one-particle spectral function with favorable accuracy at a relatively low computational cost. In addition, a comparison between the ground state energies for the one-dimensional Hubbard and Heisenberg models displays how the well known similarity in behavior of the two models at large interactions manifests within the exchange-correlation potential formalism.

cond-mat.str-el↗
arXiv2023

Task-Oriented Multi-Modal Mutual Leaning for Vision-Language Models

Prompt learning has become one of the most efficient paradigms for adapting large pre-trained vision-language models to downstream tasks. Current state-of-the-art methods, like CoOp and ProDA, tend to adopt soft prompts to learn an appropriate prompt for each specific task. Recent CoCoOp further boosts the base-to-new generalization performance via an image-conditional prompt. However, it directly fuses identical image semantics to prompts of different labels and significantly weakens the discrimination among different classes as shown in our experiments. Motivated by this observation, we first propose a class-aware text prompt (CTP) to enrich generated prompts with label-related image information. Unlike CoCoOp, CTP can effectively involve image semantics and avoid introducing extra ambiguities into different prompts. On the other hand, instead of reserving the complete image representations, we propose text-guided feature tuning (TFT) to make the image branch attend to class-related representation. A contrastive loss is employed to align such augmented text and image representations on downstream tasks. In this way, the image-to-text CTP and text-to-image TFT can be mutually promoted to enhance the adaptation of VLMs for downstream tasks. Extensive experiments demonstrate that our method outperforms the existing methods by a significant margin. Especially, compared to CoCoOp, we achieve an average improvement of 4.03% on new classes and 3.19% on harmonic-mean over eleven classification benchmarks.

cs.CV↗
arXiv2023

Conflict-Based Cross-View Consistency for Semi-Supervised Semantic Segmentation

Semi-supervised semantic segmentation (SSS) has recently gained increasing research interest as it can reduce the requirement for large-scale fully-annotated training data. The current methods often suffer from the confirmation bias from the pseudo-labelling process, which can be alleviated by the co-training framework. The current co-training-based SSS methods rely on hand-crafted perturbations to prevent the different sub-nets from collapsing into each other, but these artificial perturbations cannot lead to the optimal solution. In this work, we propose a new conflict-based cross-view consistency (CCVC) method based on a two-branch co-training framework which aims at enforcing the two sub-nets to learn informative features from irrelevant views. In particular, we first propose a new cross-view consistency (CVC) strategy that encourages the two sub-nets to learn distinct features from the same input by introducing a feature discrepancy loss, while these distinct features are expected to generate consistent prediction scores of the input. The CVC strategy helps to prevent the two sub-nets from stepping into the collapse. In addition, we further propose a conflict-based pseudo-labelling (CPL) method to guarantee the model will learn more useful information from conflicting predictions, which will lead to a stable training process. We validate our new CCVC approach on the SSS benchmark datasets where our method achieves new state-of-the-art performance. Our code is available at https://github.com/xiaoyao3302/CCVC.

cs.CV↗
arXiv2022

MutexMatch: Semi-Supervised Learning with Mutex-Based Consistency Regularization

The core issue in semi-supervised learning (SSL) lies in how to effectively leverage unlabeled data, whereas most existing methods tend to put a great emphasis on the utilization of high-confidence samples yet seldom fully explore the usage of low-confidence samples. In this paper, we aim to utilize low-confidence samples in a novel way with our proposed mutex-based consistency regularization, namely MutexMatch. Specifically, the high-confidence samples are required to exactly predict "what it is" by conventional True-Positive Classifier, while the low-confidence samples are employed to achieve a simpler goal -- to predict with ease "what it is not" by True-Negative Classifier. In this sense, we not only mitigate the pseudo-labeling errors but also make full use of the low-confidence unlabeled data by consistency of dissimilarity degree. MutexMatch achieves superior performance on multiple benchmark datasets, i.e., CIFAR-10, CIFAR-100, SVHN, STL-10, mini-ImageNet and Tiny-ImageNet. More importantly, our method further shows superiority when the amount of labeled data is scarce, e.g., 92.23% accuracy with only 20 labeled data on CIFAR-10. Our code and model weights have been released at https://github.com/NJUyued/MutexMatch4SSL.

cs.CV↗