arXiv subjects

Xin Lu

Publications and source records attributed to Xin Lu.

At least 163 records · Page 9Linked to original sources

arXiv2023

Observation of first-order quantum phase transitions and ferromagnetism in twisted double bilayer graphene

Twisted graphene multilayers are highly tunable flatband systems for developing new phases of matter. Thus far, while orbital ferromagnetism has been observed in valley polarized phases, the long-range orders of other correlated phases as well as the quantum phase transitions between different orders mostly remain unknown. Here, we report an observation of Coulomb interaction driven first-order quantum phase transitions and ferromagnetism in twisted double bilayer graphene (TDBG). At zero magnetic field, the transitions are revealed in a series of step-like abrupt resistance jumps with prominent hysteresis loop when either the displacement field (D) or the carrier density (n) is tuned across symmetry-breaking boundary near half filling, indicating a formation of ordered domains. It is worth noting that the good turnability and switching of these states gives a rise to a memory performance with a large on/off ratio. Moreover, when both spin and valley play the roles at finite magnetic field, we observe abundant first-order quantum phase transitions among normal metallic states from charge neutral point, orbital ferromagnetic states from quarter filling, and spin-polarized states from half filling. We interpret these first-order phase transitions in the picture of phase separations and spin domain percolations driven by multi-field tunable Coulomb interactions, in agreement with Lifshitz transition from Hartree-Fock calculations. The observed multi-filed tunable domain structure and its hysteresis resembles the characteristics of multiferroics, revealing intriguing magnetoelectric properties. Our result enriches the correlated phase diagram in TDBG for discovering novel exotic phases and quantum phase transitions, and it would benefit other twisted moiré systems as well.

cond-mat.mes-hall↗

arXiv2023

Don't Lose Yourself! Empathetic Response Generation via Explicit Self-Other Awareness

As a critical step to achieve human-like chatbots, empathetic response generation has attained increasing interests. Previous attempts are incomplete and not sufficient enough to elicit empathy because they only focus on the initial aspect of empathy to automatically mimic the feelings and thoughts of the user via other-awareness. However, they ignore to maintain and take the own views of the system into account, which is a crucial process to achieve the empathy called self-other awareness. To this end, we propose to generate Empathetic response with explicit Self-Other Awareness (EmpSOA). Specifically, three stages, self-other differentiation, self-other modulation and self-other generation, are devised to clearly maintain, regulate and inject the self-other aware information into the process of empathetic response generation. Both automatic and human evaluations on the benchmark dataset demonstrate the superiority of EmpSOA to generate more empathetic responses.

cs.CL↗

arXiv2023

Is ChatGPT Equipped with Emotional Dialogue Capabilities?

This report presents a study on the emotional dialogue capability of ChatGPT, an advanced language model developed by OpenAI. The study evaluates the performance of ChatGPT on emotional dialogue understanding and generation through a series of experiments on several downstream tasks. Our findings indicate that while ChatGPT's performance on emotional dialogue understanding may still lag behind that of supervised models, it exhibits promising results in generating emotional responses. Furthermore, the study suggests potential avenues for future research directions.

cs.CL↗

arXiv2023

Ground-state phase diagram of the extended two-leg $t$-$J$ ladder

Inspired by the observation of a robust $d$-wave superconducting phase driven by tuning the next-nearest-neighbor (NNN) electron hopping in recent density matrix renormalization group (DMRG) studies of six- and eight-leg $t$-$J$ model, we systematically study the phase diagram of the two-leg $t$-$J$ ladder with the NNN couplings (including NNN hopping and spin interaction) in a large region of doping level, by means of the DMRG calculations. Upon doping from half filling, we identify the Luther-Emery liquid (LEL) phase, which can be distinguished as the pairing-dominant and charge density-dominant regime by comparing the Luttinger parameter $K_ρ$. With the growing NNN couplings, pairing correlations are enhanced and correspondingly $K_ρ$ increases, driving the system from the density-dominant to the pairing-dominant regime. In the Tomonaga-Luttinger liquid (TLL) phase in the larger doping region, we identify two TLL regimes with different features of charge density correlation. At the quarter filling ($1/2$ doping level), we find that the strong dimer orders of bond energy in the open system actually decay algebraically and thus do not indicate a spontaneous translational symmetry breaking. Our results show that in the LEL phase of the two-leg ladder, the NNN couplings seem to play the similar role as that on the wider $t$-$J$ cylinder, and studies on this more accessible system can be helpful towards understanding the emergence of the remarkable $d$-wave superconducting phase on the wider system.

cond-mat.str-el↗

arXiv2023

Hybridization-Controlled Pseudogap State in the Quantum Critical Superconductor CeCoIn5

The origin of the partial suppression of the electronic density states in the enigmatic pseudogap behavior, which is at the core of understanding high-$T_c$ superconductivity, has been hotly contested as either a hallmark of preformed Cooper pairs or an incipient order of competing interactions nearby. Here, we report the quasi-particle scattering spectroscopy of the quantum critical superconductor CeCoIn$_5$, where a pseudogap with energy $Δ_g$ was manifested as a dip in the differential conductance ($dI/dV$) below the characteristic temperature of $T_g$. When subjected to external pressure, $T_g$ and $Δ_g$ gradually increase, following the trend of increase in quantum entangled hybridization between Ce 4$f$ moment and conduction electrons. On the other hand, the superconducting (SC) energy gap and its phase transition temperature shows a maximum, revealing a dome shape under pressure. The disparate dependence on pressure between the two quantum states shows that the pseudogap is less likely involved in the formation of SC Cooper pairs, but rather is controlled by Kondo hybridization, indicating that a novel type of pseudogap is realized in CeCoIn$_5$.

cond-mat.str-el↗

arXiv2022

Detecting Temporal shape changes with the Euler Characteristic Transform

Organoids are multi-cellular structures which are cultured in vitro from stem cells to resemble specific organs (e.g., brain, liver) in their three-dimensional composition. Dynamic changes in the shape and composition of these model systems can be used to understand the effect of mutations and treatments in health and disease. In this paper, we propose a new technique in the field of topological data analysis for DEtecting Temporal shape changes with the Euler Characteristic Transform (DETECT). DETECT is a rotationally invariant signature of dynamically changing shapes. We demonstrate our method on a data set of segmented videos of mouse small intestine organoid experiments and show that it outperforms classical shape descriptors. We verify our method on a synthetic organoid data set and illustrate how it generalises to 3D. We conclude that DETECT offers rigorous quantification of organoids and opens up computationally scalable methods for distinguishing different growth regimes and assessing treatment effects.

q-bio.QM↗

arXiv2022

Boosting Binary Neural Networks via Dynamic Thresholds Learning

Developing lightweight Deep Convolutional Neural Networks (DCNNs) and Vision Transformers (ViTs) has become one of the focuses in vision research since the low computational cost is essential for deploying vision models on edge devices. Recently, researchers have explored highly computational efficient Binary Neural Networks (BNNs) by binarizing weights and activations of Full-precision Neural Networks. However, the binarization process leads to an enormous accuracy gap between BNN and its full-precision version. One of the primary reasons is that the Sign function with predefined or learned static thresholds limits the representation capacity of binarized architectures since single-threshold binarization fails to utilize activation distributions. To overcome this issue, we introduce the statistics of channel information into explicit thresholds learning for the Sign Function dubbed DySign to generate various thresholds based on input distribution. Our DySign is a straightforward method to reduce information loss and boost the representative capacity of BNNs, which can be flexibly applied to both DCNNs and ViTs (i.e., DyBCNN and DyBinaryCCT) to achieve promising performance improvement. As shown in our extensive experiments. For DCNNs, DyBCNNs based on two backbones (MobileNetV1 and ResNet18) achieve 71.2% and 67.4% top1-accuracy on ImageNet dataset, outperforming baselines by a large margin (i.e., 1.8% and 1.5% respectively). For ViTs, DyBinaryCCT presents the superiority of the convolutional embedding layer in fully binarized ViTs and achieves 56.1% on the ImageNet dataset, which is nearly 9% higher than the baseline.

eess.IV↗

arXiv2022

A Unified Model for Multi-class Anomaly Detection

Despite the rapid advance of unsupervised anomaly detection, existing methods require to train separate models for different objects. In this work, we present UniAD that accomplishes anomaly detection for multiple classes with a unified framework. Under such a challenging setting, popular reconstruction networks may fall into an "identical shortcut", where both normal and anomalous samples can be well recovered, and hence fail to spot outliers. To tackle this obstacle, we make three improvements. First, we revisit the formulations of fully-connected layer, convolutional layer, as well as attention layer, and confirm the important role of query embedding (i.e., within attention layer) in preventing the network from learning the shortcut. We therefore come up with a layer-wise query decoder to help model the multi-class distribution. Second, we employ a neighbor masked attention module to further avoid the information leak from the input feature to the reconstructed output feature. Third, we propose a feature jittering strategy that urges the model to recover the correct message even with noisy inputs. We evaluate our algorithm on MVTec-AD and CIFAR-10 datasets, where we surpass the state-of-the-art alternatives by a sufficiently large margin. For example, when learning a unified model for 15 categories in MVTec-AD, we surpass the second competitor on the tasks of both anomaly detection (from 88.1% to 96.5%) and anomaly localization (from 89.5% to 96.8%). Code is available at https://github.com/zhiyuanyou/UniAD.

cs.CV↗

arXiv2022

The Equalization Losses: Gradient-Driven Training for Long-tailed Object Recognition

Long-tail distribution is widely spread in real-world applications. Due to the extremely small ratio of instances, tail categories often show inferior accuracy. In this paper, we find such performance bottleneck is mainly caused by the imbalanced gradients, which can be categorized into two parts: (1) positive part, deriving from the samples of the same category, and (2) negative part, contributed by other categories. Based on comprehensive experiments, it is also observed that the gradient ratio of accumulated positives to negatives is a good indicator to measure how balanced a category is trained. Inspired by this, we come up with a gradient-driven training mechanism to tackle the long-tail problem: re-balancing the positive/negative gradients dynamically according to current accumulative gradients, with a unified goal of achieving balance gradient ratios. Taking advantage of the simple and flexible gradient mechanism, we introduce a new family of gradient-driven loss functions, namely equalization losses. We conduct extensive experiments on a wide spectrum of visual tasks, including two-stage/single-stage long-tailed object detection (LVIS), long-tailed image classification (ImageNet-LT, Places-LT, iNaturalist), and long-tailed semantic segmentation (ADE20K). Our method consistently outperforms the baseline models, demonstrating the effectiveness and generalization ability of the proposed equalization losses. Codes will be released at https://github.com/ModelTC/United-Perception.

cs.CV↗

arXiv2022

Improving Long-tailed Object Detection with Image-Level Supervision by Multi-Task Collaborative Learning

Data in real-world object detection often exhibits the long-tailed distribution. Existing solutions tackle this problem by mitigating the competition between the head and tail categories. However, due to the scarcity of training samples, tail categories are still unable to learn discriminative representations. Bringing more data into the training may alleviate the problem, but collecting instance-level annotations is an excruciating task. In contrast, image-level annotations are easily accessible but not fully exploited. In this paper, we propose a novel framework CLIS (multi-task Collaborative Learning with Image-level Supervision), which leverage image-level supervision to enhance the detection ability in a multi-task collaborative way. Specifically, there are an object detection task (consisting of an instance-classification task and a localization task) and an image-classification task in our framework, responsible for utilizing the two types of supervision. Different tasks are trained collaboratively by three key designs: (1) task-specialized sub-networks that learn specific representations of different tasks without feature entanglement. (2) a siamese sub-network for the image-classification task that shares its knowledge with the instance-classification task, resulting in feature enrichment of detectors. (3) a contrastive learning regularization that maintains representation consistency, bridging feature gaps of different supervision. Extensive experiments are conducted on the challenging LVIS dataset. Without sophisticated loss engineering, CLIS achieves an overall AP of 31.1 with 10.1 point improvement on tail categories, establishing a new state-of-the-art. Code will be at https://github.com/waveboo/CLIS.

cs.CV↗

arXiv2022

Neighbor Regularized Bayesian Optimization for Hyperparameter Optimization

Bayesian Optimization (BO) is a common solution to search optimal hyperparameters based on sample observations of a machine learning model. Existing BO algorithms could converge slowly even collapse when the potential observation noise misdirects the optimization. In this paper, we propose a novel BO algorithm called Neighbor Regularized Bayesian Optimization (NRBO) to solve the problem. We first propose a neighbor-based regularization to smooth each sample observation, which could reduce the observation noise efficiently without any extra training cost. Since the neighbor regularization highly depends on the sample density of a neighbor area, we further design a density-based acquisition function to adjust the acquisition reward and obtain more stable statistics. In addition, we design a adjustment mechanism to ensure the framework maintains a reasonable regularization strength and density reward conditioned on remaining computation resources. We conduct experiments on the bayesmark benchmark and important computer vision benchmarks such as ImageNet and COCO. Extensive experiments demonstrate the effectiveness of NRBO and it consistently outperforms other state-of-the-art methods.

cs.CV↗

arXiv2022

Multiscale methods for signal selection in single-cell data

Analysis of single-cell transcriptomics often relies on clustering cells and then performing differential gene expression (DGE) to identify genes that vary between these clusters. These discrete analyses successfully determine cell types and markers; however, continuous variation within and between cell types may not be detected. We propose three topologically motivated mathematical methods for unsupervised feature selection that consider discrete and continuous transcriptional patterns on an equal footing across multiple scales simultaneously. Eigenscores ($\text{eig}_i$) rank signals or genes based on their correspondence to low-frequency intrinsic patterning in the data using the spectral decomposition of the Laplacian graph. The multiscale Laplacian score (MLS) is an unsupervised method for locating relevant scales in data and selecting the genes that are coherently expressed at these respective scales. The persistent Rayleigh quotient (PRQ) takes data equipped with a filtration, allowing the separation of genes with different roles in a bifurcation process (e.g., pseudo-time). We demonstrate the utility of these techniques by applying them to published single-cell transcriptomics data sets. The methods validate previously identified genes and detect additional biologically meaningful genes with coherent expression patterns. By studying the interaction between gene signals and the geometry of the underlying space, the three methods give multidimensional rankings of the genes and visualisation of relationships between them.

q-bio.QM↗

arXiv2022

Tyranny-of-the-minority regression adjustment in randomized experiments

Regression adjustment is widely used for the analysis of randomized experiments to improve the estimation efficiency of the treatment effect. This paper reexamines a weighted regression adjustment method termed as tyranny-of-the-minority (ToM), wherein units in the minority group are given greater weights. We demonstrate that the ToM regression adjustment is more robust than Lin 2013's regression adjustment with treatment-covariate interactions, even though these two regression adjustment methods are asymptotically equivalent in completely randomized experiments. Moreover, we extend ToM regression adjustment to stratified randomized experiments, completely randomized survey experiments, and cluster randomized experiments. We obtain design-based properties of the ToM regression-adjusted average treatment effect estimator under such designs. In particular, we show that ToM regression-adjusted estimator improves the asymptotic estimation efficiency compared to the unadjusted estimator even when the regression model is misspecified, and is optimal in the class of linearly adjusted estimators. We also study the asymptotic properties of various heteroscedasticity-robust standard error estimators and provide recommendations for practitioners. Simulation studies and real data analysis demonstrate ToM regression adjustment's superiority over existing methods.

stat.ME↗

arXiv2022

Quantum Hall phase in graphene engineered by interfacial charge coupling

Quantum Hall effect (QHE), the ground to construct modern conceptual electronic systems with emerging physics, is often much influenced by the interplay between the host two-dimensional electron gases and the substrate, sometimes predicted to exhibit exotic topological states. Yet the understanding of the underlying physics and the controllable engineering of this paradigm of interaction remain challenging. Here we demonstrate the observation of an unusual QHE, which differs markedly from the known picture, in graphene samples in contact with an anti-ferromagnetic insulator CrOCl equipped with dual gates. Owing to the peculiar interfacial coupling, Landau levels in monolayer graphene remain intact at negative filling fractions, but largely deviated for the positive gate-doping range. The latter QHE phase even presents in the limit of zero magnetic field, with the consequential Landau quantization following a parabolic relation between the displacement field $D$ and the magnetic field $B$. This characteristic prevails up to 100 K in a sufficiently wide effective doping range from 0 to 10$^{13}$ cm$^{-2}$. Our findings thus open up new routes for manipulating the quantum electronic states, which may find applications in such as quantum metrology.

cond-mat.mes-hall↗

arXiv2022

Few-shot Object Counting with Similarity-Aware Feature Enhancement

This work studies the problem of few-shot object counting, which counts the number of exemplar objects (i.e., described by one or several support images) occurring in the query image. The major challenge lies in that the target objects can be densely packed in the query image, making it hard to recognize every single one. To tackle the obstacle, we propose a novel learning block, equipped with a similarity comparison module and a feature enhancement module. Concretely, given a support image and a query image, we first derive a score map by comparing their projected features at every spatial position. The score maps regarding all support images are collected together and normalized across both the exemplar dimension and the spatial dimensions, producing a reliable similarity map. We then enhance the query feature with the support features by employing the developed point-wise similarities as the weighting coefficients. Such a design encourages the model to inspect the query image by focusing more on the regions akin to the support images, leading to much clearer boundaries between different objects. Extensive experiments on various benchmarks and training setups suggest that we surpass the state-of-the-art methods by a sufficiently large margin. For instance, on a recent large-scale FSC-147 dataset, we surpass the state-of-the-art method by improving the mean absolute error from 22.08 to 14.32 (35%$\uparrow$). Code has been released in https://github.com/zhiyuanyou/SAFECount.

cs.CV↗

arXiv2022

Improving Image Restoration by Revisiting Global Information Aggregation

Global operations, such as global average pooling, are widely used in top-performance image restorers. They aggregate global information from input features along entire spatial dimensions but behave differently during training and inference in image restoration tasks: they are based on different regions, namely the cropped patches (from images) and the full-resolution images. This paper revisits global information aggregation and finds that the image-based features during inference have a different distribution than the patch-based features during training. This train-test inconsistency negatively impacts the performance of models, which is severely overlooked by previous works. To reduce the inconsistency and improve test-time performance, we propose a simple method called Test-time Local Converter (TLC). Our TLC converts global operations to local ones only during inference so that they aggregate features within local spatial regions rather than the entire large images. The proposed method can be applied to various global modules (e.g., normalization, channel and spatial attention) with negligible costs. Without the need for any fine-tuning, TLC improves state-of-the-art results on several image restoration tasks, including single-image motion deblurring, video deblurring, defocus deblurring, and image denoising. In particular, with TLC, our Restormer-Local improves the state-of-the-art result in single image deblurring from 32.92 dB to 33.57 dB on GoPro dataset. The code is available at https://github.com/megvii-research/tlc.

cs.CV↗

arXiv2022

Design-based theory for cluster rerandomization

Complete randomization balances covariates on average, but covariate imbalance often exists in finite samples. Rerandomization can ensure covariate balance in the realized experiment by discarding the undesired treatment assignments. Many field experiments in public health and social sciences assign the treatment at the cluster level due to logistical constraints or policy considerations. Moreover, they are frequently combined with rerandomization in the design stage. We refer to cluster rerandomization as a cluster-randomized experiment compounded with rerandomization to balance covariates at the individual or cluster level. Existing asymptotic theory can only deal with rerandomization with treatments assigned at the individual level, leaving that for cluster rerandomization an open problem. To fill the gap, we provide a design-based theory for cluster rerandomization. Moreover, we compare two cluster rerandomization schemes that use prior information on the importance of the covariates: one based on the weighted Euclidean distance and the other based on the Mahalanobis distance with tiers of covariates. We demonstrate that the former dominates the latter with optimal weights and orthogonalized covariates. Last but not least, we discuss the role of covariate adjustment in the analysis stage and recommend covariate-adjusted procedures that can be conveniently implemented by least squares with the associated robust standard errors.

stat.ME↗

arXiv2022

HINet: Half Instance Normalization Network for Image Restoration

In this paper, we explore the role of Instance Normalization in low-level vision tasks. Specifically, we present a novel block: Half Instance Normalization Block (HIN Block), to boost the performance of image restoration networks. Based on HIN Block, we design a simple and powerful multi-stage network named HINet, which consists of two subnetworks. With the help of HIN Block, HINet surpasses the state-of-the-art (SOTA) on various image restoration tasks. For image denoising, we exceed it 0.11dB and 0.28 dB in PSNR on SIDD dataset, with only 7.5% and 30% of its multiplier-accumulator operations (MACs), 6.8 times and 2.9 times speedup respectively. For image deblurring, we get comparable performance with 22.5% of its MACs and 3.3 times speedup on REDS and GoPro datasets. For image deraining, we exceed it by 0.3 dB in PSNR on the average result of multiple datasets with 1.4 times speedup. With HINet, we won 1st place on the NTIRE 2021 Image Deblurring Challenge - Track2. JPEG Artifacts, with a PSNR of 29.70. The code is available at https://github.com/megvii-model/HINet.

eess.IV↗