arXiv Science⌕ Search

arXiv subjects

Lin Zhao

Publications and source records attributed to Lin Zhao.

At least 199 records · Page 11Linked to original sources
arXiv2023

When Brain-inspired AI Meets AGI

Artificial General Intelligence (AGI) has been a long-standing goal of humanity, with the aim of creating machines capable of performing any intellectual task that humans can do. To achieve this, AGI researchers draw inspiration from the human brain and seek to replicate its principles in intelligent machines. Brain-inspired artificial intelligence is a field that has emerged from this endeavor, combining insights from neuroscience, psychology, and computer science to develop more efficient and powerful AI systems. In this article, we provide a comprehensive overview of brain-inspired AI from the perspective of AGI. We begin with the current progress in brain-inspired AI and its extensive connection with AGI. We then cover the important characteristics for both human intelligence and AGI (e.g., scaling, multimodality, and reasoning). We discuss important technologies toward achieving AGI in current AI systems, such as in-context learning and prompt tuning. We also investigate the evolution of AGI systems from both algorithmic and infrastructural perspectives. Finally, we explore the limitations and future of AGI.

cs.AI↗
arXiv2023

Coupling Artificial Neurons in BERT and Biological Neurons in the Human Brain

Linking computational natural language processing (NLP) models and neural responses to language in the human brain on the one hand facilitates the effort towards disentangling the neural representations underpinning language perception, on the other hand provides neurolinguistics evidence to evaluate and improve NLP models. Mappings of an NLP model's representations of and the brain activities evoked by linguistic input are typically deployed to reveal this symbiosis. However, two critical problems limit its advancement: 1) The model's representations (artificial neurons, ANs) rely on layer-level embeddings and thus lack fine-granularity; 2) The brain activities (biological neurons, BNs) are limited to neural recordings of isolated cortical unit (i.e., voxel/region) and thus lack integrations and interactions among brain functions. To address those problems, in this study, we 1) define ANs with fine-granularity in transformer-based NLP models (BERT in this study) and measure their temporal activations to input text sequences; 2) define BNs as functional brain networks (FBNs) extracted from functional magnetic resonance imaging (fMRI) data to capture functional interactions in the brain; 3) couple ANs and BNs by maximizing the synchronization of their temporal activations. Our experimental results demonstrate 1) The activations of ANs and BNs are significantly synchronized; 2) the ANs carry meaningful linguistic/semantic information and anchor to their BN signatures; 3) the anchored BNs are interpretable in a neurolinguistic context. Overall, our study introduces a novel, general, and effective framework to link transformer-based NLP models and neural activities in response to language and may provide novel insights for future studies such as brain-inspired evaluation and development of NLP models.

cs.CL↗
arXiv2023

Core-Periphery Principle Guided Redesign of Self-Attention in Transformers

Designing more efficient, reliable, and explainable neural network architectures is critical to studies that are based on artificial intelligence (AI) techniques. Previous studies, by post-hoc analysis, have found that the best-performing ANNs surprisingly resemble biological neural networks (BNN), which indicates that ANNs and BNNs may share some common principles to achieve optimal performance in either machine learning or cognitive/behavior tasks. Inspired by this phenomenon, we proactively instill organizational principles of BNNs to guide the redesign of ANNs. We leverage the Core-Periphery (CP) organization, which is widely found in human brain networks, to guide the information communication mechanism in the self-attention of vision transformer (ViT) and name this novel framework as CP-ViT. In CP-ViT, the attention operation between nodes is defined by a sparse graph with a Core-Periphery structure (CP graph), where the core nodes are redesigned and reorganized to play an integrative role and serve as a center for other periphery nodes to exchange information. We evaluated the proposed CP-ViT on multiple public datasets, including medical image datasets (INbreast) and natural image datasets. Interestingly, by incorporating the BNN-derived principle (CP structure) into the redesign of ViT, our CP-ViT outperforms other state-of-the-art ANNs. In general, our work advances the state of the art in three aspects: 1) This work provides novel insights for brain-inspired AI: we can utilize the principles found in BNNs to guide and improve our ANN architecture design; 2) We show that there exist sweet spots of CP graphs that lead to CP-ViTs with significantly improved performance; and 3) The core nodes in CP-ViT correspond to task-related meaningful and important image patches, which can significantly enhance the interpretability of the trained deep model.

cs.LG↗
arXiv2023

CP-CNN: Core-Periphery Principle Guided Convolutional Neural Network

The evolution of convolutional neural networks (CNNs) can be largely attributed to the design of its architecture, i.e., the network wiring pattern. Neural architecture search (NAS) advances this by automating the search for the optimal network architecture, but the resulting network instance may not generalize well in different tasks. To overcome this, exploring network design principles that are generalizable across tasks is a more practical solution. In this study, We explore a novel brain-inspired design principle based on the core-periphery property of the human brain network to guide the design of CNNs. Our work draws inspiration from recent studies suggesting that artificial and biological neural networks may have common principles in optimizing network architecture. We implement the core-periphery principle in the design of network wiring patterns and the sparsification of the convolution operation. The resulting core-periphery principle guided CNNs (CP-CNNs) are evaluated on three different datasets. The experiments demonstrate the effectiveness and superiority compared to CNNs and ViT-based methods. Overall, our work contributes to the growing field of brain-inspired AI by incorporating insights from the human brain into the design of neural networks.

cs.NE↗
arXiv2023

AugGPT: Leveraging ChatGPT for Text Data Augmentation

Text data augmentation is an effective strategy for overcoming the challenge of limited sample sizes in many natural language processing (NLP) tasks. This challenge is especially prominent in the few-shot learning scenario, where the data in the target domain is generally much scarcer and of lowered quality. A natural and widely-used strategy to mitigate such challenges is to perform data augmentation to better capture the data invariance and increase the sample size. However, current text data augmentation methods either can't ensure the correct labeling of the generated data (lacking faithfulness) or can't ensure sufficient diversity in the generated data (lacking compactness), or both. Inspired by the recent success of large language models, especially the development of ChatGPT, which demonstrated improved language comprehension abilities, in this work, we propose a text data augmentation approach based on ChatGPT (named AugGPT). AugGPT rephrases each sentence in the training samples into multiple conceptually similar but semantically different samples. The augmented samples can then be used in downstream model training. Experiment results on few-shot learning text classification tasks show the superior performance of the proposed AugGPT approach over state-of-the-art text data augmentation methods in terms of testing accuracy and distribution of the augmented samples.

cs.CL↗
arXiv2023

Spectroscopic Evidence for Dirac Nodal Surfaces and Nodal Rings in Superconductor NaAlSi

The discovery of the topological states has become a key topic in condensed matter physics with the focus evolving from the Dirac or Weyl points to high-dimension topological states of the nodal lines and nodal surfaces. For a topological material to manifest its quantum properties and become useful in applications, the topological states need to be genuine and clean so that they lie close to the Fermi level without other trivial bands existing at the Fermi level. While a number of high-dimension topological materials are predicted, only a few of them have been synthesized and confirmed and the genuine and clean ones are especially scarce. Here we report the realization of the genuine clean multiple high-dimension topological states in NaAlSi. By performing high-resolution angle-resolved photoemission measurements and band structure calculations, we have observed two sets of nodal surfaces and the formation of two homocentric nodal ring states in NaAlSi. The observed nodal rings are distinct in that the inner one is a type-{\uppercase\expandafter{\romannumeral1}} nodal ring while the outer one is a type-{\uppercase\expandafter{\romannumeral1}} nodal ring embedded with four type-{\uppercase\expandafter{\romannumeral3}} nodal points. All the bands involved in the nodal rings lie very close to the Fermi level with no other trivial bands coexisting at the Fermi level. These observations make NaAlSi a desirable topological material to explore for novel quantum states and exotic properties.

cond-mat.mtrl-sci↗
arXiv2023

Observation of spin-polarized surface states in a nodal line semimetal SnTaS$_{2}$

The superconductor SnTaS$_{2}$ is theoretically predicted to be an intriguing topological nodal line semimetal without consideration of spin-orbit coupling. By carrying out angle-resolved photoemission (ARPES) and spin-resolved ARPES measurements combined with band structure calculations, we have provided a complete picture of the electronic structure and spin polarization property for the prominent surface states of SnTaS$_{2}$. The low-energy electronic states are dominated by surface states; two of them are from the S-terminated surface, while four of them are from the Sn-terminated surface. These give rise to interesting Fermi surface topology of SnTaS$_{2}$: three pockets located at $\barΓ$, $\bar{M}$ and $\bar{K}$ for the S-terminated surface and two pockets surrounding $\barΓ$ and $\bar{K}$ for the Sn-terminated surface. We further reveal that two surface states that cross the Fermi level are spin-polarized. Since SnTaS$_{2}$ is also a superconductor, our observations indicate that it may provide a new platform to explore topological superconductivity and other exotic properties.

cond-mat.supr-con↗
arXiv2023

Global Convergence of Two-timescale Actor-Critic for Solving Linear Quadratic Regulator

The actor-critic (AC) reinforcement learning algorithms have been the powerhouse behind many challenging applications. Nevertheless, its convergence is fragile in general. To study its instability, existing works mostly consider the uncommon double-loop variant or basic models with finite state and action space. We investigate the more practical single-sample two-timescale AC for solving the canonical linear quadratic regulator (LQR) problem, where the actor and the critic update only once with a single sample in each iteration on an unbounded continuous state and action space. Existing analysis cannot conclude the convergence for such a challenging case. We develop a new analysis framework that allows establishing the global convergence to an $ε$-optimal solution with at most an $\mathcal{O}(ε^{-2.5})$ sample complexity. To our knowledge, this is the first finite-time convergence analysis for the single sample two-timescale AC for solving LQR with global optimality. The sample complexity improves those of other variants by orders, which sheds light on the practical wisdom of single sample algorithms. We also further validate our theoretical findings via comprehensive simulation comparisons.

cs.LG↗
arXiv2023

Gyri vs. Sulci: Disentangling Brain Core-Periphery Functional Networks via Twin-Transformer

The human cerebral cortex is highly convoluted into convex gyri and concave sulci. It has been demonstrated that gyri and sulci are significantly different in their anatomy, connectivity, and function, besides exhibiting opposite shape patterns, long-distance axonal fibers connected to gyri are much denser than those connected to sulci, and neural signals on gyri are more complex in low-frequency while sulci are more complex in high-frequency. Although accumulating evidence shows significant differences between gyri and sulci, their primary roles in brain function have not been elucidated yet. To solve this fundamental problem, we design a novel Twin-Transformer framework to unveil the unique functional roles of gyri and sulci as well as their relationship in the whole brain function. Our Twin-Transformer framework adopts two structure-identical (twin) Transformers to disentangle spatial-temporal patterns of gyri and sulci, one focuses on the information of gyri and the other is on sulci. The Gyro-Sulcal interactions, along with the tremendous but widely existing variability across subjects, are characterized in the loss design. We validated our Twin-Transformer on the HCP task-fMRI dataset, for the first time, to elucidate the different roles of gyri and sulci in brain function. Our results suggest that gyri and sulci could work together in a core-periphery network manner, that is, gyri could serve as core networks for information gathering and distributing, while sulci could serve as periphery networks for specific local information processing. These findings have shed new light on our fundamental understanding of the brain's basic structural and functional mechanisms.

q-bio.NC↗
arXiv2023

Towards High Performance One-Stage Human Pose Estimation

Making top-down human pose estimation method present both good performance and high efficiency is appealing. Mask RCNN can largely improve the efficiency by conducting person detection and pose estimation in a single framework, as the features provided by the backbone are able to be shared by the two tasks. However, the performance is not as good as traditional two-stage methods. In this paper, we aim to largely advance the human pose estimation results of Mask-RCNN and still keep the efficiency. Specifically, we make improvements on the whole process of pose estimation, which contains feature extraction and keypoint detection. The part of feature extraction is ensured to get enough and valuable information of pose. Then, we introduce a Global Context Module into the keypoints detection branch to enlarge the receptive field, as it is crucial to successful human pose estimation. On the COCO val2017 set, our model using the ResNet-50 backbone achieves an AP of 68.1, which is 2.6 higher than Mask RCNN (AP of 65.5). Compared to the classic two-stage top-down method SimpleBaseline, our model largely narrows the performance gap (68.1 AP vs. 68.9 AP) with a much faster inference speed (77 ms vs. 168 ms), demonstrating the effectiveness of the proposed method. Code is available at: https://github.com/lingl_space/maskrcnn_keypoint_refined.

cs.CV↗
arXiv2022

Observation of Flat Band, Dirac Nodal Lines and Topological Surface States in Kagome Superconductor CsTi$_3$Bi$_5$

A kagome lattice of 3d transition metals hosts flat bands, Dirac fermions and saddle points. It provides a versatile platform for achieving topological superconductivity, anomalous Hall effect, unconventional density wave order and quantum spin liquid when the strong correlation, spin-orbit coupling or magnetic order are involved in such a lattice. Here, using laser-based angle-resolved photoemission spectroscopy in combination with density functional theory calculations, we investigate the electronic structure of the newly discovered kagome superconductor CsTi$_3$Bi$_5$, which is isostructural to the AV$_3$Sb$_5$ (A=K, Rb or Cs) kagome superconductors and possesses a perfect two-dimensional kagome network of Titanium. We directly observed a strikingly flat band derived from the local destructive interferences of Bloch wave functions within the kagome lattices. We also identify the type-II Dirac nodal loops around the Brillouin zone center, the type-III Dirac nodal loops around the zone corners and type-III Dirac nodal lines along the k$_z$ direction. In addition, around the Brillouin zone center, Z2 nontrivial topological surface states are also observed which is formed from the band inversion due to strong spin orbital coupling. The simultaneous existence of such multi-sets of nontrivial band structures in one kagome superconductor not only provides good opportunities to study related physics in the kagome lattice but also makes CsTi$_3$Bi$_5$ an ideal system to realize noval quantum phenomena by manipulating its chemical potential with chemical doping or pressure.

cond-mat.supr-con↗
arXiv2022

Nodal s$_\pm$ Pairing Symmetry in an Iron-Based Superconductor with only Hole Pockets

The origin of the high temperature superconductivity in the iron-based superconductors remains elusive after being extensively studied for more than a decade. Determination of the pairing symmetry is essential in understanding the superconductivity mechanism. In the iron-based superconductors that have hole pockets around the Brillouin zone center and electron pockets around the zone corners, the pairing symmetry is generally considered to be s$_\pm$, endowing a sign change in the superconducting gap between the hole and electron pockets. For the iron-based superconductors with only hole pockets, however, a couple of pairing scenarios have been proposed but the exact symmetry is still highly controversial. Here we report our determination of the pairing symmetry in KFe$_2$As$_2$ which is a prototypical iron-based superconductor with hole pockets both around the zone center and around the zone corners. By taking laser-based angle resolved photoemission measurements with super-high resolution and at ultra-low temperature, we have precisely determined the superconducting gap distribution and identified the locations of the gap nodes on all the Fermi surface around the zone center and the zone corners. The complete superconducting gap structure, in combination with the observation of the spin resonance in neutron scattering, provides strong evidence on the s$_\pm$ pairing symmetry in KFe$_2$As$_2$ with a gap sign reversal between the hole pockets around the zone center and the hole pockets around the zone corners. These results unify the pairing symmetry in the hole-doped iron-based superconductors and point to the spin fluctuation as the pairing glue in generating superconductivity.

cond-mat.supr-con↗
arXiv2022

JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI

Multi-contrast Magnetic Resonance Imaging (MRI) generates multiple medical images with rich and complementary information for routine clinical use; however, it suffers from a long acquisition time. Recent works for accelerating MRI, mainly designed for single contrast, may not be optimal for multi-contrast scenario since the inherent correlations among the multi-contrast images are not exploited. In addition, independent reconstruction of each contrast usually does not translate to optimal performance of downstream tasks. Motivated by these aspects, in this paper we design an end-to-end framework for accelerating multi-contrast MRI which simultaneously optimizes the entire MR imaging workflow including sampling, reconstruction and downstream tasks to achieve the best overall outcomes. The proposed framework consists of a sampling mask generator for each image contrast and a reconstructor exploiting the inter-contrast correlations with a recurrent structure which enables the information sharing in a holistic way. The sampling mask generator and the reconstructor are trained jointly across the multiple image contrasts. The acceleration ratio of each image contrast is also learnable and can be driven by a downstream task performance. We validate our approach on a multi-contrast brain dataset and a multi-contrast knee dataset. Experiments show that (1) our framework consistently outperforms the baselines designed for single contrast on both datasets; (2) our newly designed recurrent reconstruction network effectively improves the reconstruction quality for multi-contrast images; (3) the learnable acceleration ratio improves the downstream task performance significantly. Overall, this work has potentials to open up new avenues for optimizing the entire multi-contrast MR imaging workflow.

eess.IV↗
arXiv2022

BI AVAN: Brain inspired Adversarial Visual Attention Network

Visual attention is a fundamental mechanism in the human brain, and it inspires the design of attention mechanisms in deep neural networks. However, most of the visual attention studies adopted eye-tracking data rather than the direct measurement of brain activity to characterize human visual attention. In addition, the adversarial relationship between the attention-related objects and attention-neglected background in the human visual system was not fully exploited. To bridge these gaps, we propose a novel brain-inspired adversarial visual attention network (BI-AVAN) to characterize human visual attention directly from functional brain activity. Our BI-AVAN model imitates the biased competition process between attention-related/neglected objects to identify and locate the visual objects in a movie frame the human brain focuses on in an unsupervised manner. We use independent eye-tracking data as ground truth for validation and experimental results show that our model achieves robust and promising results when inferring meaningful human visual attention and mapping the relationship between brain activities and visual stimuli. Our BI-AVAN model contributes to the emerging field of leveraging the brain's functional architecture to inspire and guide the model design in artificial intelligence (AI), e.g., deep neural networks.

cs.CV↗
arXiv2022

Titanium doped kagome superconductor CsV3-xTixSb5 and two distinct phases

The vanadium-based kagome superconductor CsV3Sb5 has attracted tremendous attention due to its unexcepted anomalous Hall effect (AHE), charge density waves (CDWs), nematicity, and a pseudogap pair density wave (PDW) coexisting with unconventional strong-coupling superconductivity (SC). The origins of CDWs, unconventional SC, and their correlation with different electronic states in this kagome system are of great significance, but so far, are still under debate. Chemical doping in the kagome layer provides one of the most direct ways to reveal the intrinsic physics, but remains unexplored. Here, we report, for the first time, the synthesis of Ti-substituted CsV3Sb5 single crystals and its rich phase diagram mapping the evolution of intertwining electronic states. The Ti atoms directly substitute for V in the kagome layers. CsV3-xTixSb5 shows two distinct SC phases upon substitution. The Ti slightly-substituted phase displays an unconventional V-shaped SC gap, coexisting with weakening CDW, PDW, AHE, and nematicity. The Ti highly-substituted phase has a U-shaped SC gap concomitant with a short-range rotation symmetry breaking CDW, while long-range CDW, twofold symmetry of in-plane resistivity, AHE, and PDW are absent. Furthermore, we also demonstrate the chemical substitution of V atoms with other elements such as Cr and Nb, showing a different modulation on the SC phase and CDWs. These findings open up a way to synthesise a new family of doped CsV3Sb5 materials, and further representing a new platform for tuning the different correlated electronic states and superconducting pairing in kagome superconductors.

cond-mat.supr-con↗
arXiv2022

Electronic Origin of High-Tc Maximization and Persistence in Trilayer Cuprate Superconductors

In high temperature cuprate superconductors, it was found that the superconducting transition temperature Tc depends on the number of CuO2 planes (n) in the structural unit and the maximum Tc is realized in the trilayer system (n=3). It was also found that the trilayer superconductors exhibit an unusual phase diagram that Tc keeps nearly constant in the overdoped region which is in strong contrast to the Tc decrease usually found in other cuprate superconductors. The electronic origin of the Tc maximization in the trilayer superconductors and its high Tc persistence in the overdoped region remains unclear. By taking high resolution laser-based angle resolved photoemission (ARPES) measurements, here we report our revelation of the microscopic origin of the unusual superconducting properties in the trilayer superconductors. For the first time we have observed the trilayer splitting in Bi2Sr2Ca2Cu3O10+d (Bi2223) superconductor. The observed Fermi surface, band structures, superconducting gap and the selective Bogoliubov band hybridizations can be well described by a three-layer interaction model. Quantitative information of the microscopic processes involving intra- and interlayer hoppings and pairings are extracted. The electronic origin of the maximum Tc in Bi2223 and the persistence of the high Tc in the overdoped region is revealed. These results provide key insights in understanding high Tc superconductivity and pave a way to further enhance Tc in the cuprate superconductors.

cond-mat.supr-con↗
arXiv2022

MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classification

We introduce MedMNIST v2, a large-scale MNIST-like dataset collection of standardized biomedical images, including 12 datasets for 2D and 6 datasets for 3D. All images are pre-processed into a small size of 28x28 (2D) or 28x28x28 (3D) with the corresponding classification labels so that no background knowledge is required for users. Covering primary data modalities in biomedical images, MedMNIST v2 is designed to perform classification on lightweight 2D and 3D images with various dataset scales (from 100 to 100,000) and diverse tasks (binary/multi-class, ordinal regression, and multi-label). The resulting dataset, consisting of 708,069 2D images and 10,214 3D images in total, could support numerous research / educational purposes in biomedical image analysis, computer vision, and machine learning. We benchmark several baseline methods on MedMNIST v2, including 2D / 3D neural networks and open-source / commercial AutoML tools. The data and code are publicly available at https://medmnist.com/.

cs.CV↗
arXiv2022

Forensicability Assessment of Questioned Images in Recapturing Detection

Recapture detection of face and document images is an important forensic task. With deep learning, the performances of face anti-spoofing (FAS) and recaptured document detection have been improved significantly. However, the performances are not yet satisfactory on samples with weak forensic cues. The amount of forensic cues can be quantified to allow a reliable forensic result. In this work, we propose a forensicability assessment network to quantify the forensicability of the questioned samples. The low-forensicability samples are rejected before the actual recapturing detection process to improve the efficiency of recapturing detection systems. We first extract forensicability features related to both image quality assessment and forensic tasks. By exploiting domain knowledge of the forensic application in image quality and forensic features, we define three task-specific forensicability classes and the initialized locations in the feature space. Based on the extracted features and the defined centers, we train the proposed forensic assessment network (FANet) with cross-entropy loss and update the centers with a momentum-based update method. We integrate the trained FANet with practical recapturing detection schemes in face anti-spoofing and recaptured document detection tasks. Experimental results show that, for a generic CNN-based FAS scheme, FANet reduces the EERs from 33.75% to 19.23% under ROSE to IDIAP protocol by rejecting samples with the lowest 30% forensicability scores. The performance of FAS schemes is poor in the rejected samples, with EER as high as 56.48%. Similar performances in rejecting low-forensicability samples have been observed for the state-of-the-art approaches in FAS and recaptured document detection tasks. To the best of our knowledge, this is the first work that assesses the forensicability of recaptured document images and improves the system efficiency.

cs.CV↗