arXiv subjects

Shuai Zhang

Publications and source records attributed to Shuai Zhang.

At least 253 records · Page 14Linked to original sources

arXiv2024

Observation of giant nonreciprocal charge transport from quantum Hall states in a topological insulator

Symmetry breaking in quantum materials is of great importance and can lead to nonreciprocal charge transport. Topological insulators provide a unique platform to study nonreciprocal charge transport due to their surface states, especially quantum Hall states under external magnetic field. Here, we report the observation of nonreciprocal charge transport mediated by quantum Hall states in devices composed of the intrinsic topological insulator Sn-Bi1.1Sb0.9Te2S, which is attributed to asymmetric scattering between quantum Hall states and Dirac surface states. A giant nonreciprocal coefficient of up to 2.26*10^5 A^-1 is found. Our work not only reveals the properties of nonreciprocal charge transport of quantum Hall states in topological insulators, but also paves the way for future electronic devices.

cond-mat.mes-hall↗

arXiv2024

Unveiling the Secrets of Engaging Conversations: Factors that Keep Users Hooked on Role-Playing Dialog Agents

With the growing humanlike nature of dialog agents, people are now engaging in extended conversations that can stretch from brief moments to substantial periods of time. Understanding the factors that contribute to sustaining these interactions is crucial, yet existing studies primarily focusing on short-term simulations that rarely explore such prolonged and real conversations. In this paper, we investigate the factors influencing retention rates in real interactions with roleplaying models. By analyzing a large dataset of interactions between real users and thousands of characters, we systematically examine multiple factors and assess their impact on user retention rate. Surprisingly, we find that the degree to which the bot embodies the roles it plays has limited influence on retention rates, while the length of each turn it speaks significantly affects retention rates. This study sheds light on the critical aspects of user engagement with role-playing models and provides valuable insights for future improvements in the development of large language models for role-playing purposes.

cs.CL↗

arXiv2024

Combating Data Imbalances in Federated Semi-supervised Learning with Dual Regulators

Federated learning has become a popular method to learn from decentralized heterogeneous data. Federated semi-supervised learning (FSSL) emerges to train models from a small fraction of labeled data due to label scarcity on decentralized clients. Existing FSSL methods assume independent and identically distributed (IID) labeled data across clients and consistent class distribution between labeled and unlabeled data within a client. This work studies a more practical and challenging scenario of FSSL, where data distribution is different not only across clients but also within a client between labeled and unlabeled data. To address this challenge, we propose a novel FSSL framework with dual regulators, FedDure. FedDure lifts the previous assumption with a coarse-grained regulator (C-reg) and a fine-grained regulator (F-reg): C-reg regularizes the updating of the local model by tracking the learning effect on labeled data distribution; F-reg learns an adaptive weighting scheme tailored for unlabeled instances in each client. We further formulate the client model training as bi-level optimization that adaptively optimizes the model in the client with two regulators. Theoretically, we show the convergence guarantee of the dual regulators. Empirically, we demonstrate that FedDure is superior to the existing methods across a wide range of settings, notably by more than 11 on CIFAR-10 and CINIC-10 datasets.

cs.LG↗

arXiv2024

PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design

Retrieval-augmented generation (RAG) can enhance the generation quality of large language models (LLMs) by incorporating external token databases. However, retrievals from large databases can constitute a substantial portion of the overall generation time, particularly when retrievals are periodically performed to align the retrieved content with the latest states of generation. In this paper, we introduce PipeRAG, a novel algorithm-system co-design approach to reduce generation latency and enhance generation quality. PipeRAG integrates (1) pipeline parallelism to enable concurrent retrieval and generation processes, (2) flexible retrieval intervals to maximize the efficiency of pipeline parallelism, and (3) a performance model to automatically balance retrieval quality and latency based on the generation states and underlying hardware. Our evaluation shows that, by combining the three aforementioned methods, PipeRAG achieves up to 2.6$\times$ speedup in end-to-end generation latency while improving generation quality. These promising results showcase the effectiveness of co-designing algorithms with underlying systems, paving the way for the adoption of PipeRAG in future RAG systems.

cs.CL↗

arXiv2024

Light-induced giant enhancement of nonreciprocal transport at KTaO3-based interfaces

Nonlinear transport is a unique functionality of noncentrosymmetric systems, which reflects profound physics, such as spin-orbit interaction, superconductivity and band geometry. However, it remains highly challenging to enhance the nonreciprocal transport for promising rectification devices. Here, we observe a light-induced giant enhancement of nonreciprocal transport at the superconducting and epitaxial CaZrO3/KTaO3 (111) interfaces. The nonreciprocal transport coefficient undergoes a giant increase with three orders of magnitude up to 105 A-1T-1. Furthermore, a strong Rashba spin-orbit coupling effective field of 14.7 T is achieved with abundant high-mobility photocarriers under ultraviolet illumination, which accounts for the giant enhancement of nonreciprocal transport coefficient. Our first-principles calculations further disclose the stronger Rashba spin-orbit coupling strength and the longer relaxation time in the photocarrier excitation process, bridging the light-property quantitative relationship. Our work provides an alternative pathway to boost nonreciprocal transport in noncentrosymmetric systems and facilitates the promising applications in opto-rectification devices and spin-orbitronic devices.

cond-mat.mes-hall↗

arXiv2024

Using k-means assistant event selection strategy to study anomalous quartic gauge couplings at muon colliders

The search for new physics beyond the Standard Model is one of the central problems of current high energy physics interest. As the luminosities of current and near-future colliders continue to increase, the search for new physics has increased the requirements for processing large amounts of data. Meanwhile, quantum computing which is rapidly evolving, has great potential to become a powerful tool to help search for new physics signals. Since the k-means algorithm is known to be able to be accelerated with the help of quantum computing, we investigate and propose an event selection strategy based on k-means algorithm to search for new physics signals. Taking the case of tri-photon processes at the muon colliders as an example, the event selection strategy is shown to be effective in helping to search for the signals of dimension-8 operators contributing to anomalous quartic gauge couplings. Compared with traditional event selection strategy, the expected constraints are generally tighter.

hep-ph↗

arXiv2024

Chemical Rules for Stacked Kagome and Honeycomb Topological Semimetals

We study the chemical rules for predicting and understanding topological states in stacked kagome and honeycomb lattices in both analytical and numerical ways. Starting with a minimal five-band tight-binding model, we sort out all the topological states into five groups, which are determined by the interlayer and intralayer hopping parameters. Combined with the model, we design an algorithm to obtain a series of experimentally synthesized topological semimetals with kagome and honeycomb layers, i.e., IAMX family (IA = Alkali metal element, M = Rare earth metal element, X = Carbon group element), in the inorganic crystal structure database. A follow-up high-throughput calculation shows that IAMX family materials are all nodal-line semimetals and they will be Weyl semimetals after taking spin-orbit coupling into consideration. To have further insights into the topology of the IAMX family, a detailed chemical rule analysis is carried out on the high-throughput calculations, including the lattice constants of the structure, intralayer and interlayer couplings, bond strengths, electronegativity, and so on, which are consistent with our tight-binding model. Our study provides a way to discover and modulate topological properties in stacked kagome and honeycomb crystals and offers candidates for studying topology-related properties like topological superconductors and axion insulators.

cond-mat.mes-hall↗

arXiv2024

Foundation Models for Recommender Systems: A Survey and New Perspectives

Recently, Foundation Models (FMs), with their extensive knowledge bases and complex architectures, have offered unique opportunities within the realm of recommender systems (RSs). In this paper, we attempt to thoroughly examine FM-based recommendation systems (FM4RecSys). We start by reviewing the research background of FM4RecSys. Then, we provide a systematic taxonomy of existing FM4RecSys research works, which can be divided into four different parts including data characteristics, representation learning, model type, and downstream tasks. Within each part, we review the key recent research developments, outlining the representative models and discussing their characteristics. Moreover, we elaborate on the open problems and opportunities of FM4RecSys aiming to shed light on future research directions in this area. In conclusion, we recap our findings and discuss the emerging trends in this field.

cs.IR↗

arXiv2024

Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems

We develop a multi-agent reinforcement learning (MARL) algorithm to minimize the total energy consumption of multiple massive MIMO (multiple-input multiple-output) base stations (BSs) in a multi-cell network while preserving the overall quality-of-service (QoS) by making decisions on the multi-level advanced sleep modes (ASMs) and antenna switching of these BSs. The problem is modeled as a decentralized partially observable Markov decision process (DEC-POMDP) to enable collaboration between individual BSs, which is necessary to tackle inter-cell interference. A multi-agent proximal policy optimization (MAPPO) algorithm is designed to learn a collaborative BS control policy. To enhance its scalability, a modified version called MAPPO-neighbor policy is further proposed. Simulation results demonstrate that the trained MAPPO agent achieves better performance compared to baseline policies. Specifically, compared to the auto sleep mode 1 (symbol-level sleeping) algorithm, the MAPPO-neighbor policy reduces power consumption by approximately 8.7% during low-traffic hours and improves energy efficiency by approximately 19% during high-traffic hours, respectively.

cs.IT↗

arXiv2024

Two-dimensional silk

The ability to form silk films on semiconductors, metals, and oxides or as free-standing membranes has motivated research into silk-based electronic, optical, and biomedical devices. However, the inherent disorder of native silk limits device performance. Here we report the creation of highly ordered two-dimensional (2D) silk fibroin (SF) layers on van der Waals solids. Using in situ atomic force microscopy, synchrotron-based infrared spectroscopy, and molecular dynamics simulations, we develop a mechanistic understanding of the assembly process. We show that the films consist of lamellae having an epitaxial relationship with the underlying lattice and that the SF molecules exhibit the same Beta-sheet secondary structure seen in the crystallites of the native form. By increasing the SF concentration, multilayer films form via layer-by-layer growth, either along a classical pathway in which SF molecules assemble directly into the lamellae or, at sufficiently high concentrations, along a two-step pathway beginning with formation of a disordered monolayer that subsequently converts into the crystalline phase. Kelvin probe measurements show that these 2D SF layers substantially alter the surface potential. Moreover, the ability to assemble 2D silk on both graphite and MoS2 suggests that it may provide a general platform for silk-based electronics on vdW solids.

cond-mat.mtrl-sci↗

arXiv2024

Pressure waves from air gun bubbles: a numerical analysis based on Finite Volume Method

The pressure wave emitted from the air gun contains many frequencies, among which the low-frequency waves are desirable for exploration and imaging, while the high-frequency waves need to be suppressed as they are harmful to marine species. The high-frequency waves originate from the fast oscillations of the flow during the release of the air, such as the impingement of the gas jet into the liquid, the expansion of the air gun bubble, and the interaction between the air gun body and the bubble. However, those dynamic and the emitted waves are adjustable by the special design of the air guns. To analyze the underlying relations, we present a numerical study with a compressible air gun bubble model using the volume of fluid (VOF) approach combined with the finite volume method (FVM) implemented in STAR-CCM+. The venting process of an air gun is investigated to reveal the influence of the air gun body. The results show that air gun pressure for the far field is mainly proportional to the expansion acceleration of the whole gas. Our results also indicate that the opening and chamber shape of the air gun affects the gas expansion acceleration, which influences the first peak of the pressure wave significantly. The larger the opening is, the faster the gas is released, the greater the amplitude of the first peak is. The larger the chamber length/diameter ratio, the slower the gas is released and the lower the amplitude of the first peak.

physics.flu-dyn↗

arXiv2023

Offline Imitation Learning with Variational Counterfactual Reasoning

In offline imitation learning (IL), an agent aims to learn an optimal expert behavior policy without additional online environment interactions. However, in many real-world scenarios, such as robotics manipulation, the offline dataset is collected from suboptimal behaviors without rewards. Due to the scarce expert data, the agents usually suffer from simply memorizing poor trajectories and are vulnerable to variations in the environments, lacking the capability of generalizing to new environments. To automatically generate high-quality expert data and improve the generalization ability of the agent, we propose a framework named \underline{O}ffline \underline{I}mitation \underline{L}earning with \underline{C}ounterfactual data \underline{A}ugmentation (OILCA) by doing counterfactual inference. In particular, we leverage identifiable variational autoencoder to generate \textit{counterfactual} samples for expert data augmentation. We theoretically analyze the influence of the generated expert data and the improvement of generalization. Moreover, we conduct extensive experiments to demonstrate that our approach significantly outperforms various baselines on both \textsc{DeepMind Control Suite} benchmark for in-distribution performance and \textsc{CausalWorld} benchmark for out-of-distribution generalization. Our code is available at \url{https://github.com/ZexuSun/OILCA-NeurIPS23}.

cs.LG↗

arXiv2023

Incorporating Prior Knowledge into Reinforcement Learning for Soft Tissue Manipulation with Autonomous Grasping Point Selection

Previous soft tissue manipulation studies assumed that the grasping point was known and the target deformation can be achieved. During the operation, the constraints are supposed to be constant, and there is no obstacles around the soft tissue. To go beyond these assumptions, a deep reinforcement learning framework with prior knowledge is proposed for soft tissue manipulation under unknown constraints, such as the force applied by fascia. The prior knowledge is represented through an intuitive manipulation strategy. As an action of the agent, a regulator factor is used to coordinate the intuitive approach and the deliberate network. A reward function is designed to balance the exploration and exploitation for large deformation. Successful simulation results verify that the proposed framework can manipulate the soft tissue while avoiding obstacles and adding new position constraints. Compared with the soft actor-critic (SAC) algorithm, the proposed framework can accelerate the training procedure and improve the generalization.

cs.RO↗

arXiv2023

Observation of a 1/3 Magnetisation Plateau Phase as Evidence for the Kitaev Interaction in a Honeycomb-Lattice Antiferromagnet

Fractional magnetisation plateaus, in which the magnetisation is pinned at a fraction of its saturated value within a range of external magnetic field, are spectacular macroscopic manifestations of the collective quantum behaviours. One prominent example of the plateau phase is found in spin-1/2 triangular-lattice antiferromagnets featuring strong geometrical frustration, and is often interpreted as quantum-fluctuation-stabilised state in magnetic field via the "order-by-disorder" mechanism. Here, we observe an unprecedented 1/3 magnetisation plateau between 5.2 and 7.4 T at 2 K in a spin-1 antiferromagnet Na$_3$Ni$_2$BiO$_6$ with a honeycomb lattice, where conventionally no geometrical frustration is anticipated. By carrying out elastic neutron scattering measurements, we propose the spin structure of the plateau phase to be an unusual partial spin-flop ferrimagnetic order, transitioning from the zigzag antiferromagnetic order in zero field. Our theoretical calculations show that the plateau phase is stabilised by the bond-anisotropic Kitaev interaction. These results provide a new paradigm for the exploration of rich quantum phases in frustrated magnets and exotic Kitaev physics in high-spin systems.

cond-mat.str-el↗

arXiv2023

MobileInst: Video Instance Segmentation on the Mobile

Video instance segmentation on mobile devices is an important yet very challenging edge AI problem. It mainly suffers from (1) heavy computation and memory costs for frame-by-frame pixel-level instance perception and (2) complicated heuristics for tracking objects. To address those issues, we present MobileInst, a lightweight and mobile-friendly framework for video instance segmentation on mobile devices. Firstly, MobileInst adopts a mobile vision transformer to extract multi-level semantic features and presents an efficient query-based dual-transformer instance decoder for mask kernels and a semantic-enhanced mask decoder to generate instance segmentation per frame. Secondly, MobileInst exploits simple yet effective kernel reuse and kernel association to track objects for video instance segmentation. Further, we propose temporal query passing to enhance the tracking ability for kernels. We conduct experiments on COCO and YouTube-VIS datasets to demonstrate the superiority of MobileInst and evaluate the inference latency on one single CPU core of Snapdragon 778G Mobile Platform, without other methods of acceleration. On the COCO dataset, MobileInst achieves 31.2 mask AP and 433 ms on the mobile CPU, which reduces the latency by 50% compared to the previous SOTA. For video instance segmentation, MobileInst achieves 35.0 AP on YouTube-VIS 2019 and 30.1 AP on YouTube-VIS 2021. Code will be available to facilitate real-world applications and future research.

cs.CV↗

arXiv2023

Discovery of a Single-Band Mott Insulator in a van der Waals Flat-Band Compound

The Mott insulator provides an excellent foundation for exploring a wide range of strongly correlated physical phenomena, such as high-temperature superconductivity, quantum spin liquid, and colossal magnetoresistance. A Mott insulator with the simplest degree of freedom is an ideal and highly desirable system for studying the fundamental physics of Mottness. In this study, we have unambiguously identified such an anticipated Mott insulator in a van der Waals layered compound Nb3Cl8. In the high-temperature phase, where interlayer coupling is negligible, density functional theory calculations for the monolayer of Nb3Cl8 suggest a half-filled flat band at the Fermi level, whereas angle-resolved photoemission spectroscopy experiments observe a large gap. This observation is perfectly reproduced by dynamical mean-field theory calculations considering strong electron correlations, indicating a correlation-driven Mott insulator state. Since this half-filled band derived from a single 2a1 orbital is isolated from all other bands, the monolayer of Nb3Cl8 is an ideal realization of the celebrated single-band Hubbard model. Upon decreasing the temperature, the bulk system undergoes a phase transition, where structural changes significantly enhance the interlayer coupling. This results in a bonding-antibonding splitting in the Hubbard bands, while the Mott gap remains dominant. Our discovery provides a simple and seminal model system for investigating Mott physics and other emerging correlated states.

cond-mat.str-el↗

arXiv2023

Identification of Carbon Stars from LAMOST DR7

Carbon stars are excellent kinematic tracers of galaxies and play important roles in understanding the evolution of the Galaxy. Therefore, it is worthwhile to search for them in a large amount of spectra. In this work, we build a new carbon star catalog based on the LAMOST DR7 spectra. The catalog contains 4542 spectra of 3546 carbon stars, identified through line index and near-infrared color-color diagrams. Through visual inspection of the spectra, we further subclassify them into 925 C--H, 384 C--R, 608 C--N, and 1292 Ba stars. However, 437 stars could not be sub-classified due to their low signal-to-noise. Moreover, by comparing with LAMOST DR7 pipeline we find 567 more carbon stars and visually sub-classify them. We find that on the $J-H$ vs. $H-K_{\rm s}$ two-color diagram, C--N stars can be reliably distinguished from the other three sub-types. Additionally, by utilizing the Gaia distance, we study the distribution of carbon stars in the H-R diagram and identify 258 dwarf carbon stars by the criterion $M_{\rm G}>$5.0\,mag. Finally, we present the spatial distribution in Galactic coordinates of the 3546 carbon stars. The majority of C-N, C-R, and Ba stars are distributed at low Galactic latitudes, while most C--H and dC stars distribute at high Galactic latitudes.

astro-ph.GA↗

arXiv2023

Optimizing rgb-d semantic segmentation through multi-modal interaction and pooling attention

Semantic segmentation of RGB-D images involves understanding the appearance and spatial relationships of objects within a scene, which requires careful consideration of various factors. However, in indoor environments, the simple input of RGB and depth images often results in a relatively limited acquisition of semantic and spatial information, leading to suboptimal segmentation outcomes. To address this, we propose the Multi-modal Interaction and Pooling Attention Network (MIPANet), a novel approach designed to harness the interactive synergy between RGB and depth modalities, optimizing the utilization of complementary information. Specifically, we incorporate a Multi-modal Interaction Fusion Module (MIM) into the deepest layers of the network. This module is engineered to facilitate the fusion of RGB and depth information, allowing for mutual enhancement and correction. Additionally, we introduce a Pooling Attention Module (PAM) at various stages of the encoder. This module serves to amplify the features extracted by the network and integrates the module's output into the decoder in a targeted manner, significantly improving semantic segmentation performance. Our experimental results demonstrate that MIPANet outperforms existing methods on two indoor scene datasets, NYUDv2 and SUN-RGBD, underscoring its effectiveness in enhancing RGB-D semantic segmentation.

cs.CV↗