arXiv subjects

Wei He

Publications and source records attributed to Wei He.

At least 181 records · Page 10Linked to original sources

arXiv2023

The Rise and Potential of Large Language Model Based Agents: A Survey

For a long time, humanity has pursued artificial intelligence (AI) equivalent to or surpassing the human level, with AI agents considered a promising vehicle for this pursuit. AI agents are artificial entities that sense their environment, make decisions, and take actions. Many efforts have been made to develop intelligent agents, but they mainly focus on advancement in algorithms or training strategies to enhance specific capabilities or performance on particular tasks. Actually, what the community lacks is a general and powerful model to serve as a starting point for designing AI agents that can adapt to diverse scenarios. Due to the versatile capabilities they demonstrate, large language models (LLMs) are regarded as potential sparks for Artificial General Intelligence (AGI), offering hope for building general AI agents. Many researchers have leveraged LLMs as the foundation to build AI agents and have achieved significant progress. In this paper, we perform a comprehensive survey on LLM-based agents. We start by tracing the concept of agents from its philosophical origins to its development in AI, and explain why LLMs are suitable foundations for agents. Building upon this, we present a general framework for LLM-based agents, comprising three main components: brain, perception, and action, and the framework can be tailored for different applications. Subsequently, we explore the extensive applications of LLM-based agents in three aspects: single-agent scenarios, multi-agent scenarios, and human-agent cooperation. Following this, we delve into agent societies, exploring the behavior and personality of LLM-based agents, the social phenomena that emerge from an agent society, and the insights they offer for human society. Finally, we discuss several key topics and open problems within the field. A repository for the related papers at https://github.com/WooooDyy/LLM-Agent-Paper-List.

cs.AI↗

arXiv2023

Large Nonreciprocity of Shear-Horizontal Surface Acoustic Waves induced by Magnetoelastic Bilayers

We report large nonreciprocity in the transmission of shear-horizontal surface acoustic waves (SAWs) on LiTaO3 substrate coated with a FeCoSiB/NiFeCu magnetoelastic bilayer. The large difference in saturation magnetization of the two layers not only brings nonreciprocal spin waves (SWs), but also ensures the phonon-magnon (SAWs-SWs) coupling at relatively low wavenumbers. It is found that the angle between the magnetization and the wavevector play important roles in determining the strength of magnetoelastic coupling and nonreciprocity, simultaneously. A large nonreciprocal transmission of SAWs about 30 dB (i.e. 60 dB/mm) is demonstrated at 2.33 GHz. In addition, the dispersion relation between coupled SH-SAWs and nonreciprocal SWs is developed, which provide a good insight into the observed phenomena. Our results offer a convenient approach to implement nonreciprocal SAW isolators or circulators.

physics.app-ph↗

arXiv2023

Exploring wavefunction hybridization of magnon-magnon hybrid state

We investigate magnon magnon hybrid states using a non Hermitian two band Hamiltonian and the concept of wavefunction hybridization. By comparing our model with micromagnetic simulations conducted on a synthetic antiferromagnet with strong magnon magnon coupling, we successfully reproduce not only the resonance frequencies and linewidths but also the phases and amplitudes of the magnon wavefunction. The hybridization effect influences the dissipation rate, leading to the crossing of linewidths. Additionally, we quantify the magnon hybridization within a magnonic Bloch sphere, which enhances the ability to manipulate hybrid magnons for coherent information processing.

cond-mat.mes-hall↗

arXiv2023

Towards Understanding the Capability of Large Language Models on Code Clone Detection: A Survey

Code cloning, the duplication of code fragments, is common in software development. While some reuse aids productivity, excessive cloning hurts maintainability and introduces bugs. Hence, automatic code clone detection is vital. Meanwhile, large language models (LLMs) possess diverse code-related knowledge, making them versatile for various software engineering challenges. However, LLMs' performance in code clone detection is unclear and needs more study for accurate assessment. In this paper, we provide the first comprehensive evaluation of LLMs for clone detection, covering different clone types, languages, and prompts. We find advanced LLMs excel in detecting complex semantic clones, surpassing existing methods. Adding intermediate reasoning steps via chain-of-thought prompts noticeably enhances performance. Additionally, representing code as vector embeddings, especially with text encoders, effectively aids clone detection.Lastly, the ability of LLMs to detect code clones differs among various programming languages. Our study suggests that LLMs have potential for clone detection due to their language capabilities, offering insights for developing robust LLM-based methods to enhance software engineering.

cs.SE↗

arXiv2023

iEDA: An Open-Source Intelligent Physical Implementation Toolkit and Library

Open-source EDA shows promising potential in unleashing EDA innovation and lowering the cost of chip design. This paper presents an open-source EDA project, iEDA, aiming for building a basic infrastructure for EDA technology evolution and closing the industrial-academic gap in the EDA area. iEDA now covers the whole flow of physical design (including Floorplan, Placement, CTS, Routing, Timing Optimization etc.), and part of the analysis tools (Static Timing Analysis and Power Analysis). To demonstrate the effectiveness of iEDA, we implement and tape out three chips of different scales (from 700k to 1.5M gates) on different process nodes (110nm and 28nm) with iEDA. iEDA is publicly available from the project home page http://ieda.oscc.cc.

cs.AR↗

arXiv2023

Building Extraction from Remote Sensing Images via an Uncertainty-Aware Network

Building extraction aims to segment building pixels from remote sensing images and plays an essential role in many applications, such as city planning and urban dynamic monitoring. Over the past few years, deep learning methods with encoder-decoder architectures have achieved remarkable performance due to their powerful feature representation capability. Nevertheless, due to the varying scales and styles of buildings, conventional deep learning models always suffer from uncertain predictions and cannot accurately distinguish the complete footprints of the building from the complex distribution of ground objects, leading to a large degree of omission and commission. In this paper, we realize the importance of uncertain prediction and propose a novel and straightforward Uncertainty-Aware Network (UANet) to alleviate this problem. To verify the performance of our proposed UANet, we conduct extensive experiments on three public building datasets, including the WHU building dataset, the Massachusetts building dataset, and the Inria aerial image dataset. Results demonstrate that the proposed UANet outperforms other state-of-the-art algorithms by a large margin.

cs.CV↗

arXiv2023

On the masses of light pseudoscalar mesons

We investigate the masses of light pseudoscalar mesons by the method based on a new anomaly free condition for axial vector current. By this viewpoint, the field theories discussed here do not have the $U(1)$ problem. We calculate the masses of nine light pseudoscalar mesons, with theoretical result agrees reasonably good with experiment.

physics.gen-ph↗

arXiv2023

A Survey on Federated Recommendation Systems

Federated learning has recently been applied to recommendation systems to protect user privacy. In federated learning settings, recommendation systems can train recommendation models only collecting the intermediate parameters instead of the real user data, which greatly enhances the user privacy. Beside, federated recommendation systems enable to collaborate with other data platforms to improve recommended model performance while meeting the regulation and privacy constraints. However, federated recommendation systems faces many new challenges such as privacy, security, heterogeneity and communication costs. While significant research has been conducted in these areas, gaps in the surveying literature still exist. In this survey, we-(1) summarize some common privacy mechanisms used in federated recommendation systems and discuss the advantages and limitations of each mechanism; (2) review some robust aggregation strategies and several novel attacks against security; (3) summarize some approaches to address heterogeneity and communication costs problems; (4)introduce some open source platforms that can be used to build federated recommendation systems; (5) present some prospective research directions in the future. This survey can guide researchers and practitioners understand the research progress in these areas.

cs.IR↗

arXiv2023

National-scale 1-m resolution land-cover mapping for the entire China based on a low-cost solution and open-access data

Nowadays, many large-scale land-cover (LC) products have been released, however, current LC products for China either lack a fine resolution or nationwide coverage. With the rapid urbanization of China, there is an urgent need for creating a very-high-resolution (VHR) national-scale LC map for China. In this study, a novel 1-m resolution LC map of China covering $9,600,000 km^2$, called SinoLC-1, was produced by using a deep learning framework and multi-source open-access data. To efficiently generate the VHR national-scale LC map, firstly, the reliable LC labels were collected from three 10-m LC products and Open Street Map data. Secondly, the collected 10-m labels and 1-m Google Earth imagery were utilized in the proposed low-to-high (L2H) framework for training. With weak and self-supervised strategies, the L2H framework resolves the label noise brought by the mismatched resolution between training pairs and produces VHR results. Lastly, we compare the SinoLC-1 with five widely used products and validate it with a sample set including 10,6852 points and a statistical report collected from the government. The results show the SinoLC-1 achieved an OA of 74\% and a Kappa of 0.65. Moreover, as the first 1-m national-scale LC map for China, the SinoLC-1 shows overall acceptable results with the finest landscape details.

cs.CV↗

arXiv2023

Oscillatory states of quantum Kapitza pendulum

We study quantum mechanics problem described by the Schrödinger equation with Kapitza pendulum potential, that is the asymmetric double-well potential on the circle. For the oscillatory states spatially localize around the two stable saddle positions of the potential, we obtain the perturbative eigenvalues and corresponding piecewise wavefunctions. The spectrum is computed by extending the angle coordinate to the complex plane so that the quantization condition is formulated as contour integral along a path extending in the imaginary direction. Quantum tunneling between the wells is computed.

quant-ph↗

arXiv2022

Ground states and magnonics in orthogonally-coupled symmetric all-antiferromagnetic junctions

In this work, the rich ground-state structure of orthogonally-coupled symmetric all-antiferromagnetic junctions with easy-plane anisotropy is reported. Spin reorientation process rather than the traditional spin flop (SF) occurs, resulting in a novel phase in which Néel vectors preserve the mirror-reflection symmetry (termed as ``MRS phase"). The phase transitions between SF and MRS phases can be either the first- or second-order. After disturbed by external stimuli, magnons with different parities emerge. For in-plane dc fields, no couplings between magnons occur. When dc fields become oblique, coherent couplings between magnons with opposite parity emerge, leading to anticrossings in resonance frequencies. However, self-hybridization among magnons with the same parity never happens. More interestingly, spin waves based on MRS phase are linearly polarized and their polarization directions can be fine controlled.

cond-mat.mes-hall↗

arXiv2022

Towards Complex Backgrounds: A Unified Difference-Aware Decoder for Binary Segmentation

Binary segmentation is used to distinguish objects of interest from background, and is an active area of convolutional encoder-decoder network research. The current decoders are designed for specific objects based on the common backbones as the encoders, but cannot deal with complex backgrounds. Inspired by the way human eyes detect objects of interest, a new unified dual-branch decoder paradigm named the difference-aware decoder is proposed in this paper to explore the difference between the foreground and the background and separate the objects of interest in optical images. The difference-aware decoder imitates the human eye in three stages using the multi-level features output by the encoder. In Stage A, the first branch decoder of the difference-aware decoder is used to obtain a guide map. The highest-level features are enhanced with a novel field expansion module and a dual residual attention module, and are combined with the lowest-level features to obtain the guide map. In Stage B, the other branch decoder adopts a middle feature fusion module to make trade-offs between textural details and semantic information and generate background-aware features. In Stage C, the proposed difference-aware extractor, consisting of a difference guidance model and a difference enhancement module, fuses the guide map from Stage A and the background-aware features from Stage B, to enlarge the differences between the foreground and the background and output a final detection result. The results demonstrate that the difference-aware decoder can achieve a higher accuracy than the other state-of-the-art binary segmentation methods for these tasks.

cs.CV↗

arXiv2022

Learning by Consuming: Optimal Pricing with Endogenous Information Provision

We study the revenue-maximizing mechanism when a buyer's value evolves endogenously because of learning-by-consuming. A seller sells one unit of a divisible good, while the buyer relies on his private, rough valuation to choose his first-stage consumption level. Consuming more leads to a more precise valuation estimate, after which the buyer determines the second-stage consumption level. The optimum is a menu of try-and-decide contracts, consisting of a first-stage price-quantity pair and a second-stage per-unit price for the remaining quantity. In equilibrium, a higher first-stage valuation buyer pays more for higher first-stage consumption and enjoys a lower second-stage per-unit price. Methodologically, we deal with the difficulty that due to the failure of single-crossing condition, monotonicity in allocation plus the envelope condition is insufficient for incentive compatibility. Our results help to understand contracts about sequential consumption with the learning feature; e.g., leasing contracts for experience goods and trial sessions for certain courses.

econ.TH↗

arXiv2022

Transonic buffet characteristics under conditions of free and forced transition

Transonic buffet is commonly associated with self-sustained flow unsteadiness involving shock-wave/boundary-layer interaction over aerofoils and wings. The phenomenon has been classified as either laminar or turbulent based on the state of the boundary layer immediately upstream of the shock foot and distinct mechanisms for the two types have been suggested. The turbulent case is known to be associated with a global linear instability. Herein, large-eddy simulations are used for the first time to make direct comparisons of the two types by examining free- and forced-transition conditions. Corresponding simulations based on the Reynolds-averaged Navier--Stokes equations for the forced-transition case are also performed for comparison with the scale-resolving approach and for linking the findings with existing literature. Coherent flow features are scrutinised using both data-based spectral proper orthogonal decomposition of the time-marched results and operator-based global linear stability and resolvent analyses within the Reynolds-averaged Navier--Stokes framework. It is demonstrated that the essential dynamic features remain the same for the two buffet types (and for the two levels of the aerodynamic modelling hierarchy), suggesting that both types arise due to the same fundamental mechanism.

physics.flu-dyn↗

arXiv2022

Hermite-Gaussian-mode coherently composed states and deep learning based free-space optical communication link

In laser-based free-space optical communication, besides OAM beams, Hermite-Gaussian (HG) modes or HG-mode coherently composed states (HG-MCCS) can also be adopted as the information carrier to extend the channel capacity with the spatial pattern based encoding and decoding link. The light field of HG-MCCS is mainly determined by three independent parameters, including indexes of HG modes, relative initial phases between two eigenmodes, and scale coefficients of the eigenmodes, which can obtain a large number of effective coding modes at a low mode order. The beam intensity distributions of the HG-MCCSs have obvious distinguishable spatial characteristics and can keep propagation invariance, which are convenient to be decoded by the convolutional neural network (CNN) based image recognition method. We experimentally utilize HG-MCCS to realize a communication link including encoding, transmission under atmospheric turbulence (AT), and decoding based on CNN. With the index order of eigenmodes within six, 125 HG-MCCS are generated and used for information encoding, and the average recognition accuracy reached 99.5% for non-AT conditions. For the 125-level color images transmission, the error rate of the system is less than 1.8% even under the weak AT condition. Our work provides a useful basis for the future combination of dense data communication and artificial intelligence technology.

physics.optics↗

arXiv2022

BMD: A General Class-balanced Multicentric Dynamic Prototype Strategy for Source-free Domain Adaptation

Source-free Domain Adaptation (SFDA) aims to adapt a pre-trained source model to the unlabeled target domain without accessing the well-labeled source data, which is a much more practical setting due to the data privacy, security, and transmission issues. To make up for the absence of source data, most existing methods introduced feature prototype based pseudo-labeling strategies to realize self-training model adaptation. However, feature prototypes are obtained by instance-level predictions based feature clustering, which is category-biased and tends to result in noisy labels since the visual domain gaps between source and target are usually different between categories. In addition, we found that a monocentric feature prototype may be ineffective to represent each category and introduce negative transfer, especially for those hard-transfer data. To address these issues, we propose a general class-Balanced Multicentric Dynamic prototype (BMD) strategy for the SFDA task. Specifically, for each target category, we first introduce a global inter-class balanced sampling strategy to aggregate potential representative target samples. Then, we design an intra-class multicentric clustering strategy to achieve more robust and representative prototypes generation. In contrast to existing strategies that update the pseudo label at a fixed training period, we further introduce a dynamic pseudo labeling strategy to incorporate network update information during model adaptation. Extensive experiments show that the proposed model-agnostic BMD strategy significantly improves representative SFDA methods to yield new state-of-the-art results. The code is available at https://github.com/ispc-lab/BMD.

cs.CV↗

arXiv2022

The Lottery Ticket Hypothesis for Self-attention in Convolutional Neural Network

Recently many plug-and-play self-attention modules (SAMs) are proposed to enhance the model generalization by exploiting the internal information of deep convolutional neural networks (CNNs). In general, previous works ignore where to plug in the SAMs since they connect the SAMs individually with each block of the entire CNN backbone for granted, leading to incremental computational cost and the number of parameters with the growth of network depth. However, we empirically find and verify some counterintuitive phenomena that: (a) Connecting the SAMs to all the blocks may not always bring the largest performance boost, and connecting to partial blocks would be even better; (b) Adding the SAMs to a CNN may not always bring a performance boost, and instead it may even harm the performance of the original CNN backbone. Therefore, we articulate and demonstrate the Lottery Ticket Hypothesis for Self-attention Networks: a full self-attention network contains a subnetwork with sparse self-attention connections that can (1) accelerate inference, (2) reduce extra parameter increment, and (3) maintain accuracy. In addition to the empirical evidence, this hypothesis is also supported by our theoretical evidence. Furthermore, we propose a simple yet effective reinforcement-learning-based method to search the ticket, i.e., the connection scheme that satisfies the three above-mentioned conditions. Extensive experiments on widely-used benchmark datasets and popular self-attention networks show the effectiveness of our method. Besides, our experiments illustrate that our searched ticket has the capacity of transferring to some vision tasks, e.g., crowd counting and segmentation.

cs.CV↗

arXiv2022

The $Z_{cs}$ states and the mixture of hadronic molecule and diquark-anti-diquark components within effective field theory

In this work, we construct the Lagrangian describing meson-diquark interaction, such that the diquark-anti-diquark component as well as the molecular component is introduced when studying the $Z_{cs}$ states. In this way, the problem is solved that if only considering the $\bar{D}^{(*)}D_s^{(*)}$ components, the potentials are suppressed by OZI rule. Through solving the Bethe-Salpeter equation, we find that the $Z_{cs}(4000)^+$ can be explained as the mixture of $\bar{D}^{*0}D_s^+$ and $\bar{A}_{cs}S_{cu}$ components. Besides, for the $\bar{D}^{*0}D_s^{*+}/\bar{A}_{cs}A_{cu}$ system, the pole of $4208\pm 13i$ MeV on the second Riemann sheet is predicted, whose mass agrees with that of $Z_{cs}(4220)^+$ while the width is much smaller than $Z_{cs}(4220)^+$. Due to the large error of the $Z_{cs}(4220)^+$'s width, further measurements are expected. In addition, several other poles of different spins are predicted.

hep-ph↗