arXiv subjects

Bin Wu

Publications and source records attributed to Bin Wu.

At least 127 records · Page 7Linked to original sources

arXiv2024

A Comprehensive Review of Propagation Models in Complex Networks: From Deterministic to Deep Learning Approaches

Understanding propagation mechanisms in complex networks is essential for fields like epidemiology and multi-robot networks. This paper reviews various propagation models, from traditional deterministic frameworks to advanced data-driven and deep learning approaches. We differentiate between static and dynamic networks, noting that static models provide foundational insights, while dynamic models capture real-world temporal changes. Deterministic models like the SIR framework offer clear mathematical insights but often lack adaptability to randomness, whereas stochastic models enhance realism at the cost of interpretability. Behavior-based models focus on individual decision-making, demanding more computational resources. Data-driven approaches improve accuracy in nonlinear scenarios by adapting to evolving networks, using either traditional models or model-free machine learning techniques. We explore supervised and unsupervised learning methods, as well as reinforcement learning, which operates without predefined datasets. The application of graph neural networks (GNNs) is also discussed, highlighting their effectiveness in modeling propagation in complex networks. The paper underscores key applications and challenges associated with each model type, emphasizing the increasing importance of hybrid and machine learning-based solutions in contemporary network propagation issues.

cs.SI↗

arXiv2024

Instruction Tuning With Loss Over Instructions

Instruction tuning plays a crucial role in shaping the outputs of language models (LMs) to desired styles. In this work, we propose a simple yet effective method, Instruction Modelling (IM), which trains LMs by applying a loss function to the instruction and prompt part rather than solely to the output part. Through experiments across 21 diverse benchmarks, we show that, in many scenarios, IM can effectively improve the LM performance on both NLP tasks (e.g., MMLU, TruthfulQA, and HumanEval) and open-ended generation benchmarks (e.g., MT-Bench and AlpacaEval). Remarkably, in the most advantageous case, IM boosts model performance on AlpacaEval 1.0 by over 100%. We identify two key factors influencing the effectiveness of IM: (1) The ratio between instruction length and output length in the training data; and (2) The number of training examples. We observe that IM is especially beneficial when trained on datasets with lengthy instructions paired with brief outputs, or under the Superficial Alignment Hypothesis (SAH) where a small amount of training examples are used for instruction tuning. Further analysis substantiates our hypothesis that our improvement can be attributed to reduced overfitting to instruction tuning datasets. It is worth noting that we are not proposing \ours as a replacement for current fine-tuning processes. Instead, our work aims to provide practical guidance for instruction tuning LMs, especially in low-resource scenarios.

cs.CL↗

arXiv2024

Experimental demonstration of frequency downconverted arm length stabilization for a future upgraded gravitational wave detector

Ground-based laser interferometric gravitational wave detectors consist of complex multiple optical cavity systems. An arm-length stabilization (ALS) system has played an important role in bringing such complex detector into operational state and enhance the duty cycle. The sensitivity of these detectors can be improved if the thermal noise of their test mass mirror coatings is reduced. Crystalline AlGaAs coatings are a promising candidate for this. However, traditional ALS system with frequency-doubled 532 nm light is no longer an option with AlGaAs coatings due to the narrow bandgap of GaAs, thus alternative locking schemes must be developed. In this letter, we describe an experimental demonstration of a novel ALS scheme which is compatible with AlGaAs coatings. This ALS scheme will enable the use of AlGaAs coatings and contribute to improved sensitivity of future detectors.

physics.optics↗

arXiv2024

Deep Reinforcement Learning for Decentralized Multi-Robot Control: A DQN Approach to Robustness and Information Integration

The superiority of Multi-Robot Systems (MRS) in various complex environments is unquestionable. However, in complex situations such as search and rescue, environmental monitoring, and automated production, robots are often required to work collaboratively without a central control unit. This necessitates an efficient and robust decentralized control mechanism to process local information and guide the robots' behavior. In this work, we propose a new decentralized controller design method that utilizes the Deep Q-Network (DQN) algorithm from deep reinforcement learning, aimed at improving the integration of local information and robustness of multi-robot systems. The designed controller allows each robot to make decisions independently based on its local observations while enhancing the overall system's collaborative efficiency and adaptability to dynamic environments through a shared learning mechanism. Through testing in simulated environments, we have demonstrated the effectiveness of this controller in improving task execution efficiency, strengthening system fault tolerance, and enhancing adaptability to the environment. Furthermore, we explored the impact of DQN parameter tuning on system performance, providing insights for further optimization of the controller design. Our research not only showcases the potential application of the DQN algorithm in the decentralized control of multi-robot systems but also offers a new perspective on how to enhance the overall performance and robustness of the system through the integration of local information.

cs.RO↗

arXiv2024

State-of-the-art in Robot Learning for Multi-Robot Collaboration: A Comprehensive Survey

With the continuous breakthroughs in core technology, the dawn of large-scale integration of robotic systems into daily human life is on the horizon. Multi-robot systems (MRS) built on this foundation are undergoing drastic evolution. The fusion of artificial intelligence technology with robot hardware is seeing broad application possibilities for MRS. This article surveys the state-of-the-art of robot learning in the context of Multi-Robot Cooperation (MRC) of recent. Commonly adopted robot learning methods (or frameworks) that are inspired by humans and animals are reviewed and their advantages and disadvantages are discussed along with the associated technical challenges. The potential trends of robot learning and MRS integration exploiting the merging of these methods with real-world applications is also discussed at length. Specifically statistical methods are used to quantitatively corroborate the ideas elaborated in the article.

cs.RO↗

arXiv2024

Cold nuclear matter effects on azimuthal decorrelation in heavy-ion collisions

The assumption of factorization lies at the core of calculations of medium effects on observables computable in perturbative Quantum Chromodynamics. In this work we examine this assumption, for which we propose a setup to study hard processes and bulk nuclear matter in heavy-ion collisions on the same footing using the Glauber modelling of heavy nuclei. To exemplify this approach, we calculate the leading-order corrections to azimuthal decorrelation in Drell-Yan and boson-jet processes due to cold nuclear matter effects, not considering radiation. At leading order in both the hard momentum scale and the nuclear size, the impact-parameter dependent cross section is found to factorize for both processes. The factorization formula involves a convolution of the hard cross section with the medium-modified parton distributions, and, for boson-jet production, the medium-modified jet function.

hep-ph↗

arXiv2024

Quantum computation in fermionic thermal field theories

Thermal properties of quantum fields at finite temperature are crucial to understanding strongly interacting matter and recent development in quantum computing has provided an alternative and promising avenue of study. In this work, we study thermal field theories involving only fermions using quantum algorithms. We first delve into the presentations of fermion fields via qubits on digital quantum computers alongside the quantum algorithms such as quantum imaginary time evolutions employed to evaluate thermal properties of generic quantum field theories. Specifically, we show numerical results such as the thermal distribution and the energy density of thermal field theories for Majorana fermions in 1+1 dimensions using quantum simulators. In addition to free field theory, we also study the effects of interactions resulting from coupling with a spatially homogeneous Majorana field. In both cases, we show analytically that thermal properties of the system can be described using phase-space distributions, and the quantum simulation results agree with analytical and semiclassical expectations. Our work is an important step to understand thermal fixed points, preparing for quantum simulation of thermalization in real time.

hep-ph↗

arXiv2024

Understanding the Role of User Profile in the Personalization of Large Language Models

Utilizing user profiles to personalize Large Language Models (LLMs) has been shown to enhance the performance on a wide range of tasks. However, the precise role of user profiles and their effect mechanism on LLMs remains unclear. This study first confirms that the effectiveness of user profiles is primarily due to personalization information rather than semantic information. Furthermore, we investigate how user profiles affect the personalization of LLMs. Within the user profile, we reveal that it is the historical personalized response produced or approved by users that plays a pivotal role in personalizing LLMs. This discovery unlocks the potential of LLMs to incorporate a greater number of user profiles within the constraints of limited input length. As for the position of user profiles, we observe that user profiles integrated into different positions of the input context do not contribute equally to personalization. Instead, where the user profile that is closer to the beginning affects more on the personalization of LLMs. Our findings reveal the role of user profiles for the personalization of LLMs, and showcase how incorporating user profiles impacts performance providing insight to leverage user profiles effectively.

cs.CL↗

arXiv2024

DLP: towards active defense against backdoor attacks with decoupled learning process

Deep learning models are well known to be susceptible to backdoor attack, where the attacker only needs to provide a tampered dataset on which the triggers are injected. Models trained on the dataset will passively implant the backdoor, and triggers on the input can mislead the models during testing. Our study shows that the model shows different learning behaviors in clean and poisoned subsets during training. Based on this observation, we propose a general training pipeline to defend against backdoor attacks actively. Benign models can be trained from the unreliable dataset by decoupling the learning process into three stages, i.e., supervised learning, active unlearning, and active semi-supervised fine-tuning. The effectiveness of our approach has been shown in numerous experiments across various backdoor attacks and datasets.

cs.CR↗

arXiv2024

NBA: defensive distillation for backdoor removal via neural behavior alignment

Recently, deep neural networks have been shown to be vulnerable to backdoor attacks. A backdoor is inserted into neural networks via this attack paradigm, thus compromising the integrity of the network. As soon as an attacker presents a trigger during the testing phase, the backdoor in the model is activated, allowing the network to make specific wrong predictions. It is extremely important to defend against backdoor attacks since they are very stealthy and dangerous. In this paper, we propose a novel defense mechanism, Neural Behavioral Alignment (NBA), for backdoor removal. NBA optimizes the distillation process in terms of knowledge form and distillation samples to improve defense performance according to the characteristics of backdoor defense. NBA builds high-level representations of neural behavior within networks in order to facilitate the transfer of knowledge. Additionally, NBA crafts pseudo samples to induce student models exhibit backdoor neural behavior. By aligning the backdoor neural behavior from the student network with the benign neural behavior from the teacher network, NBA enables the proactive removal of backdoors. Extensive experiments show that NBA can effectively defend against six different backdoor attacks and outperform five state-of-the-art defenses.

cs.CR↗

arXiv2024

Systematic analysis of the form factors of $B_c\rightarrowη_c$, $J/ψ$ and corresponding weak decays

The form factors of $B_c\rightarrowη_c$ and $B_c\rightarrow J/ψ$ are analyzed in the framework of three-point QCD sum rules. In these analyses, the contributions of the vacuum condensate terms $\langle g_{s}^{2}GG\rangle$ and $\langle g_{s}^{3}GGGf\rangle$ are considered. In addition, the decay widths and branching ratios of several decay channels are obtained by using the calculated form factors. These decay processes include the nonleptonic decays of $B_c^- \to η_c π^-$, $η_c K^-$, $η_c ρ^-$, $η_c K^{*-}$, $B_c^- \to J/ψπ^-$, $J/ψK^-$, $J/ψρ^-$, $J/ψK^{*-}$, and the semileptonic decays of $B_c^- \to η_c \mathcal{l} \barν$, $B_c^- \to J/ψ\mathcal{l} \barν$. These results about the form factors and decay properties of $B_c$ meson provide useful information for us to study the heavy-quark dynamics and find new physics(NP) beyond Standard Model(SM).

hep-ph↗

arXiv2024

Quark production and thermalization of the quark-gluon plasma

We first assemble a full set of the Boltzmann Equation in Diffusion Approximation (BEDA) for studying thermalization/hydrodynamization as well as the production of massless quarks and antiquarks in out of equilibrium systems. In the BEDA, the time evolution of a generic system is characterized by the following space-time dependent quantities: the jet quenching parameter, the effective temperature, and two more for each quark flavor that describe the conversion between gluons and quarks/antiquarks via the $2\leftrightarrow2$ processes. Out of the latter two quantities, an effective net quark chemical potential is defined, which equals the net quark chemical potential after thermal equilibration. We then study thermalization and the production of three flavors of massless quarks and antiquarks in spatially homogeneous systems initially filled only with gluons. A parametric understanding of thermalization and quark production is obtained for either initially very dense or dilute systems, which are complemented by detailed numerical simulations for intermediate values of initial gluon occupancy $f_0$. For a wide range of $f_0$, the final equilibration time is determined to be about one order of magnitude longer than that in the corresponding pure gluon systems. Moreover, during the final stage of the thermalization process for $f_0\geq 10^{-4}$, gluons are found to thermalize earlier than quarks and antiquarks, undergoing the top-down thermalization.

hep-ph↗

arXiv2024

A tale of two emergent games: opinion dynamics in dynamical directed networks

Uni-directional social interactions are ubiquitous in real social networks whereas undirected interactions are intensively studied. We establish a voter model in a dynamical directed network. We analytically obtain the degree distribution of the evolving network at any given time. Furthermore, we find that the average degree is captured by an emergent game. On the other hand, we find that the fate of opinions is captured by another emergent game. Beyond expectation, the two emergent games are typically different due to the unidirectionality of the evolving networks. The Nash equilibrium analysis of the two games facilitates us to give the criterion under which the minority opinion with few disciples initially takes over the population eventually for in-group bias. Our work fosters the understanding of opinion dynamics ranging from methodology to research content.

physics.soc-ph↗

arXiv2024

Carleman estimates for space semi-discrete approximations of one-dimensional stochastic parabolic equation and its applications

In this paper, we study discrete Carleman estimates for space semi-discrete approximations of one-dimensional stochastic parabolic equation. As applications of these discrete Carleman estimates, we apply them to study two inverse problems for the spatial semi-discrete stochastic parabolic equations, including a discrete inverse random source problem and a discrete Cauchy problem. We firstly establish two Carleman estimates for a one-dimensional semi-discrete stochastic parabolic equation, one for homogeneous boundary and the other for non-homogeneous boundary. Then we apply these two estimates separately to derive two stability results. The first one is the Lipschitz stability for the discrete inverse random source problem. The second one is the Hölder stability for the discrete Cauchy problem.

math.PR↗

arXiv2024

Sagnac-type neutron displacement-noise-free interferometeric gravitational-wave detector

The detection of low-frequency gravitational waves on Earth requires the reduction of displacement noise, which dominates the low-frequency band. One method to cancel test mass displacement noise is a neutron displacement-noise-free interferometer (DFI). This paper proposes a new neutron DFI configuration, a Sagnac-type neutron DFI, which uses a Sagnac interferometer in place of the Mach-Zehnder interferometer. We demonstrate that a sensitivity of the Sagnac-type neutron DFI is higher than that of a conventional neutron DFI with the same interferometer scale. This configuration is particularly significant for neutron DFIs with limited space for construction and limited flux from available neutron sources.

gr-qc↗

arXiv2024

Opinion dynamics on biased dynamical networks: beyond rare opinion updating

Opinion dynamics is of paramount importance as it provides insights into the complex dynamics of opinion propagation and social relationship adjustment. It is assumed in most of the previous works that social relationships evolve much faster than opinions. This is not always true in reality. We propose an analytical approximation to study this issue for arbitrary time scales between opinion adjustment and network evolution. To this end, the coefficient of determination in statistics is introduced and a one-dimensional stable manifold is analytically found, i.e., the most likely trajectory. With the aid of the stable manifold, we further obtain the fate of opinions and the consensus time, i.e., fixation probability and fixation time. We find that for in-group bias, the more likely individuals are to adopt the popular opinion, the less likely the majority opinion takes over the population, i.e., conformity inhibits the domination of popular opinions. This counter-intuitive result can be interpreted from a game perspective, in which in-group bias refers to a coordination game and rewiring probability refers to a rescaling of the selection intensity. Our work proposes an efficient approximation method to foster the understanding of opinion dynamics in dynamical networks.

physics.soc-ph↗

arXiv2024

AC-EVAL: Evaluating Ancient Chinese Language Understanding in Large Language Models

Given the importance of ancient Chinese in capturing the essence of rich historical and cultural heritage, the rapid advancements in Large Language Models (LLMs) necessitate benchmarks that can effectively evaluate their understanding of ancient contexts. To meet this need, we present AC-EVAL, an innovative benchmark designed to assess the advanced knowledge and reasoning capabilities of LLMs within the context of ancient Chinese. AC-EVAL is structured across three levels of difficulty reflecting different facets of language comprehension: general historical knowledge, short text understanding, and long text comprehension. The benchmark comprises 13 tasks, spanning historical facts, geography, social customs, art, philosophy, classical poetry and prose, providing a comprehensive assessment framework. Our extensive evaluation of top-performing LLMs, tailored for both English and Chinese, reveals a substantial potential for enhancing ancient text comprehension. By highlighting the strengths and weaknesses of LLMs, AC-EVAL aims to promote their development and application forward in the realms of ancient Chinese language education and scholarly research. The AC-EVAL data and evaluation code are available at https://github.com/yuting-wei/AC-EVAL.

cs.CL↗

arXiv2024

Analysis of the electromagnetic form factors and the radiative decays of the vector heavy-light mesons

In this article, we analyze the electromagnetic form factors of the vector heavy-light mesons to the pseudoscalar heavy-light mesons in the framework of three-point QCD sum rules, where the contributions of vacuum condensate terms $\langle\overline{q}q\rangle$, $\langle\overline{q}g_{s}σGq\rangle$, $\langle g_{s}^{2}G^{2}\rangle$, $\langle f^{3}G^{3}\rangle$ and $\langle\overline{q}q\rangle\langle g_{s}^{2}G^{2}\rangle$ are considered. With these results, we also obtain the radiative decay widths of the vector heavy-light mesons and then compare our results with those of other collaboration's. The final results about the radiative decay widths are $Γ(D^{*0}\to D^{0}γ)=1.74^{+0.40}_{-0.37}$ keV, $Γ(D^{*+}\to D^{+}γ)=0.17^{+0.08}_{-0.07}$ keV, $Γ(D_{s}^{*}\to D_{s}γ)=0.029^{+0.009}_{-0.008}$ keV, $Γ(B^{*0}\to B^{0}γ)=0.018^{+0.006}_{-0.005}$ keV, $Γ(B^{*+}\to B^{+}γ)=0.015^{+0.007}_{-0.007}$ keV and $Γ(B^{*}_{s}\to B_{s}γ)=0.016^{+0.003}_{-0.005}$ keV.

hep-ph↗