arXiv subjects

Zhen Wang

Publications and source records attributed to Zhen Wang.

At least 289 records · Page 16Linked to original sources

arXiv2024

Multi-Agent, Human-Agent and Beyond: A Survey on Cooperation in Social Dilemmas

The study of cooperation within social dilemmas has long been a fundamental topic across various disciplines, including computer science and social science. Recent advancements in Artificial Intelligence (AI) have significantly reshaped this field, offering fresh insights into understanding and enhancing cooperation. This survey examines three key areas at the intersection of AI and cooperation in social dilemmas. First, focusing on multi-agent cooperation, we review the intrinsic and external motivations that support cooperation among rational agents, and the methods employed to develop effective strategies against diverse opponents. Second, looking into human-agent cooperation, we discuss the current AI algorithms for cooperating with humans and the human biases towards AI agents. Third, we review the emergent field of leveraging AI agents to enhance cooperation among humans. We conclude by discussing future research avenues, such as using large language models, establishing unified theoretical frameworks, revisiting existing theories of human cooperation, and exploring multiple real-world applications.

cs.AI↗

arXiv2024

Pavement Fatigue Crack Detection and Severity Classification Based on Convolutional Neural Network

Due to the varying intensity of pavement cracks, the complexity of topological structure, and the noise of texture background, image classification for asphalt pavement cracking has proven to be a challenging problem. Fatigue cracking, also known as alligator cracking, is one of the common distresses of asphalt pavement. It is thus important to detect and monitor the condition of alligator cracking on roadway pavements. Most research in this area has typically focused on pixel-level detection of cracking using limited datasets. A novel deep convolutional neural network that can achieve two objectives is proposed. The first objective of the proposed neural network is to classify presence of fatigue cracking based on pavement surface images. The second objective is to classify the fatigue cracking severity level based on the Distress Identification Manual (DIM) standard. In this paper, a databank of 4484 high-resolution pavement surface images is established in which images are taken locally in the Town of Blacksburg, Virginia, USA. In the data pre-preparation, over 4000 images are labeled into 4 categories manually according to DIM standards. A four-layer convolutional neural network model is then built to achieve the goal of classification of images by pavement crack severity category. The trained model reached the highest accuracy among all existing methods. After only 30 epochs of training, the model achieved a crack existence classification accuracy of 96.23% and a severity level classification accuracy of 96.74%. After 20 epochs of training, the model achieved a pavement marking presence classification accuracy of 97.64%.

cs.CV↗

arXiv2024

Asymmetric interaction preference induces cooperation in human-agent hybrid game

With the development of artificial intelligence, human beings are increasingly interested in human-agent collaboration, which generates a series of problems about the relationship between agents and humans, such as trust and cooperation. This inevitably induces the inherent human characteristic that there are subjective interaction preferences for different groups, especially in human-agent hybrid systems where human-human interaction, agent-agent interaction, and human-agent interaction coexist. However, understanding how individual interaction preferences affect the cooperation of the system remains a major challenge. Therefore, this paper proposes a human-agent hybrid prisoner's dilemma game system under the framework of evolutionary game. In spatial networks, the most significant difference between agents and humans is the flexibility of decision, where humans have higher adaptive capabilities, follow link dynamics, and adopt free decision rules, which enable them to choose different strategies for different neighbors. However, agents follow node dynamics and adopt consistent decision rules, applying the same strategy to different neighbors. We give the subjective preferences of any individual to different groups, involving the interaction preferences between homogeneous groups and heterogeneous groups respectively. The simulation results show that both human and agent have asymmetric interaction preferences for groups with different identities, which can significantly improve the cooperative behavior of the system. In the hybrid system, human groups show more stable prosocial behavior. Agent groups can form highly cooperative clusters under the condition of strong interaction preference for human groups. In addition, giving agents the ability to identify opponents can effectively alleviate the interaction dilemma of agents.

physics.soc-ph↗

arXiv2024

Improved Nonlocality Certification via Bouncing between Bell Operators and Inequalities

Bell nonlocality is an intrinsic feature of quantum mechanics, which can be certified via the violation of Bell inequalities. It is therefore a fundamental question to certify Bell nonlocality from experimental data. Here, we present an optimization scheme to improve nonlocality certification by exploring flexible mappings between Bell inequalities and Hamiltonians corresponding to the Bell operators. We show that several Hamiltonian models can be mapped to new inequalities with improved classical bounds than the original one, enabling a more robust detection of nonlocality. From the other direction, we investigate the mapping from fixed Bell inequalities to Hamiltonians, aiming to maximize quantum violations while considering experimental imperfections. As a practical demonstration, we apply this method to an XXZ-like honeycomb-lattice model utilizing over 70 superconducting qubits. The successful application of this technique, as well as combining the two directions to form an optimization loop, may open new avenues for developing more practical and noise-resilient nonlocality certification techniques and enable broader experimental explorations.

quant-ph↗

arXiv2024

Control of the Power Flows of a Stochastic Power System

How to determine the vector of power supplies of a stochastic power system for the next short horizon, such that the probability is less than a prespecified value that any phase-angle difference of a power line of the power network exits from a safe set? The power system is modelled such that the differential equation of each frequency is affected by a Brownian motion process. A safe set can be selected to be any subset of the interval $(-π/2, ~ +π/2)$, which is a sufficient condition for not losing synchronization. That the controlled system has an improved performance is shown by numerical results of three academic examples including a particular eight-node academic network, a twelve-node ring network, and a Manhattan-grid network.

eess.SY↗

arXiv2024

A Survey on Deep Active Learning: Recent Advances and New Frontiers

Active learning seeks to achieve strong performance with fewer training samples. It does this by iteratively asking an oracle to label new selected samples in a human-in-the-loop manner. This technique has gained increasing popularity due to its broad applicability, yet its survey papers, especially for deep learning-based active learning (DAL), remain scarce. Therefore, we conduct an advanced and comprehensive survey on DAL. We first introduce reviewed paper collection and filtering. Second, we formally define the DAL task and summarize the most influential baselines and widely used datasets. Third, we systematically provide a taxonomy of DAL methods from five perspectives, including annotation types, query strategies, deep model architectures, learning paradigms, and training processes, and objectively analyze their strengths and weaknesses. Then, we comprehensively summarize main applications of DAL in Natural Language Processing (NLP), Computer Vision (CV), and Data Mining (DM), etc. Finally, we discuss challenges and perspectives after a detailed analysis of current studies. This work aims to serve as a useful and quick guide for researchers in overcoming difficulties in DAL. We hope that this survey will spur further progress in this burgeoning field.

cs.LG↗

arXiv2024

TDML -- A Trustworthy Distributed Machine Learning Framework

Recent years have witnessed a surge in deep learning research, marked by the introduction of expansive generative models like OpenAI's SORA and GPT, Meta AI's LLAMA series, and Google's FLAN, BART, and Gemini models. However, the rapid advancement of large models (LM) has intensified the demand for computing resources, particularly GPUs, which are crucial for their parallel processing capabilities. This demand is exacerbated by limited GPU availability due to supply chain delays and monopolistic acquisition by major tech firms. Distributed Machine Learning (DML) methods, such as Federated Learning (FL), mitigate these challenges by partitioning data and models across multiple servers, though implementing optimizations like tensor and pipeline parallelism remains complex. Blockchain technology emerges as a promising solution, ensuring data integrity, scalability, and trust in distributed computing environments, but still lacks guidance on building practical DML systems. In this paper, we propose a \textit{trustworthy distributed machine learning} (TDML) framework that leverages blockchain to coordinate remote trainers and validate workloads, achieving privacy, transparency, and efficient model training across public remote computing resources. Experimental validation demonstrates TDML's efficacy in overcoming performance limitations and malicious node detection, positioning it as a robust solution for scalable and secure distributed machine learning.

cs.CR↗

arXiv2024

Foundations and Frontiers of Graph Learning Theory

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations, have become a popular paradigm. With these models being usually characterized by intuition-driven design or highly intricate components, placing them within the theoretical analysis framework to distill the core concepts, helps understand the key principles that drive the functionality better and guide further development. Given this surge in interest, this article provides a comprehensive summary of the theoretical foundations and breakthroughs concerning the approximation and learning behaviors intrinsic to prevalent graph learning models. Encompassing discussions on fundamental aspects such as expressiveness power, generalization, optimization, and unique phenomena such as over-smoothing and over-squashing, this piece delves into the theoretical foundations and frontier driving the evolution of graph learning. In addition, this article also presents several challenges and further initiates discussions on possible solutions.

cs.LG↗

arXiv2024

Uni-Mol2: Exploring Molecular Pretraining Model at Scale

In recent years, pretraining models have made significant advancements in the fields of natural language processing (NLP), computer vision (CV), and life sciences. The significant advancements in NLP and CV are predominantly driven by the expansion of model parameters and data size, a phenomenon now recognized as the scaling laws. However, research exploring scaling law in molecular pretraining models remains unexplored. In this work, we present Uni-Mol2 , an innovative molecular pretraining model that leverages a two-track transformer to effectively integrate features at the atomic level, graph level, and geometry structure level. Along with this, we systematically investigate the scaling law within molecular pretraining models, characterizing the power-law correlations between validation loss and model size, dataset size, and computational resources. Consequently, we successfully scale Uni-Mol2 to 1.1 billion parameters through pretraining on 800 million conformations, making it the largest molecular pretraining model to date. Extensive experiments show consistent improvement in the downstream tasks as the model size grows. The Uni-Mol2 with 1.1B parameters also outperforms existing methods, achieving an average 27% improvement on the QM9 and 14% on COMPAS-1D dataset.

cs.LG↗

arXiv2024

High-sensitivity multichannel zero-to-ultralow field NMR with atomic magnetometer arrays

Despite its versatility and high chemical specificity, conventional NMR spectroscopy is limited in measurement throughput due to the need for high-homogeneity magnetic fields, necessitating sequential sample analysis, and bulky devices. Here, we propose a multichannel NMR device that overcomes these limitations that leverages the zero-to-ultralow field (ZULF) regime, where simultaneous detection of multiple samples is carried out via an array of compact optically pumped magnetometers (OPMs). A magnetic field is used only for pre-polarization, permitting the use of large-bore, high-field, inhomogeneous magnets that can accommodate many samples concurrently. Through systematic advances, we demonstrate high-sensitivity, high resolution ZULF NMR spectroscopy with sensitivity comparable to benchtop NMR systems. The spectroscopy remains robust without the need for field shimming for periods on the order of weeks. We show the detection of ZULF NMR signals from organic molecules without isotopic enrichment, and demonstrate the parallelized detection of three distinct samples simultaneously as a proof-of-concept, with the potential to scale further to over 100 channels at a cost comparable to high-resolution liquid state NMR systems. This work sets the stage for using multichannel "NMR camera" devices for inline reaction monitoring, robotic chemistry, quality control, and high-throughput assays.

physics.ins-det↗

arXiv2024

Probing many-body Bell correlation depth with superconducting qubits

Quantum nonlocality describes a stronger form of quantum correlation than that of entanglement. It refutes Einstein's belief of local realism and is among the most distinctive and enigmatic features of quantum mechanics. It is a crucial resource for achieving quantum advantages in a variety of practical applications, ranging from cryptography and certified random number generation via self-testing to machine learning. Nevertheless, the detection of nonlocality, especially in quantum many-body systems, is notoriously challenging. Here, we report an experimental certification of genuine multipartite Bell correlations, which signal nonlocality in quantum many-body systems, up to 24 qubits with a fully programmable superconducting quantum processor. In particular, we employ energy as a Bell correlation witness and variationally decrease the energy of a many-body system across a hierarchy of thresholds, below which an increasing Bell correlation depth can be certified from experimental data. As an illustrating example, we variationally prepare the low-energy state of a two-dimensional honeycomb model with 73 qubits and certify its Bell correlations by measuring an energy that surpasses the corresponding classical bound with up to 48 standard deviations. In addition, we variationally prepare a sequence of low-energy states and certify their genuine multipartite Bell correlations up to 24 qubits via energies measured efficiently by parity oscillation and multiple quantum coherence techniques. Our results establish a viable approach for preparing and certifying multipartite Bell correlations, which provide not only a finer benchmark beyond entanglement for quantum devices, but also a valuable guide towards exploiting multipartite Bell correlation in a wide spectrum of practical applications.

quant-ph↗

arXiv2024

FreeTuner: Any Subject in Any Style with Training-free Diffusion

With the advance of diffusion models, various personalized image generation methods have been proposed. However, almost all existing work only focuses on either subject-driven or style-driven personalization. Meanwhile, state-of-the-art methods face several challenges in realizing compositional personalization, i.e., composing different subject and style concepts, such as concept disentanglement, unified reconstruction paradigm, and insufficient training data. To address these issues, we introduce FreeTuner, a flexible and training-free method for compositional personalization that can generate any user-provided subject in any user-provided style (see Figure 1). Our approach employs a disentanglement strategy that separates the generation process into two stages to effectively mitigate concept entanglement. FreeTuner leverages the intermediate features within the diffusion model for subject concept representation and introduces style guidance to align the synthesized images with the style concept, ensuring the preservation of both the subject's structure and the style's aesthetic features. Extensive experiments have demonstrated the generation ability of FreeTuner across various personalization settings.

cs.CV↗

arXiv2024

Design and test for the CEPC muon subdetector based on extruded scintillator and SiPM

A combination of scintillator, wavelength shifting (WLS) fiber, and silicon photomultiplier (SiPM) shows an excellent performance in the `$K_{L}$ and $μ$ detector (KLM)' of the Belle II experiment. In this study, we present the R&D efforts for a similar detection technology utilizing a new scintillator and SiPM. This technology can be applied to a muon detector for the proposed CEPC experiment. The R&D encompasses the investigation of the performance of a new 150 cm-long scintillator, the NDL SiPM with a sensitive surface of $\times$ 3 mm, or the Hamamatsu MPPC with a sensitive surface of 1.3 mm $\times$ 1.3 mm. Additionally, it includes the construction of a detector strip and the methods employed to achieve excellent light collection. Cosmic ray tests reveal efficient photon collections by NDL SiPM or MPPC, with efficiencies well above 90% using a threshold of 8 p.e.. The time resolutions for hits at the far end of a scintillator strip are better than 1.7 ns. The observed performance lays the foundation for advancing R&D including prototype modules aiming for reference Technical Design Report of CEPC detector recently.

physics.ins-det↗

arXiv2024

Probing configuration of $α$ clusters with spectator particles in relativistic heavy-ion collisions

We propose to use spectator particle yield ratios to probe the configuration of $α$ clusters in $^{12}$C and $^{16}$O by their collisions at RHIC and LHC energies. The idea is illustrated based on initial density distributions with various $α$-cluster configurations generated by a microscopic cluster model, and without $α$ clusters from mean-field calculations. The multifragmentation of the spectator matter produces more spectator light nuclei including $α$ clusters in collisions of nuclei with chain structure of $α$ clusters, compared to those of nuclei with a more compact structure. The yield ratio of free spectator neutrons to spectator particles with mass-to-charge ratio $A/Z=2$ scaled by their masses can be practically measured by the zero-degree calorimeter (ZDC) at RHIC and LHC, serving as a clean probe free from modeling the complicated dynamics at midrapidities.

nucl-th↗

arXiv2024

Revisiting Plasticity in Visual Reinforcement Learning: Data, Modules and Training Stages

Plasticity, the ability of a neural network to evolve with new data, is crucial for high-performance and sample-efficient visual reinforcement learning (VRL). Although methods like resetting and regularization can potentially mitigate plasticity loss, the influences of various components within the VRL framework on the agent's plasticity are still poorly understood. In this work, we conduct a systematic empirical exploration focusing on three primary underexplored facets and derive the following insightful conclusions: (1) data augmentation is essential in maintaining plasticity; (2) the critic's plasticity loss serves as the principal bottleneck impeding efficient training; and (3) without timely intervention to recover critic's plasticity in the early stages, its loss becomes catastrophic. These insights suggest a novel strategy to address the high replay ratio (RR) dilemma, where exacerbated plasticity loss hinders the potential improvements of sample efficiency brought by increased reuse frequency. Rather than setting a static RR for the entire training process, we propose Adaptive RR, which dynamically adjusts the RR based on the critic's plasticity level. Extensive evaluations indicate that Adaptive RR not only avoids catastrophic plasticity loss in the early stages but also benefits from more frequent reuse in later phases, resulting in superior sample efficiency.

cs.LG↗

arXiv2024

MaskFuser: Masked Fusion of Joint Multi-Modal Tokenization for End-to-End Autonomous Driving

Current multi-modality driving frameworks normally fuse representation by utilizing attention between single-modality branches. However, the existing networks still suppress the driving performance as the Image and LiDAR branches are independent and lack a unified observation representation. Thus, this paper proposes MaskFuser, which tokenizes various modalities into a unified semantic feature space and provides a joint representation for further behavior cloning in driving contexts. Given the unified token representation, MaskFuser is the first work to introduce cross-modality masked auto-encoder training. The masked training enhances the fusion representation by reconstruction on masked tokens. Architecturally, a hybrid-fusion network is proposed to combine advantages from both early and late fusion: For the early fusion stage, modalities are fused by performing monotonic-to-BEV translation attention between branches; Late fusion is performed by tokenizing various modalities into a unified token space with shared encoding on it. MaskFuser respectively reaches a driving score of 49.05 and route completion of 92.85% on the CARLA LongSet6 benchmark evaluation, which improves the best of previous baselines by 1.74 and 3.21%. The introduced masked fusion increases driving stability under damaged sensory inputs. MaskFuser outperforms the best of previous baselines on driving score by 6.55 (27.8%), 1.53 (13.8%), 1.57 (30.9%), respectively given sensory masking ratios 25%, 50%, and 75%.

cs.CV↗

arXiv2024

Ensemble Successor Representations for Task Generalization in Offline-to-Online Reinforcement Learning

In Reinforcement Learning (RL), training a policy from scratch with online experiences can be inefficient because of the difficulties in exploration. Recently, offline RL provides a promising solution by giving an initialized offline policy, which can be refined through online interactions. However, existing approaches primarily perform offline and online learning in the same task, without considering the task generalization problem in offline-to-online adaptation. In real-world applications, it is common that we only have an offline dataset from a specific task while aiming for fast online-adaptation for several tasks. To address this problem, our work builds upon the investigation of successor representations for task generalization in online RL and extends the framework to incorporate offline-to-online learning. We demonstrate that the conventional paradigm using successor features cannot effectively utilize offline data and improve the performance for the new task by online fine-tuning. To mitigate this, we introduce a novel methodology that leverages offline data to acquire an ensemble of successor representations and subsequently constructs ensemble Q functions. This approach enables robust representation learning from datasets with different coverage and facilitates fast adaption of Q functions towards new tasks during the online fine-tuning phase. Extensive empirical evaluations provide compelling evidence showcasing the superior performance of our method in generalizing to diverse or even unseen tasks.

cs.LG↗

arXiv2024

Contrastive Representation for Data Filtering in Cross-Domain Offline Reinforcement Learning

Cross-domain offline reinforcement learning leverages source domain data with diverse transition dynamics to alleviate the data requirement for the target domain. However, simply merging the data of two domains leads to performance degradation due to the dynamics mismatch. Existing methods address this problem by measuring the dynamics gap via domain classifiers while relying on the assumptions of the transferability of paired domains. In this paper, we propose a novel representation-based approach to measure the domain gap, where the representation is learned through a contrastive objective by sampling transitions from different domains. We show that such an objective recovers the mutual-information gap of transition functions in two domains without suffering from the unbounded issue of the dynamics gap in handling significantly different domains. Based on the representations, we introduce a data filtering algorithm that selectively shares transitions from the source domain according to the contrastive score functions. Empirical results on various tasks demonstrate that our method achieves superior performance, using only 10% of the target data to achieve 89.2% of the performance on 100% target dataset with state-of-the-art methods.

cs.LG↗