arXiv subjects

Zhen Zhang

Publications and source records attributed to Zhen Zhang.

At least 307 records · Page 17Linked to original sources

arXiv2024

A time-dependent symplectic network for non-convex path planning problems with linear and nonlinear dynamics

We propose a novel neural network architecture (TSympOCNet) to address high--dimensional optimal control problems with linear and nonlinear dynamics. An important application of this method is to solve the path planning problem of multi-agent vehicles in real time. The new method extends our previous SympOCNet framework by introducing a time-dependent symplectic network into the architecture. In addition, we propose a more general latent representation, which greatly improves model expressivity based on the universal approximation theorem. We demonstrate the efficacy of TSympOCNet in path planning problems with obstacle and collision avoidance, including systems with Newtonian dynamics and non-convex environments, up to dimension 512. Our method shows significant promise in handling efficiently both complex dynamics and constraints.

math.OC↗

arXiv2024

Tool Learning with Foundation Models

Humans possess an extraordinary ability to create and utilize tools, allowing them to overcome physical limitations and explore new frontiers. With the advent of foundation models, AI systems have the potential to be equally adept in tool use as humans. This paradigm, i.e., tool learning with foundation models, combines the strengths of specialized tools and foundation models to achieve enhanced accuracy, efficiency, and automation in problem-solving. Despite its immense potential, there is still a lack of a comprehensive understanding of key challenges, opportunities, and future endeavors in this field. To this end, we present a systematic investigation of tool learning in this paper. We first introduce the background of tool learning, including its cognitive origins, the paradigm shift of foundation models, and the complementary roles of tools and models. Then we recapitulate existing tool learning research into tool-augmented and tool-oriented learning. We formulate a general tool learning framework: starting from understanding the user instruction, models should learn to decompose a complex task into several subtasks, dynamically adjust their plan through reasoning, and effectively conquer each sub-task by selecting appropriate tools. We also discuss how to train models for improved tool-use capabilities and facilitate the generalization in tool learning. Considering the lack of a systematic tool learning evaluation in prior works, we experiment with 18 representative tools and show the potential of current foundation models in skillfully utilizing tools. Finally, we discuss several open problems that require further investigation for tool learning. In general, we hope this paper could inspire future research in integrating tools with foundation models.

cs.CL↗

arXiv2024

The Peculiar Precursor of a Gamma-Ray Burst from a Binary Merger Involving a Magnetar

The milestone discovery of GW 170817-GRB 170817A-AT 2017gfo has shown that gravitational wave (GW) could be produced during the merger of neutron star-neutron star/black hole and that in electromagnetic (EM) wave a gamma-ray burst (GRB) and a kilonova (KN) are generated in sequence after the merger. Observationally, however, EM property before the merger phase is still unclear. Here we report a peculiar precursor in a KN-associated long-duration GRB 211211A, providing evidence of the EM before the merger. This precursor lasts $\sim$ 0.2 s, and the waiting time between the precursor and the main burst is $\sim$ 1 s, comparable to that between GW 170817 and GRB 170817A. The spectrum of the precursor could be well fit with a non-thermal cutoff power-law model instead of a blackbody. Especially, a $\sim$22 Hz Quasi-Periodic Oscillation candidate ($\sim 3σ$) is detected in the precursor. These temporal and spectral properties indicate that this precursor is probably produced by a catastrophic flare accompanying with magnetoelastic or crustal oscillations of a magnetar in binary compact merger. The strong magnetic field of the magnetar can also account for the prolonged duration of GRB 211211A. However, it poses a challenge to reconcile the rather short lifetime of a magnetar with the rather long spiraling time of a binary neutron star system only by the GW radiation before merger.

astro-ph.HE↗

arXiv2024

X-ray Sources Classification Using Machine Learning: A Study with EP-WXT Pathfinder LEIA

X-ray observations play a crucial role in time-domain astronomy. The Einstein Probe (EP), a recently launched X-ray astronomical satellite, emerges as a forefront player in the field of time-domain astronomy and high-energy astrophysics. With a focus on systematic surveys in the soft X-ray band, EP aims to discover high-energy transients and monitor variable sources in the universe. To achieve these objectives, a quick and reliable classification of observed sources is essential. In this study, we developed a machine learning classifier for autonomous source classification using data from the EP-WXT Pathfinder Lobster Eye Imager for Astronomy (LEIA) and EP-WXT simulations. The proposed Random Forest classifier, built on selected features derived from light curves, energy spectra, and location information, achieves an accuracy of approximately 95% on EP simulation data and 98% on LEIA observational data. The classifier is integrated into the LEIA data processing pipeline, serving as a tool for manual validation and rapid classification during observations. This paper presents an efficient method for the classification of X-ray sources based on single observations, along with implications of most effective features for the task. This work facilitates rapid source classification for the EP mission and also provides valuable insights into feature selection and classification techniques for enhancing the efficiency and accuracy of X-ray source classification that can be adapted to other X-ray telescope data.

astro-ph.IM↗

arXiv2024

A new subclass of gamma-ray burst originating from compact binary merger

Type I gamma-ray bursts (GRBs) are believed to originate from compact binary merger usually with duration less than 2 seconds for the main emission. However, recent observations of GRB 211211A and GRB 230307A indicate that some merger-origin GRBs could last much longer. Since they show strikingly similar properties (indicating a common mechanism) which are different from the classic "long"-short burst (e.g. GRB 060614), forming an interesting subclass of type I GRBs, we suggest to name them as type IL GRBs. By identifying the first peak of GRB 230307A as a quasi-thermal precursor, we find that the prompt emission of type IL GRB is composed of three episodes: (1) a precursor followed by a short quiescent (or weak emission) period, (2) a long-duration main emission, and (3) an extended emission. With this burst pattern, a good candidate, GRB 170228A, was found in the Fermi/GBM archive data, and subsequent temporal and spectral analyses indeed show that GRB 170228A falls in the same cluster with GRB 211211A and GRB 230307A in many diagnostic figures. Thus this burst pattern could be a good reference for rapidly identifying type IL GRB and conducting low-latency follow-up observation. We estimated the occurrence rate and discussed the physical origins and implications for the three emission episodes of type IL GRBs. Our analysis suggests the pre-merger precursor model, especially the super flare model, is more favored for type IL GRBs.

astro-ph.HE↗

arXiv2024

Revealing hidden medium-range order in silicate glass-formers using many-body correlation functions

The medium range order (MRO) in amorphous systems has been linked to complex features such as the dynamic heterogeneity of supercooled liquids or the plastic deformation of glasses. However, the nature of the MRO in these materials has remained elusive, primarily due to the lack of methods capable of characterizing this order. Here, we leverage standard two-body structural correlators and advanced many-body correlation functions to probe numerically the MRO in prototypical network glassformers, i.e., silica and sodium silicates, systems that are of importance in natural as well as industrial settings. With increasing Na concentration, one finds that the local environment of Na becomes more structured and the spatial distribution of Na on intermediate length scales changes from blob-like to channel-like, indicating a growing inhomogeneity in the spatial Na arrangement. In parallel, we find that the Si-O network becomes increasingly depolymerized, resulting in a ring size distribution that broadens. The radius of gyration of the rings is well described by a power-law with an exponent around 0.75, indicating that the rings are progressively more crumbled with increasing size. Using a recently proposed four-point correlation function, we reveal that the relative orientation of the tetrahedra shows a transition at a distance around 4 Angstroms, a structural modification that is not seen in standard two-point correlation functions. Furthermore, we find that the length scale characterizing the MRO is non-monotonic as a function of temperature, caused by the competition between energetic and entropic terms. Finally, we demonstrate that the structural correlation lengths as obtained from the correlation functions that quantify the MRO are correlated with macroscopic observables such as the kinetic fragility of the liquids and the elastic properties of the glasses.

cond-mat.dis-nn↗

arXiv2024

Resource Allocation and Workload Scheduling for Large-Scale Distributed Deep Learning: A Survey

With rapidly increasing distributed deep learning workloads in large-scale data centers, efficient distributed deep learning framework strategies for resource allocation and workload scheduling have become the key to high-performance deep learning. The large-scale environment with large volumes of datasets, models, and computational and communication resources raises various unique challenges for resource allocation and workload scheduling in distributed deep learning, such as scheduling complexity, resource and workload heterogeneity, and fault tolerance. To uncover these challenges and corresponding solutions, this survey reviews the literature, mainly from 2019 to 2024, on efficient resource allocation and workload scheduling strategies for large-scale distributed DL. We explore these strategies by focusing on various resource types, scheduling granularity levels, and performance goals during distributed training and inference processes. We highlight critical challenges for each topic and discuss key insights of existing technologies. To illustrate practical large-scale resource allocation and workload scheduling in real distributed deep learning scenarios, we use a case study of training large language models. This survey aims to encourage computer science, artificial intelligence, and communications researchers to understand recent advances and explore future research directions for efficient framework strategies for large-scale distributed deep learning.

cs.DC↗

arXiv2024

Unveiling a Family of Dimerized Quantum Magnets in Ternary Metal Borides

Dimerized quantum magnets are exotic crystalline materials where Bose-Einstein condensation of magnetic excitations can happen. However, known dimerized quantum magnets are limited to only a few oxides and halides. Here, we unveil 9 dimerized quantum magnets and 11 conventional antiferromagnets in ternary metal borides MTB$_4$ (M = Sc, Y, La, Ce, Lu, Mg, Ca, Al; T = V, Cr, Mn, Fe, Co, Ni). In this type of structure, 3d transition-metal atoms T are arranged in dimers. Quantum magnetism in these compounds is dominated by strong antiferromagnetic interactions between Cr (both Cr and Mn for M = Mg and Ca) atoms within the structural dimers, with much weaker interactions between the dimers. These systems are proposed to be close to a quantum critical point between a disordered singlet spin-dimer phase, with a spin gap, and the ordered conventional Néel antiferromagnetic phase. This new family of dimerized quantum magnets greatly enriches the materials inventory that allows investigations of the spin-gap phase. All the quantum-, conventionally-, and non-magnetic systems identified, together with experimental synthesis methods of a phase suitable for characterization, provide a platform with abundant possibilities to tune the magnetic exchange coupling by doping and study this unconventional type of quantum phase transition. This work opens up new avenues for studying the quantum magnetism of spin dimers in borides and establishes a theoretical workflow for future searches for dimerized quantum magnets in other families or types of materials.

cond-mat.mtrl-sci↗

arXiv2024

Observation of spectral lines in the exceptional GRB 221009A

As the brightest gamma-ray burst ever observed, GRB 221009A provided a precious opportunity to explore spectral line features. In this paper, we performed a comprehensive spectroscopy analysis of GRB 221009A jointly with GECAM-C and Fermi/GBM data to search for emission and absorption lines. For the first time we investigated the line feature throughout this GRB including the most bright part where many instruments suffered problems, and identified prominent emission lines in multiple time intervals. The central energy of the Gaussian emission line evolves from about 37 MeV to 6 MeV, with a nearly constant ratio (about 10\%) between the line width and central energy. Particularly, we find that both the central energy and the energy flux of the emission line evolve with time as a power law decay with power law index of -1 and -2 respectively. We suggest that the observed emission lines most likely originate from the blue-shifted electron positron pair annihilation 511 keV line. We find that a standard high latitude emission scenario cannot fully interpret the observation, thus we propose that the emission line comes from some dense clumps with electron positron pairs traveling together with the jet. In this scenario, we can use the emission line to directly, for the first time, measure the bulk Lorentz factor of the jet ($Γ$) and reveal its time evolution (i.e. $Γ\sim t^{-1}$) during the prompt emission. Interestingly, we find that the flux of the annihilation line in the co-moving frame keeps constant. These discoveries of the spectral line features shed new and important lights on the physics of GRB and relativistic jet.

astro-ph.HE↗

arXiv2024

Tools at the Frontiers of Quantitative Verification

The analysis of formal models that include quantitative aspects such as timing or probabilistic choices is performed by quantitative verification tools. Broad and mature tool support is available for computing basic properties such as expected rewards on basic models such as Markov chains. Previous editions of QComp, the comparison of tools for the analysis of quantitative formal models, focused on this setting. Many application scenarios, however, require more advanced property types such as LTL and parameter synthesis queries as well as advanced models like stochastic games and partially observable MDPs. For these, tool support is in its infancy today. This paper presents the outcomes of QComp 2023: a survey of the state of the art in quantitative verification tool support for advanced property types and models. With tools ranging from first research prototypes to well-supported integrations into established toolsets, this report highlights today's active areas and tomorrow's challenges in tool-focused research for quantitative verification.

cs.LO↗

arXiv2024

Generation of Granular-Balls for Clustering Based on the Principle of Justifiable Granularity

Efficient and robust data clustering remains a challenging task in the field of data analysis. Recent efforts have explored the integration of granular-ball (GB) computing with clustering algorithms to address this challenge, yielding promising results. However, existing methods for generating GBs often rely on single indicators to measure GB quality and employ threshold-based or greedy strategies, potentially leading to GBs that do not accurately capture the underlying data distribution. To address these limitations, this article introduces a novel GB generation method. The originality of this method lies in leveraging the principle of justifiable granularity to measure the quality of a GB for clustering tasks. To be precise, we define the coverage and specificity of a GB and introduce a comprehensive measure for assessing GB quality. Utilizing this quality measure, the method incorporates a binary tree pruning-based strategy and an anomaly detection method to determine the best combination of sub-GBs for each GB and identify abnormal GBs, respectively. Compared to previous GB generation methods, the new method maximizes the overall quality of generated GBs while ensuring alignment with the data distribution, thereby enhancing the rationality of the generated GBs. Experimental results obtained from both synthetic and publicly available datasets underscore the effectiveness of the proposed GB generation method, showcasing improvements in clustering accuracy and normalized mutual information.

cs.LG↗

arXiv2024

Cross-IQA: Unsupervised Learning for Image Quality Assessment

Automatic perception of image quality is a challenging problem that impacts billions of Internet and social media users daily. To advance research in this field, we propose a no-reference image quality assessment (NR-IQA) method termed Cross-IQA based on vision transformer(ViT) model. The proposed Cross-IQA method can learn image quality features from unlabeled image data. We construct the pretext task of synthesized image reconstruction to unsupervised extract the image quality information based ViT block. The pretrained encoder of Cross-IQA is used to fine-tune a linear regression model for score prediction. Experimental results show that Cross-IQA can achieve state-of-the-art performance in assessing the low-frequency degradation information (e.g., color change, blurring, etc.) of images compared with the classical full-reference IQA and NR-IQA under the same datasets.

cs.CV↗

arXiv2024

High-throughput screening for boride superconductors

A high-throughput screening using density functional calculations is performed to search for stable boride superconductors from the existing materials database. The workflow employs the fast frozen phonon method as the descriptor to evaluate the superconducting properties quickly. 23 stable candidates are identified from the screening. For almost all found binary compounds, the superconductivity was obtained earlier experimentally or computationally. For ternary borides, previous studies are very limited. Our extensive search among ternary systems confirmed superconductivity in known systems and found several new compounds. Among these discovered superconducting ternary borides, Ta(MoB)$_2$ shows the highest superconducting temperature of ~12K. Most predicted compounds were synthesized previously; therefore, our predictions can be examined experimentally. Our work also demonstrates that the boride systems can have diverse structural motifs that lead to superconductivity.

cond-mat.mtrl-sci↗

arXiv2024

Advancing the Robustness of Large Language Models through Self-Denoised Smoothing

Although large language models (LLMs) have achieved significant success, their vulnerability to adversarial perturbations, including recent jailbreak attacks, has raised considerable concerns. However, the increasing size of these models and their limited access make improving their robustness a challenging task. Among various defense strategies, randomized smoothing has shown great potential for LLMs, as it does not require full access to the model's parameters or fine-tuning via adversarial training. However, randomized smoothing involves adding noise to the input before model prediction, and the final model's robustness largely depends on the model's performance on these noise corrupted data. Its effectiveness is often limited by the model's sub-optimal performance on noisy data. To address this issue, we propose to leverage the multitasking nature of LLMs to first denoise the noisy inputs and then to make predictions based on these denoised versions. We call this procedure self-denoised smoothing. Unlike previous denoised smoothing techniques in computer vision, which require training a separate model to enhance the robustness of LLMs, our method offers significantly better efficiency and flexibility. Our experimental results indicate that our method surpasses existing methods in both empirical and certified robustness in defending against adversarial attacks for both downstream tasks and human alignments (i.e., jailbreak attacks). Our code is publicly available at https://github.com/UCSB-NLP-Chang/SelfDenoise

cs.CL↗

arXiv2024

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

With the rapid growth in the volume of data sets, models, and devices in the domain of deep learning, there is increasing attention on large-scale distributed deep learning. In contrast to traditional distributed deep learning, the large-scale scenario poses new challenges that include fault tolerance, scalability of algorithms and infrastructures, and heterogeneity in data sets, models, and resources. Due to intensive synchronization of models and sharing of data across GPUs and computing nodes during distributed training and inference processes, communication efficiency becomes the bottleneck for achieving high performance at a large scale. This article surveys the literature over the period of 2018-2023 on algorithms and technologies aimed at achieving efficient communication in large-scale distributed deep learning at various levels, including algorithms, frameworks, and infrastructures. Specifically, we first introduce efficient algorithms for model synchronization and communication data compression in the context of large-scale distributed training. Next, we introduce efficient strategies related to resource allocation and task scheduling for use in distributed training and inference. After that, we present the latest technologies pertaining to modern communication infrastructures used in distributed deep learning with a focus on examining the impact of the communication overhead in a large-scale and heterogeneous setting. Finally, we conduct a case study on the distributed training of large language models at a large scale to illustrate how to apply these technologies in real cases. This article aims to offer researchers a comprehensive understanding of the current landscape of large-scale distributed deep learning and to reveal promising future research directions toward communication-efficient solutions in this scope.

cs.DC↗

arXiv2024

"Beam `a la carte": laser heater shaping for attosecond pulses in a multiplexed x-ray free-electron laser

Electron beam shaping allows the control of the temporal properties of x-ray free-electron laser pulses from femtosecond to attosecond timescales. Here we demonstrate the use of a laser heater to shape electron bunches and enable the generation of attosecond x-ray pulses. We demonstrate that this method can be applied in a selective way, shaping a targeted subset of bunches while leaving the remaining bunches unchanged. This experiment enables the delivery of shaped x-ray pulses to multiple undulator beamlines, with pulse properties tailored to specialized scientific applications.

physics.acc-ph↗

arXiv2024

Efficient prediction of attosecond two-colour pulses from an X-ray free-electron laser with machine learning

X-ray free-electron lasers are sources of coherent, high-intensity X-rays with numerous applications in ultra-fast measurements and dynamic structural imaging. Due to the stochastic nature of the self-amplified spontaneous emission process and the difficulty in controlling injection of electrons, output pulses exhibit significant noise and limited temporal coherence. Standard measurement techniques used for characterizing two-coloured X-ray pulses are challenging, as they are either invasive or diagnostically expensive. In this work, we employ machine learning methods such as neural networks and decision trees to predict the central photon energies of pairs of attosecond fundamental and second harmonic pulses using parameters that are easily recorded at the high-repetition rate of a single shot. Using real experimental data, we apply a detailed feature analysis on the input parameters while optimizing the training time of the machine learning methods. Our predictive models are able to make predictions of central photon energy for one of the pulses without measuring the other pulse, thereby leveraging the use of the spectrometer without having to extend its detection window. We anticipate applications in X-ray spectroscopy using XFELs, such as in time-resolved X-ray absorption and photoemission spectroscopy, where improved measurement of input spectra will lead to better experimental outcomes.

physics.acc-ph↗

arXiv2024

EX-Graph: A Pioneering Dataset Bridging Ethereum and X

While numerous public blockchain datasets are available, their utility is constrained by an exclusive focus on blockchain data. This constraint limits the incorporation of relevant social network data into blockchain analysis, thereby diminishing the breadth and depth of insight that can be derived. To address the above limitation, we introduce EX-Graph, a novel dataset that authentically links Ethereum and X, marking the first and largest dataset of its kind. EX-Graph combines Ethereum transaction records (2 million nodes and 30 million edges) and X following data (1 million nodes and 3 million edges), bonding 30,667 Ethereum addresses with verified X accounts sourced from OpenSea. Detailed statistical analysis on EX-Graph highlights the structural differences between X-matched and non-X-matched Ethereum addresses. Extensive experiments, including Ethereum link prediction, wash-trading Ethereum addresses detection, and X-Ethereum matching link prediction, emphasize the significant role of X data in enhancing Ethereum analysis. EX-Graph is available at \url{https://exgraph.deno.dev/}.

cs.SI↗