arXiv Science⌕ Search

arXiv subjects

Chao Wu

Publications and source records attributed to Chao Wu.

At least 127 records · Page 7Linked to original sources

Prompt-to-afterglow transition of optical emission in a long gamma-ray burst consistent with a fireball

Long gamma-ray bursts (GRBs), which signify the end-life collapsing of very massive stars, are produced by extremely relativistic jets colliding into circumstellar medium. Huge energy is released both in the first few seconds, namely the internal dissipation phase that powers prompt emissions, and in the subsequent self-similar jet-deceleration phase that produces afterglows observed in broad-band electromagnetic spectrum. However, prompt optical emissions of GRBs have been rarely detected, seriously limiting our understanding of the transition between the two phases. Here we report detection of prompt optical emissions from a gamma-ray burst (i.e. GRB 201223A) using a dedicated telescope array with a high temporal resolution and a wide time coverage. The early phase coincident with prompt γ-ray emissions show a luminosity in great excess with respect to the extrapolation of γ-rays, while the later luminosity bump is consistent with onset of the afterglow. The clearly detected transition allows us to differentiate physical processes contributing to early optical emissions and to diagnose the composition of the jet

astro-ph.HE↗

Learning Cautiously in Federated Learning with Noisy and Heterogeneous Clients

Federated learning (FL) is a distributed framework for collaboratively training with privacy guarantees. In real-world scenarios, clients may have Non-IID data (local class imbalance) with poor annotation quality (label noise). The co-existence of label noise and class imbalance in FL's small local datasets renders conventional FL methods and noisy-label learning methods both ineffective. To address the challenges, we propose FedCNI without using an additional clean proxy dataset. It includes a noise-resilient local solver and a robust global aggregator. For the local solver, we design a more robust prototypical noise detector to distinguish noisy samples. Further to reduce the negative impact brought by the noisy samples, we devise a curriculum pseudo labeling method and a denoise Mixup training strategy. For the global aggregator, we propose a switching re-weighted aggregation method tailored to different learning periods. Extensive experiments demonstrate our method can substantially outperform state-of-the-art solutions in mix-heterogeneous FL environments.

cs.LG↗

A huge-amplitude white-light superflare on a L0 brown dwarf discovered by GWAC survey

White-light superflares from ultra cool stars are thought to be resulted from magnetic reconnection, but the magnetic dynamics in a fully convective star is not clear yet. In this paper, we report a stellar superflare detected with the Ground Wide Angle Camera (GWAC), along with rapid follow-ups with the F60A, Xinglong 2.16m and LCOGT telescopes. The effective temperature of the counterpart is estimated to be $2200\pm50$K by the BT-Settl model, corresponding to a spectral type of L0. The $R-$band light curve can be modeled as a sum of three exponential decay components, where the impulsive component contributes a fraction of 23\% of the total energy, while the gradual and the shallower decay phases emit 42\% and 35\% of the total energy, respectively. The strong and variable Balmer narrow emission lines indicate the large amplitude flare is resulted from magnetic activity. The bolometric energy released is about $6.4\times10^{33}$ ergs, equivalent to an energy release in a duration of 143.7 hours at its quiescent level. The amplitude of $ΔR=-8.6 $mag ( or $ΔV=-11.2$ mag), placing it one of the highest amplitudes of any ultra cool star recorded with excellent temporal resolution. We argue that a stellar flare with such rapidly decaying and huge amplitude at distances greater than 1 kpc may be false positive in searching for counterparts of catastrophic events such as gravitational wave events or gamma-ray bursts, which are valuable in time-domain astronomy and should be given more attention.

astro-ph.SR↗

Delving into the Adversarial Robustness of Federated Learning

In Federated Learning (FL), models are as fragile as centrally trained models against adversarial examples. However, the adversarial robustness of federated learning remains largely unexplored. This paper casts light on the challenge of adversarial robustness of federated learning. To facilitate a better understanding of the adversarial vulnerability of the existing FL methods, we conduct comprehensive robustness evaluations on various attacks and adversarial training methods. Moreover, we reveal the negative impacts induced by directly adopting adversarial training in FL, which seriously hurts the test accuracy, especially in non-IID settings. In this work, we propose a novel algorithm called Decision Boundary based Federated Adversarial Training (DBFAT), which consists of two components (local re-weighting and global regularization) to improve both accuracy and robustness of FL systems. Extensive experiments on multiple datasets demonstrate that DBFAT consistently outperforms other baselines under both IID and non-IID settings.

cs.LG↗

Photometric and Spectroscopic Observations of GRB 210104A: Bright Reverse shock Emission and Dense Circumburst Environment

Early afterglow observations of gamma-ray bursts (GRBs) are valuable for exploring the properties of their jets and ambient medium. We report our photometric and spectroscopic observations of GRB 210104A and discuss its jet properties with multiwavelength data. Our spectroscopic observation reveals several absorption features and a tentative redshift of 0.46 is identified. A bright optical flare that has a peak brightness of $R=13$ mag at $112\pm 7$~s was observed in the $R$ band during $67\sim 165$ seconds post the GRB trigger. The flux of the $R$-band afterglow decays with a slope of $α_{\rm O}={-0.91\pm 0.03}$ at $t>650$~s. The early X-ray afterglow lightcurve is a smooth bump, and it decays with a slope of $α_{\rm X}=-1.18\pm 0.01$ at late epoch. Our joint spectral fit to the optical-X-ray afterglows during $(1.1-1.3)\times 10^{4}$~s yields a photon index $Γ_{\rm O,X}=-1.82\pm 0.04$. The derived host galaxy extinction is $A_{R}=0.87$. Attributing the early optical flare to the reverse-shock (RS) emission and the late optical-X-ray emission to the forward shock emission; the optical and X-ray lightcurves at $t<3\times 10^4$~s can be well fit adopting an Markov Chain Monte Carlo algorithm. Comparing the properties of GRB 210104A with other GRBs that have detection of bright RS emission, we show that its jet is mildly magnetized ($R_{\rm B}=28$), with high radiation efficiency ($77\%$), is sub-energetic ($E_{\rm k, iso}=4.5\times 10^{51}$ erg), and moderately relativistic ($Γ_0\sim 35$) in a density medium ($n_{0}\sim 417\;{\rm cm}^{-3}$). It follows the tight $L_{γ,\rm iso}-E_{\rm p,z}-Γ_{0}$ relation as with typical GRBs.

astro-ph.HE↗

All-in-One: A Highly Representative DNN Pruning Framework for Edge Devices with Dynamic Power Management

During the deployment of deep neural networks (DNNs) on edge devices, many research efforts are devoted to the limited hardware resource. However, little attention is paid to the influence of dynamic power management. As edge devices typically only have a budget of energy with batteries (rather than almost unlimited energy support on servers or workstations), their dynamic power management often changes the execution frequency as in the widely-used dynamic voltage and frequency scaling (DVFS) technique. This leads to highly unstable inference speed performance, especially for computation-intensive DNN models, which can harm user experience and waste hardware resources. We firstly identify this problem and then propose All-in-One, a highly representative pruning framework to work with dynamic power management using DVFS. The framework can use only one set of model weights and soft masks (together with other auxiliary parameters of negligible storage) to represent multiple models of various pruning ratios. By re-configuring the model to the corresponding pruning ratio for a specific execution frequency (and voltage), we are able to achieve stable inference speed, i.e., keeping the difference in speed performance under various execution frequencies as small as possible. Our experiments demonstrate that our method not only achieves high accuracy for multiple models of different pruning ratios, but also reduces their variance of inference latency for various frequencies, with minimal memory consumption of only one model and one soft mask.

cs.LG↗

DENSE: Data-Free One-Shot Federated Learning

One-shot Federated Learning (FL) has recently emerged as a promising approach, which allows the central server to learn a model in a single communication round. Despite the low communication cost, existing one-shot FL methods are mostly impractical or face inherent limitations, \eg a public dataset is required, clients' models are homogeneous, and additional data/model information need to be uploaded. To overcome these issues, we propose a novel two-stage \textbf{D}ata-fre\textbf{E} o\textbf{N}e-\textbf{S}hot federated l\textbf{E}arning (DENSE) framework, which trains the global model by a data generation stage and a model distillation stage. DENSE is a practical one-shot FL method that can be applied in reality due to the following advantages: (1) DENSE requires no additional information compared with other methods (except the model parameters) to be transferred between clients and the server; (2) DENSE does not require any auxiliary dataset for training; (3) DENSE considers model heterogeneity in FL, \ie different clients can have different model architectures. Experiments on a variety of real-world datasets demonstrate the superiority of our method.For example, DENSE outperforms the best baseline method Fed-ADI by 5.08\% on CIFAR10 dataset.

cs.LG↗

Magnetic activities and parameters of 43 flare stars in the GWAC archive

In the archive of the Ground Wide Angle Camera (GWAC), we found 43 white light flares from 43 stars, among which, three are sympathetic or homologous flares, and one of them also has a quasi-periodic pulsation with a period of $13.0\pm1.5$ minutes. Among these 43 flare stars, there are 19 new active stars and 41 stars that have available TESS and/or K2 light curves, from which we found 931 stellar flares. We also obtained rotational or orbital periods of 34 GWAC flare stars, of which 33 are less than 5.4 days, and ephemerides of three eclipsing binaries from these light curves. Combining with low resolution spectra from LAMOST and the Xinglong 2.16m telescope, we found that $L_{\rm Hα}/L_{\rm bol}$ are in the saturation region in the rotation-activity diagram. From the LAMOST medium-resolution spectrum, we found that Star \#3 (HAT 178-02667) has double H$α$ emissions which imply it is a binary, and two components are both active stars. Thirteen stars have flare frequency distributions (FFDs) from TESS and/or K2 light curves. These FFDs show that the flares detected by GWAC can occur at a frequency of 0.5 to 9.5 yr$^{-1}$. The impact of flares on habitable planets was also studied based on these FFDs, and flares from some GWAC flare stars may produce enough energetic flares to destroy ozone layers, but none can trigger prebiotic chemistry on their habitable planets.

astro-ph.SR↗

Towards Effective Clustered Federated Learning: A Peer-to-peer Framework with Adaptive Neighbor Matching

In federated learning (FL), clients may have diverse objectives, and merging all clients' knowledge into one global model will cause negative transfer to local performance. Thus, clustered FL is proposed to group similar clients into clusters and maintain several global models. In the literature, centralized clustered FL algorithms require the assumption of the number of clusters and hence are not effective enough to explore the latent relationships among clients. In this paper, without assuming the number of clusters, we propose a peer-to-peer (P2P) FL algorithm named PANM. In PANM, clients communicate with peers to adaptively form an effective clustered topology. Specifically, we present two novel metrics for measuring client similarity and a two-stage neighbor matching algorithm based Monte Carlo method and Expectation Maximization under the Gaussian Mixture Model assumption. We have conducted theoretical analyses of PANM on the probability of neighbor estimation and the error gap to the clustered optimum. We have also implemented extensive experiments under both synthetic and real-world clustered heterogeneity. Theoretical analysis and empirical experiments show that the proposed algorithm is superior to the P2P FL counterparts, and it achieves better performance than the centralized cluster FL method. PANM is effective even under extremely low communication budgets.

cs.AI↗

Recent Advancements of Artificial Intelligence in Particle Therapy

We are in a golden age of progress in artificial intelligence (AI). Radiotherapy, due to its technology-intensive nature as well as direct human-machine interactions, is perfectly suited for benefitting from AI to enhance accuracy and efficiency. Over the past few years, a vast majority of AI research have already been published in the field of photon therapy, while the applications of AI specifically targeted for particle therapy remain scarcely investigated. There are two distinct differences between photon therapy and particle therapy: beam interaction physics (photons vs. charged particles) and beam delivery mode (e.g. IMRT/VMAT vs. pencil beam scanning). As a result, different strategies of AI deployment are required between these two radiotherapy modalities. In this article, we aim to present a comprehensive survey of recent literatures exclusively focusing on AI-powered particle therapy. Six major aspects are included: treatment planning, dose calculation, range and dose verification, image guidance, quality assurance and adaptive replanning. A number of perspectives as well as potential challenges and common pitfalls, are also discussed.

physics.med-ph↗

Dissipation wavenumber and regularity for electron magnetohydrodynamics

We consider the electron magnetohydrodynamics (MHD) with static background ion flow. A special situation of $B(x,y,t)=\nabla\times (a\vec e_z)+b \vec e_z$ with scalar-valued functions $a(x,y,t)$ and $b(x,y,t)$ was studied numerically in the physics paper [7]. The authors concluded from numerical simulations that there is no evidence of dissipation cutoff for the electron MHD. In this paper we show the existence of determining wavenumber for the electron MHD, and establish a regularity condition only on the low modes of the solution. Our results suggest that the conclusion of the physics paper on the dissipation cutoff for the electron MHD is debatable.

math.AP↗

DeltaFS: Pursuing Zero Update Overhead via Metadata-Enabled Delta Compression for Log-structured File System on Mobile Devices

Data compression has been widely adopted to release mobile devices from intensive write pressure. Delta compression is particularly promising for its high compression efficacy over conventional compression methods. However, this method suffers from non-trivial system overheads incurred by delta maintenance and read penalty, which prevents its applicability on mobile devices. To this end, this paper proposes DeltaFS, a metadata-enabled Delta compression on log-structured File System for mobile devices, to achieve utmost compressing efficiency and zero hardware costs. DeltaFS smartly exploits the out-of-place updating ability of Log-structured File System (LFS) to alleviate the problems of write amplification, which is the key bottleneck for delta compression implementation. Specifically, DeltaFS utilizes the inline area in file inodes for delta maintenance with zero hardware cost, and integrates an inline area manage strategy to improve the utilization of constrained inline area. Moreover, a complimentary delta maintenance strategy is incorporated, which selectively maintains delta chunks in the main data area to break through the limitation of constrained inline area. Experimental results show that DeltaFS substantially reduces write traffics by up to 64.8\%, and improves the I/O performance by up to 37.3\%.

cs.DC↗

Federated Learning with Label Distribution Skew via Logits Calibration

Traditional federated optimization methods perform poorly with heterogeneous data (ie, accuracy reduction), especially for highly skewed data. In this paper, we investigate the label distribution skew in FL, where the distribution of labels varies across clients. First, we investigate the label distribution skew from a statistical view. We demonstrate both theoretically and empirically that previous methods based on softmax cross-entropy are not suitable, which can result in local models heavily overfitting to minority classes and missing classes. Additionally, we theoretically introduce a deviation bound to measure the deviation of the gradient after local update. At last, we propose FedLC (\textbf {Fed} erated learning via\textbf {L} ogits\textbf {C} alibration), which calibrates the logits before softmax cross-entropy according to the probability of occurrence of each class. FedLC applies a fine-grained calibrated cross-entropy loss to local update by adding a pairwise label margin. Extensive experiments on federated datasets and real-world datasets demonstrate that FedLC leads to a more accurate global model and much improved performance. Furthermore, integrating other FL methods into our approach can further enhance the performance of the global model.

cs.LG↗

Adversarial Examples for Good: Adversarial Examples Guided Imbalanced Learning

Adversarial examples are inputs for machine learning models that have been designed by attackers to cause the model to make mistakes. In this paper, we demonstrate that adversarial examples can also be utilized for good to improve the performance of imbalanced learning. We provide a new perspective on how to deal with imbalanced data: adjust the biased decision boundary by training with Guiding Adversarial Examples (GAEs). Our method can effectively increase the accuracy of minority classes while sacrificing little accuracy on majority classes. We empirically show, on several benchmark datasets, our proposed method is comparable to the state-of-the-art method. To our best knowledge, we are the first to deal with imbalanced learning with adversarial examples.

cs.LG↗

S2RL: Do We Really Need to Perceive All States in Deep Multi-Agent Reinforcement Learning?

Collaborative multi-agent reinforcement learning (MARL) has been widely used in many practical applications, where each agent makes a decision based on its own observation. Most mainstream methods treat each local observation as an entirety when modeling the decentralized local utility functions. However, they ignore the fact that local observation information can be further divided into several entities, and only part of the entities is helpful to model inference. Moreover, the importance of different entities may change over time. To improve the performance of decentralized policies, the attention mechanism is used to capture features of local information. Nevertheless, existing attention models rely on dense fully connected graphs and cannot better perceive important states. To this end, we propose a sparse state based MARL (S2RL) framework, which utilizes a sparse attention mechanism to discard irrelevant information in local observations. The local utility functions are estimated through the self-attention and sparse attention mechanisms separately, then are combined into a standard joint value function and auxiliary joint value function in the central critic. We design the S2RL framework as a plug-and-play module, making it general enough to be applied to various methods. Extensive experiments on StarCraft II show that S2RL can significantly improve the performance of many state-of-the-art methods.

cs.LG↗

Massive On-shell Recursion Relations for n-point Amplitudes

We construct two and three-line shifts for tree-level amplitude with massless and/or massive particles, and provide a method to construct general multi-line shifts for all masses. We choose the massless-massive BCFW shift from these shifts and examine its validity in renormalizable theories. Using such a shift, we find that amplitudes with at least one massless vector boson are constructible. This reveals the importance of gauge theory in the construction of amplitudes with massive particles. We also find that this kind of amplitudes have a cancellation related to group structure among different channels, which is essential for constructibility. Furthermore, we show that in the limit of large shift parameter $z$, the amplitude with four massive vector bosons, which can include transverse massive vector particles, have structures proportional to the amplitude with shifted vector particles replaced by Goldstone bosons in the leading order. This is responsible for the failure of massive-massive BCFW recursion relations in the amplitudes with four massive vector bosons.

hep-th↗

Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI

Influenced by the great success of deep learning via cloud computing and the rapid development of edge chips, research in artificial intelligence (AI) has shifted to both of the computing paradigms, i.e., cloud computing and edge computing. In recent years, we have witnessed significant progress in developing more advanced AI models on cloud servers that surpass traditional deep learning models owing to model innovations (e.g., Transformers, Pretrained families), explosion of training data and soaring computing capabilities. However, edge computing, especially edge and cloud collaborative computing, are still in its infancy to announce their success due to the resource-constrained IoT scenarios with very limited algorithms deployed. In this survey, we conduct a systematic review for both cloud and edge AI. Specifically, we are the first to set up the collaborative learning mechanism for cloud and edge modeling with a thorough review of the architectures that enable such mechanism. We also discuss potentials and practical experiences of some on-going advanced edge AI topics including pretraining models, graph neural networks and reinforcement learning. Finally, we discuss the promising directions and challenges in this field.

cs.LG↗

Software Engineers Response to Public Crisis: Lessons Learnt from Spontaneously Building an Informative COVID-19 Dashboard

The Coronavirus disease 2019 (COVID-19) outbreak quickly spread around the world, resulting in over 240 million infections and 4 million deaths by Oct 2021. While the virus is spreading from person to person silently, fear has also been spreading around the globe. The COVID-19 information from the Australian Government is convincing but not timely or detailed, and there is much information on social networks with both facts and rumors. As software engineers, we have spontaneously and rapidly constructed a COVID-19 information dashboard aggregating reliable information semi-automatically checked from different sources for providing one-stop information sharing site about the latest status in Australia. Inspired by the John Hopkins University COVID-19 Map, our dashboard contains the case statistics, case distribution, government policy, latest news, with interactive visualization. In this paper, we present a participant's in-person observations in which the authors acted as founders of https://covid-19-au.com/ serving more than 830K users with 14M page views since March 2020. According to our first-hand experience, we summarize 9 lessons for developers, researchers and instructors. These lessons may inspire the development, research and teaching in software engineer aspects for coping with similar public crises in the future.

cs.SE↗