arXiv subjects

Fei Wang

Publications and source records attributed to Fei Wang.

At least 523 records · Page 29Linked to original sources

arXiv2022

Local Randomized Neural Networks with Discontinuous Galerkin Methods for Partial Differential Equations

Randomized neural networks (RNN) are a variation of neural networks in which the hidden-layer parameters are fixed to randomly assigned values and the output-layer parameters are obtained by solving a linear system by least squares. This improves the efficiency without degrading the accuracy of the neural network. In this paper, we combine the idea of the local RNN (LRNN) and the discontinuous Galerkin (DG) approach for solving partial differential equations. RNNs are used to approximate the solution on the subdomains, and the DG formulation is used to glue them together. Taking the Poisson problem as a model, we propose three numerical schemes and provide the convergence analyses. Then we extend the ideas to time-dependent problems. Taking the heat equation as a model, three space-time LRNN with DG formulations are proposed. Finally, we present numerical tests to demonstrate the performance of the methods developed herein. We compare the proposed methods with the finite element method and the usual DG method. The LRNN-DG methods can achieve better accuracy under the same degrees of freedom, signifying that this new approach has a great potential for solving partial differential equations.

math.NA↗

arXiv2022

Response to: Significance and stability of deep learning-based identification of subtypes within major psychiatric disorders. Molecular Psychiatry (2022)

Recently, Winter and Hahn [1] commented on our work on identifying subtypes of major psychiatry disorders (MPDs) based on neurobiological features using machine learning [2]. They questioned the generalizability of our methods and the statistical significance, stability, and overfitting of the results, and proposed a pipeline for disease subtyping. We appreciate their earnest consideration of our work, however, we need to point out their misconceptions of basic machine-learning concepts and delineate some key issues involved.

cs.LG↗

arXiv2022

Collaboration Equilibrium in Federated Learning

Federated learning (FL) refers to the paradigm of learning models over a collaborative research network involving multiple clients without sacrificing privacy. Recently, there have been rising concerns on the distributional discrepancies across different clients, which could even cause counterproductive consequences when collaborating with others. While it is not necessarily that collaborating with all clients will achieve the best performance, in this paper, we study a rational collaboration called ``collaboration equilibrium'' (CE), where smaller collaboration coalitions are formed. Each client collaborates with certain members who maximally improve the model learning and isolates the others who make little contribution. We propose the concept of benefit graph which describes how each client can benefit from collaborating with other clients and advance a Pareto optimization approach to identify the optimal collaborators. Then we theoretically prove that we can reach a CE from the benefit graph through an iterative graph operation. Our framework provides a new way of setting up collaborations in a research network. Experiments on both synthetic and real world data sets are provided to demonstrate the effectiveness of our method.

cs.LG↗

arXiv2022

Explanation of electron and muon $g-2$ anomalies in AMSB

We propose to jointly explain the electron/muon $g-2$ anomalies in the framework of anomaly mediated SUSY breaking (AMSB) scenario. Two Yukawa deflected AMSB models are proposed and discussed in depth: one with lepton-specific interactions and the other one with messenger-matter interactions. Both models are found to be able to jointly explain the anomalies at $2 σ$ level by naturally realizing the preferred parameter space with $μM_1,μM_2<0$ and very heavy left-handed smuon.

hep-ph↗

arXiv2022

Thermal conductivity reduction in (Zr$_{0.25}$Ta$_{0.25}$Nb$_{0.25}$Ti$_{0.25}$)C high entropy carbide from extrinsic lattice defects

High entropy carbides ceramics with randomly-distributed multiple principal cations have shown high temperature stability, low thermal conductivity, and possible radiation tolerance. While chemical disorder has been shown to suppress thermal conductivity in these materials, little investigation has been made on the effects of additional, extrinsically-generated structural defects on thermal transport. Here, (Zr$_{0.25}$Ta$_{0.25}$Nb$_{0.25}$Ti$_{0.25}$)C is exposed to Zr ions to generate a micron-scale, structural-defect-bearing layer. The reduction in lattice thermal transport is measured using laser thermoreflectance. Conductivity changes from different implantation temperatures suggest dislocation loops contribute little to phonon scattering while nanoscale defects serve as effective scatterers, offering a pathway for thermal engineering.

cond-mat.mtrl-sci↗

arXiv2022

Social Distancing Alert with Smartwatches

Social distancing is an efficient public health practice during the COVID-19 pandemic. However, people would violate the social distancing practice unconsciously when they conduct some social activities such as handshaking, hugging, kissing on the face or forehead, etc. In this paper, we present SoDA, a social distancing practice violation alert system based on smartwatches, for preventing COVID-19 virus transmission. SoDA utilizes recordings of accelerometers and gyroscopes to recognize activities that may violate social distancing practice with simple yet effective Vision Transformer models. Extensive experiments over 10 volunteers and 1800+ samples demonstrate that SoDA achieves social activity recognition with the accuracy of 94.7%, 1.8% negative alert, and 2.2% missing alert.

cs.HC↗

arXiv2022

Mask Wearing Status Estimation with Smartwatches

We present MaskReminder, an automatic mask-wearing status estimation system based on smartwatches, to remind users who may be exposed to the COVID-19 virus transmission scenarios, to wear a mask. MaskReminder with the powerful MLP-Mixer deep learning model can effectively learn long-short range information from the inertial measurement unit readings, and can recognize the mask-related hand movements such as wearing a mask, lowering the metal strap of the mask, removing the strap from behind one side of the ears, etc. Extensive experiments on 20 volunteers and 8000+ data samples show that the average recognition accuracy is 89%. Moreover, MaskReminder is capable to remind a user to wear with a success rate of 90% even in the user-independent setting.

cs.HC↗

arXiv2022

NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results

This paper reviews the NTIRE 2022 challenge on efficient single image super-resolution with focus on the proposed solutions and results. The task of the challenge was to super-resolve an input image with a magnification factor of $\times$4 based on pairs of low and corresponding high resolution images. The aim was to design a network for single image super-resolution that achieved improvement of efficiency measured according to several metrics including runtime, parameters, FLOPs, activations, and memory consumption while at least maintaining the PSNR of 29.00dB on DIV2K validation set. IMDN is set as the baseline for efficiency measurement. The challenge had 3 tracks including the main track (runtime), sub-track one (model complexity), and sub-track two (overall performance). In the main track, the practical runtime performance of the submissions was evaluated. The rank of the teams were determined directly by the absolute value of the average runtime on the validation set and test set. In sub-track one, the number of parameters and FLOPs were considered. And the individual rankings of the two metrics were summed up to determine a final ranking in this track. In sub-track two, all of the five metrics mentioned in the description of the challenge including runtime, parameter count, FLOPs, activations, and memory consumption were considered. Similar to sub-track one, the rankings of five metrics were summed up to determine a final ranking. The challenge had 303 registered participants, and 43 teams made valid submissions. They gauge the state-of-the-art in efficient single image super-resolution.

cs.CV↗

arXiv2022

Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning

Controlled table-to-text generation seeks to generate natural language descriptions for highlighted subparts of a table. Previous SOTA systems still employ a sequence-to-sequence generation method, which merely captures the table as a linear structure and is brittle when table layouts change. We seek to go beyond this paradigm by (1) effectively expressing the relations of content pieces in the table, and (2) making our model robust to content-invariant structural transformations. Accordingly, we propose an equivariance learning framework, which encodes tables with a structure-aware self-attention mechanism. This prunes the full self-attention structure into an order-invariant graph attention that captures the connected graph structure of cells belonging to the same row or column, and it differentiates between relevant cells and irrelevant cells from the structural perspective. Our framework also modifies the positional encoding mechanism to preserve the relative position of tokens in the same cell but enforce position invariance among different cells. Our technology is free to be plugged into existing table-to-text generation models, and has improved T5-based models to offer better performance on ToTTo and HiTab. Moreover, on a harder version of ToTTo, we preserve promising performance, while previous SOTA systems, even with transformation-based data augmentation, have seen significant performance drops. Our code is available at https://github.com/luka-group/Lattice.

cs.CL↗

arXiv2022

Manifoldron: Direct Space Partition via Manifold Discovery

A neural network with the widely-used ReLU activation has been shown to partition the sample space into many convex polytopes for prediction. However, the parameterized way a neural network and other machine learning models use to partition the space has imperfections, \textit{e}.\textit{g}., the compromised interpretability for complex models, the inflexibility in decision boundary construction due to the generic character of the model, and the risk of being trapped into shortcut solutions. In contrast, although the non-parameterized models can adorably avoid or downplay these issues, they are usually insufficiently powerful either due to over-simplification or the failure to accommodate the manifold structures of data. In this context, we first propose a new type of machine learning models referred to as Manifoldron that directly derives decision boundaries from data and partitions the space via manifold structure discovery. Then, we systematically analyze the key characteristics of the Manifoldron such as manifold characterization capability and its link to neural networks. The experimental results on 4 synthetic examples, 20 public benchmark datasets, and 1 real-world application demonstrate that the proposed Manifoldron performs competitively compared to the mainstream machine learning models. We have shared our code in \url{https://github.com/wdayang/Manifoldron} for free download and evaluation.

cs.LG↗

arXiv2022

Unveiling non-gray surface of cloudy exoplanets: the influence of wavelength-dependent surface albedo and cloud scattering properties on retrieval solutions

Direct-imaging spectra hold rich information about a planet's atmosphere and surface, and several space-based missions aiming at such observations will become a reality in the near future. Previous spectral retrieval works have resulted in key atmospheric constraints under the assumption of a gray surface, but the effect of wavelength-dependent surface albedo on retrieval has not been shown. We explore the influence of the coupling effect of cloud and wavelength-dependent surface albedo on retrieval performance via modeling suites of Earth-like atmospheres with varying cloud and surface albedo parameterizations. Under the assumption of known cloud scattering properties, the surface spectral albedos can be reasonably recovered when the surface cover represents that of Earth-like vegetation or ocean, which may aid in characterizing the planet's habitability. When the cloud scattering properties cannot be assumed, we show that the degeneracy between the cloud properties and wavelength-dependent surface albedo leads to biased results of atmospheric and cloud properties. The multi-epoch visible band observations offer limited improvement in disentangling this degeneracy. However, the constraints on atmospheric properties from the combination of UV band (R $\sim 6$) $+$ visible band (R $\sim 140$) are consistent with input values to within 1 $σ$. If short bandpass data is not available, an alternative solution to reduce the retrieval uncertainties would be to have the prior constraints on planetary cloud fraction with less than 20% uncertainty.

astro-ph.EP↗

arXiv2022

Explaining The Muon $g-2$ Anomaly and New CDF II W-Boson Mass in the Framework of (Extra)Ordinary Gauge Mediation

The SUSY contributions $Δa_μ$ to muon $g-2$ anomaly can not even reach $3σ$ in ordinary gauge mediated SUSY breaking (GMSB) scenarios because of the strong correlations between the colored sparticle masses and the uncolored EW sparticle masses. An interesting extension to GMSB is the (Extra)Ordinary Gauge Mediation (EOGM), which can relax the correlations between squarks and sleptons with non-universal choices for $N_{eff,3}$ and $N_{eff,2}$. We find that EOGM scenarios with $N_{eff,3}\ll N_{eff,2}$ can explain the muon $g-2$ anomaly within $3σ$ range, however can not explain the new W-boson mass by CDF II. We also propose to extend EOGM with additional adjoint $Σ_8$ and $Σ_3$ messengers at a high scale of order $1.0\times 10^{14}$ GeV, which can shift the gauge coupling unification scale to the string scale. Such EOGM extension scenarios with adjoint messengers could spoil the unwanted gaugino mass ratios and give large SUSY contributions to $Δa_μ$ for $N_{eff,3}\ll N_{eff,2}$, which can explain the muon $g-2$ anomaly up to $1σ$. Besides, because of the large messenger scale of order $1.0\times 10^{14}$ GeV, such scenarios will in general lead to large $|A_t|$ at the EW scale, which can accommodate the 125 GeV Higgs easily and possibly lead to smaller EWFT as well as BGFT. We discuss the possibility to explain the new CDF II W-boson mass in the GMSB-type framework. We find that SUSY contributions can marginally account for the new W-boson mass in the region with sleptons and wino both being light.

hep-ph↗

arXiv2022

Stretchable Cells Help DARTS Search Better

Differentiable neural architecture search (DARTS) has gained much success in discovering flexible and diverse cell types. To reduce the evaluation gap, the supernet is expected to have identical layers with the target network. However, even for this consistent search, the searched cells often suffer from poor performance, especially for the supernet with fewer layers, as current DARTS methods are prone to wide and shallow cells, and this topology collapse induces sub-optimal searched cells. In this paper, we alleviate this issue by endowing the cells with explicit stretchability, so the search can be directly implemented on our stretchable cells for both operation type and topology simultaneously. Concretely, we introduce a set of topological variables and a combinatorial probabilistic distribution to explicitly model the target topology. With more diverse and complex topologies, our method adapts well for various layer numbers. Extensive experiments on CIFAR-10 and ImageNet show that our stretchable cells obtain better performance with fewer layers and parameters. For example, our method can improve DARTS by 0.28\% accuracy on CIFAR-10 dataset with 45\% parameters reduced or 2.9\% with similar FLOPs on ImageNet dataset.

cs.CV↗

arXiv2022

GreedyNASv2: Greedier Search with a Greedy Path Filter

Training a good supernet in one-shot NAS methods is difficult since the search space is usually considerably huge (e.g., $13^{21}$). In order to enhance the supernet's evaluation ability, one greedy strategy is to sample good paths, and let the supernet lean towards the good ones and ease its evaluation burden as a result. However, in practice the search can be still quite inefficient since the identification of good paths is not accurate enough and sampled paths still scatter around the whole search space. In this paper, we leverage an explicit path filter to capture the characteristics of paths and directly filter those weak ones, so that the search can be thus implemented on the shrunk space more greedily and efficiently. Concretely, based on the fact that good paths are much less than the weak ones in the space, we argue that the label of "weak paths" will be more confident and reliable than that of "good paths" in multi-path sampling. In this way, we thus cast the training of path filter in the positive and unlabeled (PU) learning paradigm, and also encourage a \textit{path embedding} as better path/operation representation to enhance the identification capacity of the learned filter. By dint of this embedding, we can further shrink the search space by aggregating similar operations with similar embeddings, and the search can be more efficient and accurate. Extensive experiments validate the effectiveness of the proposed method GreedyNASv2. For example, our obtained GreedyNASv2-L achieves $81.1\%$ Top-1 accuracy on ImageNet dataset, significantly outperforming the ResNet-50 strong baselines.

cs.CV↗

arXiv2022

$2^{1296}$ Exponentially Complex Quantum Many-Body Simulation via Scalable Deep Learning Method

For decades, people are developing efficient numerical methods for solving the challenging quantum many-body problem, whose Hilbert space grows exponentially with the size of the problem. However, this journey is far from over, as previous methods all have serious limitations. The recently developed deep learning methods provide a very promising new route to solve the long-standing quantum many-body problems. We report that a deep learning based simulation protocol can achieve the solution with state-of-the-art precision in the Hilbert space as large as $2^{1296}$ for spin system and $3^{144}$ for fermion system , using a HPC-AI hybrid framework on the new Sunway supercomputer. With highly scalability up to 40 million heterogeneous cores, our applications have measured 94% weak scaling efficiency and 72% strong scaling efficiency. The accomplishment of this work opens the door to simulate spin models and Fermion models on unprecedented lattice size with extreme high precision.

quant-ph↗

arXiv2022

A Keypoint-based Global Association Network for Lane Detection

Lane detection is a challenging task that requires predicting complex topology shapes of lane lines and distinguishing different types of lanes simultaneously. Earlier works follow a top-down roadmap to regress predefined anchors into various shapes of lane lines, which lacks enough flexibility to fit complex shapes of lanes due to the fixed anchor shapes. Lately, some works propose to formulate lane detection as a keypoint estimation problem to describe the shapes of lane lines more flexibly and gradually group adjacent keypoints belonging to the same lane line in a point-by-point manner, which is inefficient and time-consuming during postprocessing. In this paper, we propose a Global Association Network (GANet) to formulate the lane detection problem from a new perspective, where each keypoint is directly regressed to the starting point of the lane line instead of point-by-point extension. Concretely, the association of keypoints to their belonged lane line is conducted by predicting their offsets to the corresponding starting points of lanes globally without dependence on each other, which could be done in parallel to greatly improve efficiency. In addition, we further propose a Lane-aware Feature Aggregator (LFA), which adaptively captures the local correlations between adjacent keypoints to supplement local information to the global association. Extensive experiments on two popular lane detection benchmarks show that our method outperforms previous methods with F1 score of 79.63% on CULane and 97.71% on Tusimple dataset with high FPS. The code will be released at https://github.com/Wolfwjs/GANet.

cs.CV↗

arXiv2022

Bridging the Gap between Deep Learning and Frustrated Quantum Spin System for Extreme-scale Simulations on New Generation of Sunway Supercomputer

Efficient numerical methods are promising tools for delivering unique insights into the fascinating properties of physics, such as the highly frustrated quantum many-body systems. However, the computational complexity of obtaining the wave functions for accurately describing the quantum states increases exponentially with respect to particle number. Here we present a novel convolutional neural network (CNN) for simulating the two-dimensional highly frustrated spin-$1/2$ $J_1-J_2$ Heisenberg model, meanwhile the simulation is performed at an extreme scale system with low cost and high scalability. By ingenious employment of transfer learning and CNN's translational invariance, we successfully investigate the quantum system with the lattice size up to $24\times24$, within 30 million cores of the new generation of sunway supercomputer. The final achievement demonstrates the effectiveness of CNN-based representation of quantum-state and brings the state-of-the-art record up to a brand-new level from both aspects of remarkable accuracy and unprecedented scales.

cond-mat.str-el↗

arXiv2022

Q-balls Formation and the Production of Gravitational Waves With Non-minimal Gravitational Coupling

We propose to introduce non-minimal couplings of Affleck-Dine (AD) field to gravity by adding the coupling of AD field to the Ricci scalar curvature. As the Jordan frame supergravity always predict $|Φ|^2 {\cal R}/6$ type coupling for scalars with canonical kinetic terms, we propose a way to realize the required $c_0|Φ|^2 {\cal R}$-type couplings with generic $c_0$ for canonical complex scalar fields after SUSY breaking. The impacts of such non-minimal gravitational couplings for AD field is shown, especially on the Q-balls formation and the associated gravitational wave (GW) productions. New form of scalar potential for AD field in the Einstein frame is obtained. By numerical simulations, we find that, with non-minimal gravitational coupling to AD field, Q-balls can successfully form even with the choice of non-negative $K$ parameter for $ξ>0$. The associated GW productions as well as their dependences on the $ξ$ parameter are also discussed.

gr-qc↗