arXiv Science⌕ Search

arXiv subjects

Yi Wang

Publications and source records attributed to Yi Wang.

At least 703 records · Page 39Linked to original sources
arXiv2022

Exploring linguistic feature and model combination for speech recognition based automatic AD detection

Early diagnosis of Alzheimer's disease (AD) is crucial in facilitating preventive care and delay progression. Speech based automatic AD screening systems provide a non-intrusive and more scalable alternative to other clinical screening techniques. Scarcity of such specialist data leads to uncertainty in both model selection and feature learning when developing such systems. To this end, this paper investigates the use of feature and model combination approaches to improve the robustness of domain fine-tuning of BERT and Roberta pre-trained text encoders on limited data, before the resulting embedding features being fed into an ensemble of backend classifiers to produce the final AD detection decision via majority voting. Experiments conducted on the ADReSS20 Challenge dataset suggest consistent performance improvements were obtained using model and feature combination in system development. State-of-the-art AD detection accuracies of 91.67 percent and 93.75 percent were obtained using manual and ASR speech transcripts respectively on the ADReSS20 test set consisting of 48 elderly speakers.

cs.LG↗
arXiv2022

The Yamabe flow on asymptotically Euclidean manifolds with nonpositive Yamabe constant

We study the Yamabe flow on asymptotically flat manifolds with non-positive Yamabe constant $Y\leq 0$. Previous work by the second and third named authors \cite{ChenWang} showed that while the Yamabe flow always converges in a global weighted sense when $Y>0$, the flow must diverge when $Y\leq 0$. We show here in the $Y\leq 0$ case however that after suitable rescalings, the Yamabe flow starting from any asymptotically flat manifold must converge to the unique positive function which solves the Yamabe problem on a compactification of the original manifold.

math.DG↗
arXiv2022

First report of a solar energetic particle event observed by China's Tianwen-1 mission in transit to Mars

Solar energetic particles (SEPs) associated with flares and/or coronal mass ejection (CME)-driven shocks can impose acute radiation hazards to space explorations. To measure energetic particles in near-Mars space, the Mars Energetic Particle Analyzer (MEPA) instrument onboard China's Tianwen-1 (TW-1) mission was designed. Here, we report the first MEPA measurements of the widespread SEP event occurring on 29 November 2020 when TW-1 was in transit to Mars. This event occurred when TW-1 and Earth were magnetically well connected, known as the Hohmann-Parker effect, thus offering a rare opportunity to understand the underlying particle acceleration and transport process. Measurements from TW-1 and near-Earth spacecraft show similar double-power-law spectra and a radial dependence of the SEP peak intensities. Moreover, the decay phases of the time-intensity profiles at different locations clearly show the reservoir effect. We conclude that the double-power-law spectrum is likely generated at the acceleration site, and that a small but finite cross-field diffusion is crucial to understand the formation of the SEP reservoir phenomenon. These results provide insight into particle acceleration and transport associated with CME-driven shocks, which may contribute to the improvement of relevant physical models.

astro-ph.SR↗
arXiv2022

Weakly-supervised Part-Attention and Mentored Networks for Vehicle Re-Identification

Vehicle re-identification (Re-ID) aims to retrieve images with the same vehicle ID across different cameras. Current part-level feature learning methods typically detect vehicle parts via uniform division, outside tools, or attention modeling. However, such part features often require expensive additional annotations and cause sub-optimal performance in case of unreliable part mask predictions. In this paper, we propose a weakly-supervised Part-Attention Network (PANet) and Part-Mentored Network (PMNet) for Vehicle Re-ID. Firstly, PANet localizes vehicle parts via part-relevant channel recalibration and cluster-based mask generation without vehicle part supervisory information. Secondly, PMNet leverages teacher-student guided learning to distill vehicle part-specific features from PANet and performs multi-scale global-part feature extraction. During inference, PMNet can adaptively extract discriminative part features without part localization by PANet, preventing unstable part mask predictions. We address this Re-ID issue as a multi-task problem and adopt Homoscedastic Uncertainty to learn the optimal weighing of ID losses. Experiments are conducted on two public benchmarks, showing that our approach outperforms recent methods, which require no extra annotations by an average increase of 3.0% in CMC@5 on VehicleID and over 1.4% in mAP on VeRi776. Moreover, our method can extend to the occluded vehicle Re-ID task and exhibits good generalization ability.

cs.CV↗
arXiv2022

Cutting Rule for Cosmological Collider Signals: A Bulk Evolution Perspective

We show that the evolution of interacting massive particles in the de Sitter bulk can be understood at leading order as a series of resonant decay and production events. From this perspective, we classify the cosmological collider signals into local and nonlocal categories with drastically different physical origins. This further allows us to derive a cutting rule for efficiently extracting these cosmological collider signals in an analytical fashion. Our cutting rule is a practical way for extracting cosmological collider signals in model building, and can be readily implemented as symbolic computational packages in the future.

hep-th↗
arXiv2022

MAT: Mask-Aware Transformer for Large Hole Image Inpainting

Recent studies have shown the importance of modeling long-range interactions in the inpainting problem. To achieve this goal, existing approaches exploit either standalone attention techniques or transformers, but usually under a low resolution in consideration of computational cost. In this paper, we present a novel transformer-based model for large hole inpainting, which unifies the merits of transformers and convolutions to efficiently process high-resolution images. We carefully design each component of our framework to guarantee the high fidelity and diversity of recovered images. Specifically, we customize an inpainting-oriented transformer block, where the attention module aggregates non-local information only from partial valid tokens, indicated by a dynamic mask. Extensive experiments demonstrate the state-of-the-art performance of the new model on multiple benchmark datasets. Code is released at https://github.com/fenglinglwb/MAT.

cs.CV↗
arXiv2022

1st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)

This report presents the methods of the winning entry of the RxR-Habitat Competition in CVPR 2022. The competition addresses the problem of Vision-and-Language Navigation in Continuous Environments (VLN-CE), which requires an agent to follow step-by-step natural language instructions to reach a target. We present a modular plan-and-control approach for the task. Our model consists of three modules: the candidate waypoints predictor (CWP), the history enhanced planner and the tryout controller. In each decision loop, CWP first predicts a set of candidate waypoints based on depth observations from multiple views. It can reduce the complexity of the action space and facilitate planning. Then, a history-enhanced planner is adopted to select one of the candidate waypoints as the subgoal. The planner additionally encodes historical memory to track the navigation progress, which is especially effective for long-horizon navigation. Finally, we propose a non-parametric heuristic controller named tryout to execute low-level actions to reach the planned subgoal. It is based on the trial-and-error mechanism which can help the agent to avoid obstacles and escape from getting stuck. All three modules work hierarchically until the agent stops. We further take several recent advances of Vision-and-Language Navigation (VLN) to improve the performance such as pretraining based on large-scale synthetic in-domain dataset, environment-level data augmentation and snapshot model ensemble. Our model won the RxR-Habitat Competition 2022, with 48% and 90% relative improvements over existing methods on NDTW and SR metrics respectively.

cs.CV↗
arXiv2022

Conformer Based Elderly Speech Recognition System for Alzheimer's Disease Detection

Early diagnosis of Alzheimer's disease (AD) is crucial in facilitating preventive care to delay further progression. This paper presents the development of a state-of-the-art Conformer based speech recognition system built on the DementiaBank Pitt corpus for automatic AD detection. The baseline Conformer system trained with speed perturbation and SpecAugment based data augmentation is significantly improved by incorporating a set of purposefully designed modeling features, including neural architecture search based auto-configuration of domain-specific Conformer hyper-parameters in addition to parameter fine-tuning; fine-grained elderly speaker adaptation using learning hidden unit contributions (LHUC); and two-pass cross-system rescoring based combination with hybrid TDNN systems. An overall word error rate (WER) reduction of 13.6% absolute (34.8% relative) was obtained on the evaluation data of 48 elderly speakers. Using the final systems' recognition outputs to extract textual features, the best-published speech recognition based AD detection accuracy of 91.7% was obtained.

eess.AS↗
arXiv2022

WOLONet: Wave Outlooker for Efficient and High Fidelity Speech Synthesis

Recently, GAN-based neural vocoders such as Parallel WaveGAN, MelGAN, HiFiGAN, and UnivNet have become popular due to their lightweight and parallel structure, resulting in a real-time synthesized waveform with high fidelity, even on a CPU. HiFiGAN and UnivNet are two SOTA vocoders. Despite their high quality, there is still room for improvement. In this paper, motivated by the structure of Vision Outlooker from computer vision, we adopt a similar idea and propose an effective and lightweight neural vocoder called WOLONet. In this network, we develop a novel lightweight block that uses a location-variable, channel-independent, and depthwise dynamic convolutional kernel with sinusoidally activated dynamic kernel weights. To demonstrate the effectiveness and generalizability of our method, we perform an ablation study to verify our novel design and make a subjective and objective comparison with typical GAN-based vocoders. The results show that our WOLONet achieves the best generation quality while requiring fewer parameters than the two neural SOTA vocoders, HiFiGAN and UnivNet.

cs.SD↗
arXiv2022

Self-supervised Vision Transformers for Joint SAR-optical Representation Learning

Self-supervised learning (SSL) has attracted much interest in remote sensing and earth observation due to its ability to learn task-agnostic representations without human annotation. While most of the existing SSL works in remote sensing utilize ConvNet backbones and focus on a single modality, we explore the potential of vision transformers (ViTs) for joint SAR-optical representation learning. Based on DINO, a state-of-the-art SSL algorithm that distills knowledge from two augmented views of an input image, we combine SAR and optical imagery by concatenating all channels to a unified input. Subsequently, we randomly mask out channels of one modality as a data augmentation strategy. While training, the model gets fed optical-only, SAR-only, and SAR-optical image pairs learning both inner- and intra-modality representations. Experimental results employing the BigEarthNet-MM dataset demonstrate the benefits of both, the ViT backbones and the proposed multimodal SSL algorithm DINO-MM.

cs.CV↗
arXiv2022

Monitoring Urban Forests from Auto-Generated Segmentation Maps

We present and evaluate a weakly-supervised methodology to quantify the spatio-temporal distribution of urban forests based on remotely sensed data with close-to-zero human interaction. Successfully training machine learning models for semantic segmentation typically depends on the availability of high-quality labels. We evaluate the benefit of high-resolution, three-dimensional point cloud data (LiDAR) as source of noisy labels in order to train models for the localization of trees in orthophotos. As proof of concept we sense Hurricane Sandy's impact on urban forests in Coney Island, New York City (NYC) and reference it to less impacted urban space in Brooklyn, NYC.

cs.CV↗
arXiv2022

UMSNet: An Universal Multi-sensor Network for Human Activity Recognition

Human activity recognition (HAR) based on multimodal sensors has become a rapidly growing branch of biometric recognition and artificial intelligence. However, how to fully mine multimodal time series data and effectively learn accurate behavioral features has always been a hot topic in this field. Practical applications also require a well-generalized framework that can quickly process a variety of raw sensor data and learn better feature representations. This paper proposes a universal multi-sensor network (UMSNet) for human activity recognition. In particular, we propose a new lightweight sensor residual block (called LSR block), which improves the performance by reducing the number of activation function and normalization layers, and adding inverted bottleneck structure and grouping convolution. Then, the Transformer is used to extract the relationship of series features to realize the classification and recognition of human activities. Our framework has a clear structure and can be directly applied to various types of multi-modal Time Series Classification (TSC) tasks after simple specialization. Extensive experiments show that the proposed UMSNet outperforms other state-of-the-art methods on two popular multi-sensor human activity recognition datasets (i.e. HHAR dataset and MHEALTH dataset).

cs.CV↗
arXiv2022

Ultrahigh-energy Gamma Rays and Gravitational Waves from Primordial Exotic Stellar Bubbles

We put forward a novel class of exotic celestial objects that can be produced through phase transitions occurred in the primordial Universe. These objects appear as bubbles of stellar sizes and can be dominated by primordial black holes (PBHs). We report that, due to the processes of Hawking radiation and binary evolution of PBHs inside these stellar bubbles, both electromagnetic and gravitational radiations can be emitted that are featured on the gamma-ray spectra and stochastic gravitational waves (GWs). Our results reveal that, depending on the mass distribution, the exotic stellar bubbles consisting of PBHs provide not only a decent fit for the ultrahigh-energy gamma-ray spectrum reported by the recent LHAASO experiment, but also predict GW signals that are expected to be tested by the forthcoming GW surveys.

astro-ph.CO↗
arXiv2022

Thermodynamic modeling with uncertainty quantification using the modified quasichemical model in quadruplet approximation: Implementation into PyCalphad and ESPEI

The modified quasichemical model in the quadruplet approximation (MQMQA) considers the first- and the second-nearest-neighbor coordination and interactions, particularly useful in describing short-range ordering in complex liquids such as molten salts, slag in metal processing, and electrolytic solutions. The present work implements the MQMQA into the Python based open-source software PyCalphad for thermodynamic calculations. This endeavor facilitates the development of MQMQA-based thermodynamic database with uncertainty quantification (UQ) using the open-source software ESPEI. A new database structure based on Extensible Markup Language (XML) is proposed for ESPEI evaluation of MQMQA model parameters. Using the KF-NiF2 system as an example, we demonstrate the successful implementation of MQMQA in PyCalphad through thermodynamic calculations of Gibbs energy, equilibrium quadruplet fractions, and phase diagram, as well as database development with UQ using ESPEI. The present implementation offers an open-source capability for performing CALPHAD modeling for complex liquids with short-range ordering using MQMQA.

physics.comp-ph↗
arXiv2022

Termination of Superradiance from a Binary Companion

We study the impact of a binary companion on black hole superradiance at orbital frequencies away from the gravitational-collider-physics (GCP) resonance bands. A superradiant state can couple to a strongly absorptive state via the tidal perturbation of the companion, thereby acquiring a suppressed superradiance rate. Below a critical binary separation, this superradiance rate becomes negative, and the boson cloud gets absorbed by the black hole. This critical binary separation leads to tight constraints on GCP. Especially, a companion with mass ratio $q>10^{-3}$ invalidates all GCP fine structure transitions, as well as almost all Bohr transitions except those from the $|ψ_{211}\rangle$ state. Meanwhile, the backreaction on the companion manifests itself as a torque acting on the binary, producing floating/sinking orbits that can be verified via pulsar timing. In addition, the possible termination of cloud growth may help to alleviate the current bounds on the ultralight boson mass from various null detections.

gr-qc↗
arXiv2022

Beam Training and Tracking in MmWave Communication: A Survey

Communicating on millimeter wave (mmWave) bands is ushering in a new epoch of mobile communication which provides the availability of 10 Gbps high data rate transmission. However, mmWave links are easily prone to short transmission range communication because of the serious free space path loss and the blockage by obstacles. To overcome these challenges, highly directional beams are exploited to achieve robust links by hybrid beamforming. Accurately aligning the transmitter and receiver beams, i.e. beam training, is vitally important to high data rate transmission. However, it may cause huge overhead which has negative effects on initial access, handover, and tracking. Besides, the mobility patterns of users are complicated and dynamic, which may cause tracking error and large tracking latency. An efficient beam tracking method has a positive effect on sustaining robust links. This article provides an overview of the beam training and tracking technologies on mmWave bands and reveals the insights for future research in the 6th Generation (6G) mobile network. Especially, some open research problems are proposed to realize fast, accurate, and robust beam training and tracking. We hope that this survey provides guidelines for the researchers in the area of mmWave communications.

eess.SP↗
arXiv2022

Long-run User Value Optimization in Recommender Systems through Content Creation Modeling

Content recommender systems are generally adept at maximizing immediate user satisfaction but to optimize for the \textit{long-run} user value, we need more statistically sophisticated solutions than off-the-shelf simple recommender algorithms. In this paper we lay out such a solution to optimize \textit{long-run} user value through discounted utility maximization and a machine learning method we have developed for estimating it. Our method estimates which content producers are most likely to create the highest long-run user value if their content is shown more to users who enjoy it in the present. We do this estimation with the help of an A/B test and heterogeneous effects machine learning model. We have used such models in Facebook's feed ranking system, and such a model can be used in other recommender systems.

cs.IR↗