arXiv subjects

Yi Wang

Publications and source records attributed to Yi Wang.

At least 523 records · Page 29Linked to original sources

arXiv2024

MARS: Mixture of Auto-Regressive Models for Fine-grained Text-to-image Synthesis

Auto-regressive models have made significant progress in the realm of language generation, yet they do not perform on par with diffusion models in the domain of image synthesis. In this work, we introduce MARS, a novel framework for T2I generation that incorporates a specially designed Semantic Vision-Language Integration Expert (SemVIE). This innovative component integrates pre-trained LLMs by independently processing linguistic and visual information, freezing the textual component while fine-tuning the visual component. This methodology preserves the NLP capabilities of LLMs while imbuing them with exceptional visual understanding. Building upon the powerful base of the pre-trained Qwen-7B, MARS stands out with its bilingual generative capabilities corresponding to both English and Chinese language prompts and the capacity for joint image and text generation. The flexibility of this framework lends itself to migration towards any-to-any task adaptability. Furthermore, MARS employs a multi-stage training strategy that first establishes robust image-text alignment through complementary bidirectional tasks and subsequently concentrates on refining the T2I generation process, significantly augmenting text-image synchrony and the granularity of image details. Notably, MARS requires only 9% of the GPU days needed by SD1.5, yet it achieves remarkable results across a variety of benchmarks, illustrating the training efficiency and the potential for swift deployment in various applications.

cs.CV↗

arXiv2024

Temperature-Dependent Photoluminescence of PEDOT:PSS for use as Transparent Electrodes in the DarkSide-20k Time Projection Chamber

Dual-phase time-projection chambers (TPCs) filled with noble elements are used for particle detection, with many focusing on rare-event searches. These detectors measure two signals: one from scintillation light, and another from drifting ionized electrons. The DarkSide-20k design uses a transparent vessel with external photodetectors. Electrodes, used to drift the electrons, are located between the active medium and the photodetectors, requiring them to be transparent to allow scintillation light to transmit through them. The transparent electrode coating for DarkSide-20k is poly(3,4-ethylenedioxythiophene) poly(styrene sulfonate) (PEDOT:PSS) or Clevios. For rare-event search detectors, the fluorescence of materials that are between the active volume and the photodetectors may lead to backgrounds in the data. Since Clevios is a new material for TPC electrodes, its fluorescent properties need to be characterized to understand their potential impact on backgrounds. Previous studies have indicated that Clevios can fluoresce, with maximal fluorescence produced using UV-excitation. Our study analyzes the fluorescence of Clevios, under UV-excitation, using both time-resolved and spectral techniques between 4 K and 300 K. We find that the fluorescence of Clevios is negligible when compared to the fluorescence of common fluorescent materials used in TPCs, such as 1,1,4,4-tetraphenyl-1,3-butadiene (TPB).

physics.ins-det↗

arXiv2024

Thermal and mechanical study of a parametrised cryostat model for optical characterisation of upcoming CMB experiments

Current and future experiments observing the cosmic microwave background require a detailed understanding of optical performance at cryogenic temperatures. Pre-deployment analysis of optics can be performed in custom-engineered cryogenic test beds, such as Mod-Cam, a first light camera for the CCAT project. This work presents studies of the mechanical and thermal performance of CryoSim, a model of a generic cylindrical 4-K cryostat cooled with a commercial pulse tube cryocooler that can be used to characterise optical components and full reimaging optical systems. CryoSim is extensively parametrised, allowing the joint analysis and optimisation of mechanical and thermal performance via finite element methods. Results from this model are validated against measured cooldown data of the Mod-Cam cryostat. Due to the extensive parametrisation of the model, significant modifications of the cryostat geometry may be implemented to be representative of any system the scientific community may desire, and validation of thermal and mechanical performance can be carried out rapidly.

astro-ph.IM↗

arXiv2024

Spectral Methods for Matrix Product Factorization

A graph $G$ is factored into graphs $H$ and $K$ via a matrix product if there exist adjacency matrices $A$, $B$, and $C$ of $G$, $H$, and $K$, respectively, such that $A = BC$. In this paper, we study the spectral aspects of the matrix product of graphs, including regularity, bipartiteness, and connectivity. We show that if a graph $G$ is factored into a connected graph $H$ and a graph $K$ with no isolated vertices, then certain properties hold. If $H$ is non-bipartite, then $G$ is connected. If $H$ is bipartite and $G$ is not connected, then $K$ is a regular bipartite graph, and consequently, $n$ is even. Furthermore, we show that trees are not factorizable, which answers a question posed by Maghsoudi et al.

math.CO↗

arXiv2024

Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognition

Self-supervised learning (SSL) based speech foundation models have been applied to a wide range of ASR tasks. However, their application to dysarthric and elderly speech via data-intensive parameter fine-tuning is confronted by in-domain data scarcity and mismatch. To this end, this paper explores a series of approaches to integrate domain fine-tuned SSL pre-trained models and their features into TDNN and Conformer ASR systems for dysarthric and elderly speech recognition. These include: a) input feature fusion between standard acoustic frontends and domain fine-tuned SSL speech representations; b) frame-level joint decoding between TDNN systems separately trained using standard acoustic features alone and those with additional domain fine-tuned SSL features; and c) multi-pass decoding involving the TDNN/Conformer system outputs to be rescored using domain fine-tuned pre-trained ASR models. In addition, fine-tuned SSL speech features are used in acoustic-to-articulatory (A2A) inversion to construct multi-modal ASR systems. Experiments are conducted on four tasks: the English UASpeech and TORGO dysarthric speech corpora; and the English DementiaBank Pitt and Cantonese JCCOCC MoCA elderly speech datasets. The TDNN systems constructed by integrating domain-adapted HuBERT, wav2vec2-conformer or multi-lingual XLSR models and their features consistently outperform the standalone fine-tuned SSL pre-trained models. These systems produced statistically significant WER or CER reductions of 6.53%, 1.90%, 2.04% and 7.97% absolute (24.10%, 23.84%, 10.14% and 31.39% relative) on the four tasks respectively. Consistent improvements in Alzheimer's Disease detection accuracy are also obtained using the DementiaBank Pitt elderly speech recognition outputs.

eess.AS↗

arXiv2024

Properties of the QCD Matter -- An Experimental Review of Selected Results from RHIC BES Program

In the paper, we discuss the development of the multi-gap resistive plate chamber Time-of-Flight (TOF) technology and the production of the STAR TOF detector in China at the beginning of the 21st century. Then we review recent experimental results from the first beam energy scan program (BES-I) at the Relativistic Heavy Ion Collider (RHIC). Topics cover measurements of collectivity, chirality, criticality, global polarization, strangeness, heavy-flavor, di-lepton and light nuclei productions.

nucl-ex↗

arXiv2024

Machine Learning with Real-time and Small Footprint Anomaly Detection System for In-Vehicle Gateway

Anomaly Detection System (ADS) is an essential part of a modern gateway Electronic Control Unit (ECU) to detect abnormal behaviors and attacks in vehicles. Among the existing attacks, ``one-time`` attack is the most challenging to be detected, together with the strict gateway ECU constraints of both microsecond or even nanosecond level real-time budget and limited footprint of code. To address the challenges, we propose to use the self-information theory to generate values for training and testing models, aiming to achieve real-time detection performance for the ``one-time`` attack that has not been well studied in the past. Second, the generation of self-information is based on logarithm calculation, which leads to the smallest footprint to reduce the cost in Gateway. Finally, our proposed method uses an unsupervised model without the need of training data for anomalies or attacks. We have compared different machine learning methods ranging from typical machine learning models to deep learning models, e.g., Hidden Markov Model (HMM), Support Vector Data Description (SVDD), and Long Short Term Memory (LSTM). Experimental results show that our proposed method achieves 8.7 times lower False Positive Rate (FPR), 1.77 times faster testing time, and 4.88 times smaller footprint.

cs.CR↗

arXiv2024

Why are non-radial solar eruptions less frequent than radial ones?

Coronal mass ejections from the Sun are not always initiated along a radial trajectory; such non-radial eruptions are well known to be caused by the asymmetry of the pre-eruption magnetic configuration, which is primarily determined by the uneven distribution of magnetic flux at the photosphere. Therefore, it is naturally expected that the non-radial eruptions should be rather common, at least as frequent as radial ones, given the typically asymmetrical nature of photospheric magnetic flux. However, statistical studies have shown that only a small fraction of eruptions display non-radial behavior. Here we aim to shed light on this counterintuitive fact, based on a series of numerical simulations of eruption initiation in bipolar fields with different asymmetric flux distributions. As the asymmetry of the flux distribution increases, the eruption direction tends to deviate further away from the radial path, accompanied by a decrease in eruption intensity. In case of too strong asymmetry, no eruption is triggered, indicating that excessively inclined eruptions cannot occur. Therefore, our simulations suggest that asymmetry plays a negative role in producing eruption, potentially explaining the lesser frequency of non-radial solar eruptions compared to radial ones. With increasing asymmetry, the degree of non-potentiality the field can attain is reduced. Consequently, the intensity of the pre-eruption current sheet decreases, and reconnection becomes less efficient, resulting in weaker eruptions.

astro-ph.SR↗

arXiv2024

Towards Multi-modality Fusion and Prototype-based Feature Refinement for Clinically Significant Prostate Cancer Classification in Transrectal Ultrasound

Prostate cancer is a highly prevalent cancer and ranks as the second leading cause of cancer-related deaths in men globally. Recently, the utilization of multi-modality transrectal ultrasound (TRUS) has gained significant traction as a valuable technique for guiding prostate biopsies. In this study, we propose a novel learning framework for clinically significant prostate cancer (csPCa) classification using multi-modality TRUS. The proposed framework employs two separate 3D ResNet-50 to extract distinctive features from B-mode and shear wave elastography (SWE). Additionally, an attention module is incorporated to effectively refine B-mode features and aggregate the extracted features from both modalities. Furthermore, we utilize few shot segmentation task to enhance the capacity of classification encoder. Due to the limited availability of csPCa masks, a prototype correction module is employed to extract representative prototypes of csPCa. The performance of the framework is assessed on a large-scale dataset consisting of 512 TRUS videos with biopsy-proved prostate cancer. The results demonstrate the strong capability in accurately identifying csPCa, achieving an area under the curve (AUC) of 0.86. Moreover, the framework generates visual class activation mapping (CAM), which can serve as valuable assistance for localizing csPCa. These CAM images may offer valuable guidance during TRUS-guided targeted biopsies, enhancing the efficacy of the biopsy procedure.The code is available at https://github.com/2313595986/SmileCode.

eess.IV↗

arXiv2024

Symmetric Multi-Similarity Loss for EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2024

In this report, we present our champion solution for EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge in CVPR 2024. Essentially, this challenge differs from traditional visual-text retrieval tasks by providing a correlation matrix that acts as a set of soft labels for video-text clip combinations. However, existing loss functions have not fully exploited this information. Motivated by this, we propose a novel loss function, Symmetric Multi-Similarity Loss, which offers a more precise learning objective. Together with tricks and ensemble learning, the model achieves 63.76% average mAP and 74.25% average nDCG on the public leaderboard, demonstrating the effectiveness of our approach. Our code will be released at: https://github.com/xqwang14/SMS-Loss/tree/main

cs.CV↗

arXiv2024

Encoding Matching Criteria for Cross-domain Deformable Image Registration

Most existing deep learning-based registration methods are trained on single-type images to address same-domain tasks.However, cross-domain deformable registration remains challenging.We argue that the tailor-made matching criteria in traditional registration methods is one of the main reason they are applicable in different domains.Motivated by this, we devise a registration-oriented encoder to model the matching criteria of image features and structural features, which is beneficial to boost registration accuracy and adaptability.Specifically, a general feature encoder (Encoder-G) is proposed to capture comprehensive medical image features, while a structural feature encoder (Encoder-S) is designed to encode the structural self-similarity into the global representation.Extensive experiments on images from three different domains prove the efficacy of the proposed method. Moreover, by updating Encoder-S using one-shot learning, our method can effectively adapt to different domains.The code is publicly available at https://github.com/JuliusWang-7/EncoderReg.

cs.CV↗

arXiv2024

A Topological Drive for Spacetime Travel

We present a toy metric of spacetime travel from topological change. A bubble-like baby universe is detached and re-attached from our universe. Depending on where the bubble is re-attached, matter may travel superluminally or backwards-in-time through the bubble. Quasiregular singularities are formed at the detachment and re-attachment spacetime points. The spacetime is traversable and not covered by any horizons. Exotic matter violating energy conditions is required to realize such spacetimes.

gr-qc↗

arXiv2024

Data Caching for Enterprise-Grade Petabyte-Scale OLAP

With the exponential growth of data and evolving use cases, petabyte-scale OLAP data platforms are increasingly adopting a model that decouples compute from storage. This shift, evident in organizations like Uber and Meta, introduces operational challenges including massive, read-heavy I/O traffic with potential throttling, as well as skewed and fragmented data access patterns. Addressing these challenges, this paper introduces the Alluxio local (edge) cache, a highly effective architectural optimization tailored for such environments. This embeddable cache, optimized for petabyte-scale data analytics, leverages local SSD resources to alleviate network I/O and API call pressures, significantly improving data transfer efficiency. Integrated with OLAP systems like Presto and storage services like HDFS, the Alluxio local cache has demonstrated its effectiveness in handling large-scale, enterprise-grade workloads over three years of deployment at Uber and Meta. We share insights and operational experiences in implementing these optimizations, providing valuable perspectives on managing modern, massive-scale OLAP workloads.

cs.DC↗

arXiv2024

Data-driven Power Flow Linearization: Simulation

Building on the theoretical insights of Part I, this paper, as the second part of the tutorial, dives deeper into data-driven power flow linearization (DPFL), focusing on comprehensive numerical testing. The necessity of these simulations stems from the theoretical analysis's inherent limitations, particularly the challenge of identifying the differences in real-world performance among DPFL methods with overlapping theoretical capabilities and/or limitations. The absence of a comprehensive numerical comparison of DPFL approaches in the literature also motivates this paper, especially given the fact that over 95% of existing DPFL studies have not provided any open-source codes. To bridge the gap, this paper first reviews existing DPFL experiments, examining the adopted test scenarios, load fluctuation settings, data sources, considerations for data noise/outliers, and the comparison made so far. Subsequently, this paper evaluates a total of 44 methods, containing over 30 existing DPFL approaches, some innovative DPFL techniques, and several classic physics-driven power flow linearization methods for benchmarking. The evaluation spans various dimensions, including generalizability, applicability, accuracy, and computational efficiency, using various different test cases scaling from 9-bus to 1354-bus systems. The numerical analysis identifies and examines significant trends and consistent findings across all methods under various test cases. It also offers theoretical insights into phenomena like under-performance, failure, excessive computation times, etc. Overall, this paper identifies the differences in the performances of the wide range of DPFL methods, reveals gaps not evident from theoretical discussions, assists in method selection for real-world applications, and provides thorough discussions on open questions within DPFL research, indicating ten potential future directions.

eess.SY↗

arXiv2024

Data-driven Power Flow Linearization: Theory

This two-part tutorial dives into the field of data-driven power flow linearization (DPFL), a domain gaining increased attention. DPFL stands out for its higher approximation accuracy, wide adaptability, and better ability to implicitly incorporate the latest system attributes. This renders DPFL a potentially superior option for managing the significant fluctuations from renewable energy sources, a step towards realizing a more sustainable energy future, by translating the higher model accuracy into increased economic efficiency and less energy losses. To conduct a deep and rigorous reexamination, this tutorial first classifies existing DPFL methods into DPFL training algorithms and supportive techniques. Their mathematical models, analytical solutions, capabilities, limitations, and generalizability are systematically examined, discussed, and summarized. In addition, this tutorial reviews existing DPFL experiments, examining the settings of test systems, the fidelity of datasets, and the comparison made among a limited number of DPFL methods. Further, this tutorial implements extensive numerical comparisons of all existing DPFL methods (40 methods in total) and four classic physics-driven approaches, focusing on their generalizability, applicability, accuracy, and computational efficiency. Through these simulationmethodss, this tutorial aims to reveal the actual performance of all the methods (including the performances exposed to data noise or outliers), guiding the selection of appropriate linearization methods. Furthermore, this tutorial discusses future directions based on the theoretical and numerical insights gained. As the first part, this paper reexamines DPFL theories, covering all the training algorithms and supportive techniques. Capabilities, limitations, and aspects of generalizability, which were previously unmentioned in the literature, have been identified.

cs.LG↗

arXiv2024

BCS in the Sky: Signatures of Inflationary Fermion Condensation

We consider a Bardeen-Cooper-Schrieffer (BCS)-like model in the inflationary background. We show that with an axial chemical potential, the attractive quartic fermion self-interaction can lead to a BCS-like condensation. In the rigid-de Sitter (dS) limit of inflation where backreaction from the inflaton and graviton is neglected, we perform the first computation of the non-perturbative effective potential that includes the full spacetime curvature effects in the presence of the chemical potential, subject to the mean-field approximation whose validity has been checked via the Ginzburg criterion. The corresponding BCS phase transition is always first-order, when the varying Hubble is interpreted as an effective Gibbons-Hawking temperature of dS spacetime. In the condensed phase, the theory can be understood from UV and IR sides as fermionic and bosonic, respectively. This leads to distinctive signatures in the primordial non-Gaussianity of curvature perturbations. Namely, the oscillatory cosmological collider signal is smoothly turned off at a finite momentum ratio, since different momentum ratios effectively probe different energy scales. In addition, such BCS phase transitions can also source stochastic gravitational waves, which are feasible for future experiments.

hep-th↗

arXiv2024

Learning to Maximize Mutual Information for Chain-of-Thought Distillation

Knowledge distillation, the technique of transferring knowledge from large, complex models to smaller ones, marks a pivotal step towards efficient AI deployment. Distilling Step-by-Step~(DSS), a novel method utilizing chain-of-thought~(CoT) distillation, has demonstrated promise by imbuing smaller models with the superior reasoning capabilities of their larger counterparts. In DSS, the distilled model acquires the ability to generate rationales and predict labels concurrently through a multi-task learning framework. However, DSS overlooks the intrinsic relationship between the two training tasks, leading to ineffective integration of CoT knowledge with the task of label prediction. To this end, we investigate the mutual relationship of the two tasks from Information Bottleneck perspective and formulate it as maximizing the mutual information of the representation features of the two tasks. We propose a variational approach to solve this optimization problem using a learning-based method. Our experimental results across four datasets demonstrate that our method outperforms the state-of-the-art DSS. Our findings offer insightful guidance for future research on language model distillation as well as applications involving CoT. Codes are available at \url{https://github.com/xinchen9/cot_distillation_ACL2024}.

cs.CL↗

arXiv2024

Task Specific Pretraining with Noisy Labels for Remote Sensing Image Segmentation

Compared to supervised deep learning, self-supervision provides remote sensing a tool to reduce the amount of exact, human-crafted geospatial annotations. While image-level information for unsupervised pretraining efficiently works for various classification downstream tasks, the performance on pixel-level semantic segmentation lags behind in terms of model accuracy. On the contrary, many easily available label sources (e.g., automatic labeling tools and land cover land use products) exist, which can provide a large amount of noisy labels for segmentation model training. In this work, we propose to exploit noisy semantic segmentation maps for model pretraining. Our experiments provide insights on robustness per network layer. The transfer learning settings test the cases when the pretrained encoders are fine-tuned for different label classes and decoders. The results from two datasets indicate the effectiveness of task-specific supervised pretraining with noisy labels. Our findings pave new avenues to improved model accuracy and novel pretraining strategies for efficient remote sensing image segmentation.

cs.CV↗