arXiv subjects

Yue Zhao

Publications and source records attributed to Yue Zhao.

At least 253 records · Page 14Linked to original sources

arXiv2024

Stability for an inverse random source problem of the biharmonic Schrodinger equation

In this paper, we study the inverse random source scattering problem for the biharmonic Schrodinger equation in two and three dimensions. The driven source is assumed to be a generalized microlocally isotropic Gaussian random function whose covariance operator is a classical pseudodifferential operator. We examine the meromorphic continuation and estimates for the resolvent of the biharmonic Schrodinger operator with respect to complex frequencies, which yields the well-posedness of the direct problem and a Born series expansion for the solution. For the inverse problem, we present quantitative stability estimates in determining the micro-correlation strength of the random source by using the correlation far-field data at multiple frequencies. The key ingredient in the analysis is employing scattering theory to obtain the analytic domain and an upper bound for the resolvent of the biharmonic Schrodinger operator and applying a quantitative analytic continuation principle in complex theory. The analysis only requires data in a finite interval of frequencies.

math.AP↗

arXiv2024

Towards Secure and Private AI: A Framework for Decentralized Inference

The rapid advancement of ML models in critical sectors such as healthcare, finance, and security has intensified the need for robust data security, model integrity, and reliable outputs. Large multimodal foundational models, while crucial for complex tasks, present challenges in scalability, reliability, and potential misuse. Decentralized systems offer a solution by distributing workload and mitigating central points of failure, but they introduce risks of unauthorized access to sensitive data across nodes. We address these challenges with a comprehensive framework designed for responsible AI development. Our approach incorporates: 1) Zero-knowledge proofs for secure model verification, enhancing trust without compromising privacy. 2) Consensus-based verification checks to ensure consistent outputs across nodes, mitigating hallucinations and maintaining model integrity. 3) Split Learning techniques that segment models across different nodes, preserving data privacy by preventing full data access at any point. 4) Hardware-based security through trusted execution environments (TEEs) to protect data and computations. This framework aims to enhance security and privacy and improve the reliability and fairness of multimodal AI systems. Promoting efficient resource utilization contributes to more sustainable AI development. Our state-of-the-art proofs and principles demonstrate the framework's effectiveness in responsibly democratizing artificial intelligence, offering a promising approach for building secure and private foundational models.

cs.CR↗

arXiv2024

PyOD 2: A Python Library for Outlier Detection with LLM-powered Model Selection

Outlier detection (OD), also known as anomaly detection, is a critical machine learning (ML) task with applications in fraud detection, network intrusion detection, clickstream analysis, recommendation systems, and social network moderation. Among open-source libraries for outlier detection, the Python Outlier Detection (PyOD) library is the most widely adopted, with over 8,500 GitHub stars, 25 million downloads, and diverse industry usage. However, PyOD currently faces three limitations: (1) insufficient coverage of modern deep learning algorithms, (2) fragmented implementations across PyTorch and TensorFlow, and (3) no automated model selection, making it hard for non-experts. To address these issues, we present PyOD Version 2 (PyOD 2), which integrates 12 state-of-the-art deep learning models into a unified PyTorch framework and introduces a large language model (LLM)-based pipeline for automated OD model selection. These improvements simplify OD workflows, provide access to 45 algorithms, and deliver robust performance on various datasets. In this paper, we demonstrate how PyOD 2 streamlines the deployment and automation of OD models and sets a new standard in both research and industry. PyOD 2 is accessible at [https://github.com/yzhao062/pyod](https://github.com/yzhao062/pyod). This study aligns with the Web Mining and Content Analysis track, addressing topics such as the robustness of Web mining methods and the quality of algorithmically-generated Web data.

cs.LG↗

arXiv2024

Political-LLM: Large Language Models in Political Science

In recent years, large language models (LLMs) have been widely adopted in political science tasks such as election prediction, sentiment analysis, policy impact assessment, and misinformation detection. Meanwhile, the need to systematically understand how LLMs can further revolutionize the field also becomes urgent. In this work, we--a multidisciplinary team of researchers spanning computer science and political science--present the first principled framework termed Political-LLM to advance the comprehensive understanding of integrating LLMs into computational political science. Specifically, we first introduce a fundamental taxonomy classifying the existing explorations into two perspectives: political science and computational methodologies. In particular, from the political science perspective, we highlight the role of LLMs in automating predictive and generative tasks, simulating behavior dynamics, and improving causal inference through tools like counterfactual generation; from a computational perspective, we introduce advancements in data preparation, fine-tuning, and evaluation methods for LLMs that are tailored to political contexts. We identify key challenges and future directions, emphasizing the development of domain-specific datasets, addressing issues of bias and fairness, incorporating human expertise, and redefining evaluation criteria to align with the unique requirements of computational political science. Political-LLM seeks to serve as a guidebook for researchers to foster an informed, ethical, and impactful use of Artificial Intelligence in political science. Our online resource is available at: http://political-llm.org/.

cs.CL↗

arXiv2024

Identifying an acoustic source in a two-layered medium from multi-frequency phased or phaseless far-field patterns

This paper presents a method for reconstructing an acoustic source located in a two-layered medium from multi-frequency phased or phaseless far-field patterns measured on the upper hemisphere. The interface between the two media is assumed to be flat and infinite, while the source is buried in the lower half-space. In the phased case, a Fourier method is proposed to identify the source based on far-field measurements. This method assumes that the source is compactly supported and can be represented by a sum of Fourier basis functions. By utilizing the far-field patterns at different frequencies, the Fourier coefficients of the source can be determined, allowing for its reconstruction. For the case where phase information is unavailable, a phase retrieval formula is developed to retrieve the phase information. This formula exploits the fact that the far-field patterns are related to the source through a linear operator that preserves phase information. By developing a suitable phase retrieval algorithm, the phase information can be recovered. Once the phase is retrieved, the Fourier method can be adopted to recover the source function. Numerical experiments in two and three dimensions are conducted to validate the performance of the proposed methods.

math.NA↗

arXiv2024

Recovering the sources in the stochastic wave equations from multi-frequency far-field patterns

This paper concerns the inverse source scattering problems of recovering random sources for acoustic and elastic waves. The underlying sources are assumed to be random functions driven by an additive white noise. The inversion process aims to find the essential statistical characteristics of the mean and variance from the radiated random wave field at multiple frequencies. To this end, we propose a non-iterative algorithm by approximating the mean and variance via the truncated Fourier series. Then, the Fourier coefficients can be explicitly evaluated by sparse far-field measurements, resulting in an easy-to-implement and efficient approach for the reconstruction. Demonstrations with extensive numerical results are presented to corroborate the feasibility and robustness of the proposed method.

math.NA↗

arXiv2024

Personalized Multimodal Large Language Models: A Survey

Multimodal Large Language Models (MLLMs) have become increasingly important due to their state-of-the-art performance and ability to integrate multiple data modalities, such as text, images, and audio, to perform complex tasks with high accuracy. This paper presents a comprehensive survey on personalized multimodal large language models, focusing on their architecture, training methods, and applications. We propose an intuitive taxonomy for categorizing the techniques used to personalize MLLMs to individual users, and discuss the techniques accordingly. Furthermore, we discuss how such techniques can be combined or adapted when appropriate, highlighting their advantages and underlying rationale. We also provide a succinct summary of personalization tasks investigated in existing research, along with the evaluation metrics commonly used. Additionally, we summarize the datasets that are useful for benchmarking personalized MLLMs. Finally, we outline critical open challenges. This survey aims to serve as a valuable resource for researchers and practitioners seeking to understand and advance the development of personalized multimodal large language models.

cs.CV↗

arXiv2024

GenoCraft: A Comprehensive, User-Friendly Web-Based Platform for High-Throughput Omics Data Analysis and Visualization

The surge in high-throughput omics data has reshaped the landscape of biological research, underlining the need for powerful, user-friendly data analysis and interpretation tools. This paper presents GenoCraft, a web-based comprehensive software solution designed to handle the entire pipeline of omics data processing. GenoCraft offers a unified platform featuring advanced bioinformatics tools, covering all aspects of omics data analysis. It encompasses a range of functionalities, such as normalization, quality control, differential analysis, network analysis, pathway analysis, and diverse visualization techniques. This software makes state-of-the-art omics data analysis more accessible to a wider range of users. With GenoCraft, researchers and data scientists have access to an array of cutting-edge bioinformatics tools under a user-friendly interface, making it a valuable resource for managing and analyzing large-scale omics data. The API with an interactive web interface is publicly available at https://genocraft.stanford. edu/. We also release all the codes in https://github.com/futianfan/GenoCraft.

q-bio.GN↗

arXiv2024

DPU: Dynamic Prototype Updating for Multimodal Out-of-Distribution Detection

Out-of-distribution (OOD) detection is essential for ensuring the robustness of machine learning models by identifying samples that deviate from the training distribution. While traditional OOD detection has primarily focused on single-modality inputs, such as images, recent advances in multimodal models have demonstrated the potential of leveraging multiple modalities (e.g., video, optical flow, audio) to enhance detection performance. However, existing methods often overlook intra-class variability within in-distribution (ID) data, assuming that samples of the same class are perfectly cohesive and consistent. This assumption can lead to performance degradation, especially when prediction discrepancies are uniformly amplified across all samples. To address this issue, we propose Dynamic Prototype Updating (DPU), a novel plug-and-play framework for multimodal OOD detection that accounts for intra-class variations. Our method dynamically updates class center representations for each class by measuring the variance of similar samples within each batch, enabling adaptive adjustments. This approach allows us to amplify prediction discrepancies based on the updated class centers, thereby improving the model's robustness and generalization across different modalities. Extensive experiments on two tasks, five datasets, and nine base OOD algorithms demonstrate that DPU significantly improves OOD detection performance, setting a new state-of-the-art in multimodal OOD detection, with improvements of up to 80 percent in Far-OOD detection. To facilitate accessibility and reproducibility, our code is publicly available on GitHub.

cs.CV↗

arXiv2024

Variance-reduced random batch Langevin dynamics

The random batch method is advantageous in accelerating force calculations in particle simulations, but it poses a challenge of removing the artificial heating effect in application to the Langevin dynamics. We develop an approach to solve this issue by estimating the force variance, resulting in a variance-reduced random batch Langevin dynamics. Theoretical analysis shows the high-order local truncation error of the time step in the numerical discretization scheme, in consistent with the fluctuation-dissipation theorem. Numerical results indicate that the method can achieve a significant variance reduction since a smaller batch size provides accurate approximation, demonstrating the attractive feature of the variance-reduced random batch method for Langevin dynamics.

physics.comp-ph↗

arXiv2024

Meta-Learning for Speeding Up Large Model Inference in Decentralized Environments

The deployment of large-scale models, such as large language models (LLMs) and sophisticated image generation systems, incurs substantial costs due to their computational demands. To mitigate these costs and address challenges related to scalability and data security, there is a growing shift towards decentralized systems for deploying such models. In these decentralized environments, efficient inference acceleration becomes crucial to manage computational resources effectively and enhance system responsiveness. In this work, we address the challenge of selecting optimal acceleration methods in decentralized systems by introducing a meta-learning-based framework. This framework automates the selection process by learning from historical performance data of various acceleration techniques across different tasks. Unlike traditional methods that rely on random selection or expert intuition, our approach systematically identifies the best acceleration strategies based on the specific characteristics of each task. We demonstrate that our meta-learning framework not only streamlines the decision-making process but also consistently outperforms conventional methods in terms of efficiency and performance. Our results highlight the potential of meta-learning to revolutionize inference acceleration in decentralized AI systems, offering a path towards more democratic and economically feasible artificial intelligence solutions.

cs.LG↗

arXiv2024

MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalities

Detecting out-of-distribution (OOD) samples is important for deploying machine learning models in safety-critical applications such as autonomous driving and robot-assisted surgery. Existing research has mainly focused on unimodal scenarios on image data. However, real-world applications are inherently multimodal, which makes it essential to leverage information from multiple modalities to enhance the efficacy of OOD detection. To establish a foundation for more realistic Multimodal OOD Detection, we introduce the first-of-its-kind benchmark, MultiOOD, characterized by diverse dataset sizes and varying modality combinations. We first evaluate existing unimodal OOD detection algorithms on MultiOOD, observing that the mere inclusion of additional modalities yields substantial improvements. This underscores the importance of utilizing multiple modalities for OOD detection. Based on the observation of Modality Prediction Discrepancy between in-distribution (ID) and OOD data, and its strong correlation with OOD performance, we propose the Agree-to-Disagree (A2D) algorithm to encourage such discrepancy during training. Moreover, we introduce a novel outlier synthesis method, NP-Mix, which explores broader feature spaces by leveraging the information from nearest neighbor classes and complements A2D to strengthen OOD detection performance. Extensive experiments on MultiOOD demonstrate that training with A2D and NP-Mix improves existing OOD detection algorithms by a large margin. Our source code and MultiOOD benchmark are available at https://github.com/donghao51/MultiOOD.

cs.CV↗

arXiv2024

Dark Photon Dark Matter and Low-Frequency Gravitational Wave Detection with Gaia-like Astrometry

Astrometric surveys offer us a method to search for elusive cosmic signatures, such as ultralight dark photon dark matter and gravitational waves, by observing the deflection to the apparent positions of the stars. The detection capabilities of such surveys rapidly decrease at low frequencies, because the signals become hardly distinguishable from the background motion of stars. In this work, we find that the background motion can be well described by a linear model over time, based on which we propose a linear background subtraction scheme. Compared to the conventional quadratic subtraction, the advantage of linear subtraction emerges within the frequency range below $6 \times 10^{-9}~{\rm Hz}$. Taking dark photons with purely gravitational interactions, dark photons with additional $U(1)_{B}$ or $U(1)_{B-L}$ gauge interactions, and low-frequency gravitational waves as examples, we illustrate that the linear subtraction scheme can result in an enhancement of more than one order of magnitude in the exclusion limits of Gaia-like experiments in the low-frequency range.

hep-ph↗

arXiv2024

BA-Net: Bridge Attention in Deep Neural Networks

Attention mechanisms, particularly channel attention, have become highly influential in numerous computer vision tasks. Despite their effectiveness, many existing methods primarily focus on optimizing performance through complex attention modules applied at individual convolutional layers, often overlooking the synergistic interactions that can occur across multiple layers. In response to this gap, we introduce bridge attention, a novel approach designed to facilitate more effective integration and information flow between different convolutional layers. Our work extends the original bridge attention model (BAv1) by introducing an adaptive selection operator, which reduces information redundancy and optimizes the overall information exchange. This enhancement results in the development of BAv2, which achieves substantial performance improvements in the ImageNet classification task, obtaining Top-1 accuracies of 80.49% and 81.75% when using ResNet50 and ResNet101 as backbone networks, respectively. These results surpass the retrained baselines by 1.61% and 0.77%, respectively. Furthermore, BAv2 outperforms other existing channel attention techniques, such as the classical SENet101, exceeding its retrained performance by 0.52% Additionally, integrating BAv2 into advanced convolutional networks and vision transformers has led to significant gains in performance across a wide range of computer vision tasks, underscoring its broad applicability.

cs.CV↗

arXiv2024

An Adaptive Reconstruction Method for Arbitrary High-Order Accuracy Using Discontinuity Feedback

This paper introduces an effcient class of adaptive stencil extension reconstruction methods based on a discontinuity feedback factor, addressing the challenges of weak robustness and high computational cost in high-order schemes, particularly those of 7th-order or above. Two key innovations are presented: The accuracy order adaptively increases from the lowest level based on local stencil smoothness, contrasting with conventional methods like Weighted Essentially Non-Oscillatory (WENO) and Monotonic Upstream-Centered Scheme for Conservation Laws (MUSCL)limiters, which typically reduce order from the highest level. The Discontinuity Feedback Factor (DF) serves a dual purpose: detecting sub-cell discontinuity strength and explicitly incorporating into the reconstruction process as a local smoothness measure. This approach eliminates the need for computationally expensive smoothness indicators often required in very high-order schemes, such as 9th-order schemes, and can be easily generalized to arbitrary high-order schemes. Rigorous test cases, including a Mach 20000 jet, demonstrate the exceptional robustness of this approach.

math.NA↗

arXiv2024

TrustLLM: Trustworthiness in Large Language Models

Large language models (LLMs), exemplified by ChatGPT, have gained considerable attention for their excellent natural language processing capabilities. Nonetheless, these LLMs present many challenges, particularly in the realm of trustworthiness. Therefore, ensuring the trustworthiness of LLMs emerges as an important topic. This paper introduces TrustLLM, a comprehensive study of trustworthiness in LLMs, including principles for different dimensions of trustworthiness, established benchmark, evaluation, and analysis of trustworthiness for mainstream LLMs, and discussion of open challenges and future directions. Specifically, we first propose a set of principles for trustworthy LLMs that span eight different dimensions. Based on these principles, we further establish a benchmark across six dimensions including truthfulness, safety, fairness, robustness, privacy, and machine ethics. We then present a study evaluating 16 mainstream LLMs in TrustLLM, consisting of over 30 datasets. Our findings firstly show that in general trustworthiness and utility (i.e., functional effectiveness) are positively related. Secondly, our observations reveal that proprietary LLMs generally outperform most open-source counterparts in terms of trustworthiness, raising concerns about the potential risks of widely accessible open-source LLMs. However, a few open-source LLMs come very close to proprietary ones. Thirdly, it is important to note that some LLMs may be overly calibrated towards exhibiting trustworthiness, to the extent that they compromise their utility by mistakenly treating benign prompts as harmful and consequently not responding. Finally, we emphasize the importance of ensuring transparency not only in the models themselves but also in the technologies that underpin trustworthiness. Knowing the specific trustworthy technologies that have been employed is crucial for analyzing their effectiveness.

cs.CL↗

arXiv2024

Hidden in Plain Sight: Exploring Chat History Tampering in Interactive Language Models

Large Language Models (LLMs) such as ChatGPT and Llama have become prevalent in real-world applications, exhibiting impressive text generation performance. LLMs are fundamentally developed from a scenario where the input data remains static and unstructured. To behave interactively, LLM-based chat systems must integrate prior chat history as context into their inputs, following a pre-defined structure. However, LLMs cannot separate user inputs from context, enabling chat history tampering. This paper introduces a systematic methodology to inject user-supplied history into LLM conversations without any prior knowledge of the target model. The key is to utilize prompt templates that can well organize the messages to be injected, leading the target LLM to interpret them as genuine chat history. To automatically search for effective templates in a WebUI black-box setting, we propose the LLM-Guided Genetic Algorithm (LLMGA) that leverages an LLM to generate and iteratively optimize the templates. We apply the proposed method to popular real-world LLMs including ChatGPT and Llama-2/3. The results show that chat history tampering can enhance the malleability of the model's behavior over time and greatly influence the model output. For example, it can improve the success rate of disallowed response elicitation up to 97% on ChatGPT. Our findings provide insights into the challenges associated with the real-world deployment of interactive LLMs.

cs.AI↗

arXiv2024

Blowing in the Dark Matter Wind

Interactions between dark matter and ordinary matter will transfer momentum, and therefore give rise to a force on ordinary matter due to the dark matter `wind.' We show that this force can be maximal in a realistic model of dark matter, meaning that an order-1 fraction of the dark matter momentum incident on a target of ordinary matter is reflected. The model consists of light ($m_ϕ\lsim \text{eV}$) scalar dark matter with an effective interaction $ϕ^2 \barψψ$, where $ψ$ is an electron or nucleon field. If the coupling is repulsive and sufficiently strong, the field $ϕ$ is excluded from ordinary matter, analogous to the Meissner effect for photons in a superconductor. We show that there is a large region of parameter space that is compatible with existing constraints, where the force is large enough to be detected by existing force probes, such as satellite tests of the equivalence principle and torsion balance experiments. However, shielding of the dark matter by ordinary matter prevents existing experiments from being sensitive to the dark matter force. We show that precise measurements of spacecraft trajectories proposed to test long distance modifications of gravity are sensitive to this force for a wide range of parameters.

hep-ph↗