arXiv subjects

Eric Zhang

Publications and source records attributed to Eric Zhang.

At least 19 recordsLinked to original sources

arXiv2026

Scalable Detection of Fossil Palynomorphs in Multifocal Digital Microscopy Images

Palynomorphs (microscopic, organic-walled fossils such as pollen, spores, and dinoflagellates) are important high-resolution records of past climates and are critical to the study of ancient ecosystems. Existing methods rely on manual analysis of high-resolution, multifocal digital microscopy images, which is slow and time-consuming and requires researchers to compromise on the scale of their investigations. To the best of our knowledge, our work proposes the first ever scalable end-to-end pipeline for automated palynomorph detection in whole slide images that addresses this bottleneck through: (1) efficient methods for decomposing and compressing digitized multifocal microscope slide images into tractable 2-dimensional tiles for analysis; (2) benchmarking modern object detection models, including RF-DETR, for the detection of palynomorphs, achieving an AP@50 of 0.879; (3) an efficient algorithm for the synthesis of detection outputs across large-scale, high-resolution images; and (4) an I/O optimization resulting in faster inference time. Our methods drastically reduce the time required for palynomorph detection in a single slide from often days of manual inspection to under one hour of automated analysis, enabling palynological research at a substantially greater scale.

cs.CV↗

arXiv2026

Large Language Models for AI-Assisted Radiotherapy Scheduling: A Feasibility Study Under Realistic Operational Constraints

Radiotherapy (RT) patient scheduling is a complex operational problem. Current scheduling often relies on manual coordination and can be difficult to adapt to changing clinical demands. This study evaluated the feasibility of using a large language model (LLM) to generate candidate RT patient schedules satisfying predefined clinical and operational constraints. A simulated three-LINAC RT scheduling environment was developed over one year using synthetic patient arrivals and treatment characteristics modeled after clinical practice. A total of 1,400 new patients across 12 treatment categories were generated. An LLM-based scheduling framework used structured natural-language prompts encoding clinical rules, operational constraints, and scheduling objectives. Performance was evaluated across scenarios involving weekly time consistency, LINAC continuity, gap-constrained temporal relaxation, and infeasible request handling. Generated schedules were validated using deterministic rule-based checks and manual review. LLM-generated schedules satisfied predefined feasibility rules in the evaluated scenarios. Approximately 99% of evaluated fractions remained within the preferred 60-minute weekly treatment-time window. Adding a LINAC-continuity objective reduced LINAC switching from 54.6% to 10.1%. Adding gap-constrained temporal relaxation reduced Friday mean daily gap time from 169.5 to 89.2 minutes while maintaining approximately 99% of fractions within the 60-minute window. The framework also identified infeasible scheduling requests and proposed interpretable corrective actions. These results suggested that LLMs may support RT patient scheduling in constraint-rich simulated clinical environments, motivating further investigation of LLM-assisted scheduling as a flexible, human-in-the-loop decision-support approach for RT operations.

physics.med-ph↗

arXiv2025

Shared Parameter Subspaces and Cross-Task Linearity in Emergently Misaligned Behavior

Recent work has discovered that large language models can develop broadly misaligned behaviors after being fine-tuned on narrowly harmful datasets, a phenomenon known as emergent misalignment (EM). However, the fundamental mechanisms enabling such harmful generalization across disparate domains remain poorly understood. In this work, we adopt a geometric perspective to study EM and demonstrate that it exhibits a fundamental cross-task linear structure in how harmful behavior is encoded across different datasets. Specifically, we find a strong convergence in EM parameters across tasks, with the fine-tuned weight updates showing relatively high cosine similarities, as well as shared lower-dimensional subspaces as measured by their principal angles and projection overlaps. Furthermore, we also show functional equivalence via linear mode connectivity, wherein interpolated models across narrow misalignment tasks maintain coherent, broadly misaligned behavior. Our results indicate that EM arises from different narrow tasks discovering the same set of shared parameter directions, suggesting that harmful behaviors may be organized into specific, predictable regions of the weight landscape. By revealing this fundamental connection between parametric geometry and behavioral outcomes, we hope our work catalyzes further research on parameter space interpretability and weight-based interventions.

cs.LG↗

arXiv2025

Contrastive Dimension Reduction: A Systematic Review

Contrastive dimension reduction (CDR) methods aim to extract signal unique to or enriched in a treatment (foreground) group relative to a control (background) group. This setting arises in many scientific domains, such as genomics, imaging, and time series analysis, where traditional dimension reduction techniques such as Principal Component Analysis (PCA) may fail to isolate the signal of interest. In this review, we provide a systematic overview of existing CDR methods. We propose a pipeline for analyzing case-control studies together with a taxonomy of CDR methods based on their assumptions, objectives, and mathematical formulations, unifying disparate approaches under a shared conceptual framework. We highlight key applications and challenges in existing CDR methods, and identify open questions and future directions. By providing a clear framework for CDR and its applications, we aim to facilitate broader adoption and motivate further developments in this emerging field.

stat.ME↗

arXiv2025

The Entangling of Supernova Feedback Impacts with Coarsening Simulation Resolution

It is often understood that supernova (SN) feedback in galaxies is responsible for regulating star formation (SF) and generating gaseous outflows. However, a detailed look at their small-scale effects on the interstellar medium (ISM) in simulations shows that these processes proceed in distinct and separate channels. We demonstrate this finding in two independent simulations of isolated dwarf galaxies with very high ($m_{\rm gas}$ $\sim \msun$) numerical resolution, {\small LYRA} and {\small RIGEL}. Focusing on the immediate environment surrounding SNe, our findings suggest that the macroscopic effect of a given SN on the galaxy is best predicted by its local density. Outflows are driven by SNe in diffuse regions expanding to their cooling radii on large ($\sim$ kpc) scales, while dense SF regions are disrupted in a localized ($\sim$ pc) manner. However, these separate feedback channels are only distinguishable at very high resolutions capable of following mass scales $\lesssim 10^2 \,\msun$. When averaging on coarser scales, ISM densities are greatly mis-estimated, and variations between different SF and SNe-affected regions are severely washed out. It therefore cannot be self-consistently determined, from coarse-resolution information \textit{alone}, (1) whether a SN tends to contribute to outflows or direct SF suppression, and (2) the rate of SF in a given region. In particular, commonly used parameters in coarse-resolution (subgrid) models, such as the SN cooling radius and SF density threshold, may require more detailed treatments informed by high-resolution studies.

astro-ph.GA↗

arXiv2025

Deploying UDM Series in Real-Life Stuttered Speech Applications: A Clinical Evaluation Framework

Stuttered and dysfluent speech detection systems have traditionally suffered from the trade-off between accuracy and clinical interpretability. While end-to-end deep learning models achieve high performance, their black-box nature limits clinical adoption. This paper looks at the Unconstrained Dysfluency Modeling (UDM) series-the current state-of-the-art framework developed by Berkeley that combines modular architecture, explicit phoneme alignment, and interpretable outputs for real-world clinical deployment. Through extensive experiments involving patients and certified speech-language pathologists (SLPs), we demonstrate that UDM achieves state-of-the-art performance (F1: 0.89+-0.04) while providing clinically meaningful interpretability scores (4.2/5.0). Our deployment study shows 87% clinician acceptance rate and 34% reduction in diagnostic time. The results provide strong evidence that UDM represents a practical pathway toward AI-assisted speech therapy in clinical environments.

cs.SD↗

arXiv2025

A Comparative Study of Controllability, Explainability, and Performance in Dysfluency Detection Models

Recent advances in dysfluency detection have introduced a variety of modeling paradigms, ranging from lightweight object-detection inspired networks (YOLOStutter) to modular interpretable frameworks (UDM). While performance on benchmark datasets continues to improve, clinical adoption requires more than accuracy: models must be controllable and explainable. In this paper, we present a systematic comparative analysis of four representative approaches--YOLO-Stutter, FluentNet, UDM, and SSDM--along three dimensions: performance, controllability, and explainability. Through comprehensive evaluation on multiple datasets and expert clinician assessment, we find that YOLO-Stutter and FluentNet provide efficiency and simplicity, but with limited transparency; UDM achieves the best balance of accuracy and clinical interpretability; and SSDM, while promising, could not be fully reproduced in our experiments. Our analysis highlights the trade-offs among competing approaches and identifies future directions for clinically viable dysfluency modeling. We also provide detailed implementation insights and practical deployment considerations for each approach.

cs.AI↗

arXiv2025

Revisiting Rule-Based Stuttering Detection: A Comprehensive Analysis of Interpretable Models for Clinical Applications

Stuttering affects approximately 1% of the global population, impacting communication and quality of life. While recent advances in deep learning have pushed the boundaries of automatic speech dysfluency detection, rule-based approaches remain crucial for clinical applications where interpretability and transparency are paramount. This paper presents a comprehensive analysis of rule-based stuttering detection systems, synthesizing insights from multiple corpora including UCLASS, FluencyBank, and SEP-28k. We propose an enhanced rule-based framework that incorporates speaking-rate normalization, multi-level acoustic feature analysis, and hierarchical decision structures. Our approach achieves competitive performance while maintaining complete interpretability-critical for clinical adoption. We demonstrate that rule-based systems excel particularly in prolongation detection (97-99% accuracy) and provide stable performance across varying speaking rates. Furthermore, we show how these interpretable models can be integrated with modern machine learning pipelines as proposal generators or constraint modules, bridging the gap between traditional speech pathology practices and contemporary AI systems. Our analysis reveals that while neural approaches may achieve marginally higher accuracy in unconstrained settings, rule-based methods offer unique advantages in clinical contexts where decision auditability, patient-specific tuning, and real-time feedback are essential.

cs.AI↗

arXiv2025

Contrastive CUR: Interpretable Joint Feature and Sample Selection for Case-Control Studies

Dimension reduction is an essential tool for analyzing high dimensional data. Most existing methods, including principal component analysis (PCA), as well as their extensions, provide principal components that are often linear combinations of features, which are often challenging to interpret. CUR decomposition, another matrix decomposition technique, is a more interpretable and efficient alternative, offers simultaneous feature and sample selection. Despite this, many biomedical studies involve two groups: a foreground (treatment or case) group and a background (control) group, where the objective is to identify features unique to or enriched in the foreground. This need for contrastive dimension reduction is not well addressed by existing CUR methods, nor by contrastive approaches rooted in PCAs. Furthermore, they fail to address a key challenge in biomedical studies: the need for selecting samples unique to the foreground. In this paper, we address this gap by proposing a Contrastive CUR (CCUR), a novel method specifically designed for case-control studies. Through extensive experiments, we demonstrate that CCUR outperforms existing techniques in isolating biologically relevant features as well as identifying sample-specific responses unique to the foreground, offering deeper insights into case-control biomedical data.

stat.ME↗

arXiv2025

Can Gradient Descent Simulate Prompting?

There are two primary ways of incorporating new information into a language model (LM): changing its prompt or changing its parameters, e.g. via fine-tuning. Parameter updates incur no long-term storage cost for model changes. However, for many model updates, prompting is significantly more effective: prompted models can generalize robustly from single examples and draw logical inferences that do not occur under standard fine-tuning. Can models be modified so that fine-tuning does emulate prompting? This paper describes a method for meta-training LMs such that gradient updates emulate the effects of conditioning on new information. Our approach uses tools from gradient-based meta-learning but uses an LM's own prompted predictions as targets, eliminating the need for ground-truth labels. Subsequent gradient descent training recovers some (and occasionally all) of prompted model performance -- showing improvement on the ``reversal curse'' tasks, and answering questions about text passages after a single gradient update. These results suggest that, with appropriate initialization, gradient descent can be surprisingly expressive. Our results suggest new avenues for long-context modeling and offer insight into the generalization capabilities of gradient-based learning.

cs.CL↗

arXiv2024

Unforgettable Generalization in Language Models

When language models (LMs) are trained to forget (or "unlearn'') a skill, how precisely does their behavior change? We study the behavior of transformer LMs in which tasks have been forgotten via fine-tuning on randomized labels. Such LMs learn to generate near-random predictions for individual examples in the "training'' set used for forgetting. Across tasks, however, LMs exhibit extreme variability in whether LM predictions change on examples outside the training set. In some tasks (like entailment classification), forgetting generalizes robustly, and causes models to produce uninformative predictions on new task instances; in other tasks (like physical commonsense reasoning and scientific question answering) forgetting affects only the training examples, and models continue to perform the "forgotten'' task accurately even for examples very similar to those that appeared in the training set. Dataset difficulty is not predictive of whether a behavior can be forgotten; instead, generalization in forgetting is (weakly) predicted by the confidence of LMs' initial task predictions and the variability of LM representations of training data, with low confidence and low variability both associated with greater generalization. Perhaps most surprisingly, random-label forgetting appears to be somewhat insensitive to the contents of the training set: for example, models trained on science questions with random labels continue to answer other science questions accurately, but begin to produce random labels on entailment classification tasks. Finally, we show that even generalizable forgetting is shallow: linear probes trained on LMs' representations can still perform tasks reliably after forgetting. Our results highlight the difficulty and unpredictability of performing targeted skill removal from models via fine-tuning.

cs.LG↗

arXiv2024

Ragnar\"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track

Did you try out the new Bing Search? Or maybe you fiddled around with Google AI~Overviews? These might sound familiar because the modern-day search stack has recently evolved to include retrieval-augmented generation (RAG) systems. They allow searching and incorporating real-time data into large language models (LLMs) to provide a well-informed, attributed, concise summary in contrast to the traditional search paradigm that relies on displaying a ranked list of documents. Therefore, given these recent advancements, it is crucial to have an arena to build, test, visualize, and systematically evaluate RAG-based search systems. With this in mind, we propose the TREC 2024 RAG Track to foster innovation in evaluating RAG systems. In our work, we lay out the steps we've made towards making this track a reality -- we describe the details of our reusable framework, Ragnar\"ok, explain the curation of the new MS MARCO V2.1 collection choice, release the development topics for the track, and standardize the I/O definitions which assist the end user. Next, using Ragnar\"ok, we identify and provide key industrial baselines such as OpenAI's GPT-4o or Cohere's Command R+. Further, we introduce a web-based user interface for an interactive arena allowing benchmarking pairwise RAG systems by crowdsourcing. We open-source our Ragnar\"ok framework and baselines to achieve a unified standard for future RAG systems.

cs.IR↗

arXiv2024

Bursty Star Formation in Dwarfs is Sensitive to Numerical Choices in Supernova Feedback Models

Simulations of galaxy formation are mostly unable to resolve the energy-conserving phase of individual supernova events, having to resort to subgrid models to distribute the energy and momentum resulting from stellar feedback. However, the properties of these simulated galaxies, including the morphology, stellar mass formed and the burstiness of the star formation history, are highly sensitive to numerical choices adopted in these subgrid models. Using the {\small SMUGGLE} stellar feedback model, we compute idealized simulations of a $M_{\rm vir} \sim 10^{10} \, \msun$ dwarf galaxy, a regime where most simulation codes predict significant burstiness in star formation, resulting in strong gas flows that lead to the formation of dark matter cores. We find that by varying only the directional distribution of momentum imparted from supernovae to the surrounding gas, while holding the total momentum per supernova constant, bursty star formation may be amplified or completely suppressed, and the total stellar mass formed can vary by as much as a factor of $\sim 3$. In particular, when momentum is primarily directed perpendicular to the gas disk, less bursty and lower overall star formation rates result, yielding less gas turbulence, more disky morphologies and a retention of cuspy dark matter density profiles. An improved understanding of the non-linear coupling of stellar feedback into inhomogeneous gaseous media is thus needed to make robust predictions for stellar morphologies and dark matter core formation in dwarfs independent of uncertain numerical choices in the baryonic treatment.

astro-ph.GA↗

arXiv2023

Constraining a companion of the galactic center black hole, Sgr A*

We use 23 years of astrometric and radial velocity data on the orbit of the star S0-2 to constrain a hypothetical intermediate-mass black hole orbiting the massive black hole Sgr A* at the Galactic center. The data place upper limits on variations of the orientation of the stellar orbit (inclination, nodal angle, and pericenter) at levels between 0.02 and 0.07 degrees per year. We use a combination of analytic estimates and full numerical integrations of the orbit of S0-2 in the presence of a black-hole binary. For a companion IMBH whose semi-major axis $a_c$ is larger than that of S0-2 (1020 a.u.), we find that in the region between 1000 and 4000 a.u., a companion black hole with mass $m_c$ between $10^3$ and $10^5 M_\odot$ is excluded, with a boundary behaving as $a_c \sim m_c^{1/3}$. For a companion with $a_c < 1020$ a.u., we find that a black hole with mass between $10^3$ and $10^5 \, M_\odot$ is again excluded, with a boundary behaving as $a_c \sim m_c^{-1/2}$. These bounds arise from quadrupolar perturbations of the orbit of S0-2. However, significantly stronger bounds on the mass of an inner companion arise from the fact that the location of S0-2 is measured relative to the bright emission of Sgr A*. As a consequence, that separation is perturbed by the ``wobble'' of Sgr A* about the center of mass between it and the companion, leading to ``apparent'' perturbations of S0-2's orbit that also include a dipole component. The result is a set of bounds as small as $400 \, M_\odot$ at 200 a.u.; the numerical simulations suggest a bound from these effects varying as $a_c \sim m_c^{-1}$. We compare and contrast our results with those from a recent analysis by the GRAVITY collaboration.

astro-ph.GA↗

arXiv2023

Zero-shot Generative Model Adaptation via Image-specific Prompt Learning

Recently, CLIP-guided image synthesis has shown appealing performance on adapting a pre-trained source-domain generator to an unseen target domain. It does not require any target-domain samples but only the textual domain labels. The training is highly efficient, e.g., a few minutes. However, existing methods still have some limitations in the quality of generated images and may suffer from the mode collapse issue. A key reason is that a fixed adaptation direction is applied for all cross-domain image pairs, which leads to identical supervision signals. To address this issue, we propose an Image-specific Prompt Learning (IPL) method, which learns specific prompt vectors for each source-domain image. This produces a more precise adaptation direction for every cross-domain image pair, endowing the target-domain generator with greatly enhanced flexibility. Qualitative and quantitative evaluations on various domains demonstrate that IPL effectively improves the quality and diversity of synthesized images and alleviates the mode collapse. Moreover, IPL is independent of the structure of the generative model, such as generative adversarial networks or diffusion models. Code is available at https://github.com/Picsart-AI-Research/IPL-Zero-Shot-Generative-Model-Adaptation.

cs.CV↗

arXiv2023

Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models

The unlearning problem of deep learning models, once primarily an academic concern, has become a prevalent issue in the industry. The significant advances in text-to-image generation techniques have prompted global discussions on privacy, copyright, and safety, as numerous unauthorized personal IDs, content, artistic creations, and potentially harmful materials have been learned by these models and later utilized to generate and distribute uncontrolled content. To address this challenge, we propose \textbf{Forget-Me-Not}, an efficient and low-cost solution designed to safely remove specified IDs, objects, or styles from a well-configured text-to-image model in as little as 30 seconds, without impairing its ability to generate other content. Alongside our method, we introduce the \textbf{Memorization Score (M-Score)} and \textbf{ConceptBench} to measure the models' capacity to generate general concepts, grouped into three primary categories: ID, object, and style. Using M-Score and ConceptBench, we demonstrate that Forget-Me-Not can effectively eliminate targeted concepts while maintaining the model's performance on other concepts. Furthermore, Forget-Me-Not offers two practical extensions: a) removal of potentially harmful or NSFW content, and b) enhancement of model accuracy, inclusion and diversity through \textbf{concept correction and disentanglement}. It can also be adapted as a lightweight model patch for Stable Diffusion, allowing for concept manipulation and convenient distribution. To encourage future research in this critical area and promote the development of safe and inclusive generative models, we will open-source our code and ConceptBench at \href{https://github.com/SHI-Labs/Forget-Me-Not}{https://github.com/SHI-Labs/Forget-Me-Not}.

cs.CV↗

arXiv2023

A Stability Timescale for Non-Hierarchical Three-Body Systems

The gravitational three-body problem is a fundamental problem in physics and has significant applications to astronomy. Three-body configurations are often considered stable as long the system is hierarchical; that is, the two orbital distances are well-separated. However, instability, which is often associated with significant energy exchange between orbits, takes time to develop. Assuming two massive objects in a circular orbit and a test particle in an eccentric orbit, we develop an analytical formula estimating the time it takes for the test particle's orbital energy to change by an order of itself. We show its consistency with results from N-body simulations. For eccentric orbits in particular, the instability is primarily driven not by close encounters of the test particle with one of the other bodies, but by the fundamental susceptibility of eccentric orbits to exchange energy at their periapsis. Motivated by recent suggestions that the galactic center may host an intermediate-mass black hole (IMBH) as a companion to the massive black hole Sgr A*, we use our timescale to explore the parameter space that could harbor an IMBH for the lifetime of the S-cluster of stars surrounding Sgr A*. Furthermore, we show that the orbit of an S-star can be stable for long timescales in the presence of other orbital crossing stars, thus suggesting that the S-cluster may be stable for the lifetimes of its member stars.

astro-ph.GA↗

arXiv2022

Versatile Diffusion: Text, Images and Variations All in One Diffusion Model

Recent advances in diffusion models have set an impressive milestone in many generation tasks, and trending works such as DALL-E2, Imagen, and Stable Diffusion have attracted great interest. Despite the rapid landscape changes, recent new approaches focus on extensions and performance rather than capacity, thus requiring separate models for separate tasks. In this work, we expand the existing single-flow diffusion pipeline into a multi-task multimodal network, dubbed Versatile Diffusion (VD), that handles multiple flows of text-to-image, image-to-text, and variations in one unified model. The pipeline design of VD instantiates a unified multi-flow diffusion framework, consisting of sharable and swappable layer modules that enable the crossmodal generality beyond images and text. Through extensive experiments, we demonstrate that VD successfully achieves the following: a) VD outperforms the baseline approaches and handles all its base tasks with competitive quality; b) VD enables novel extensions such as disentanglement of style and semantics, dual- and multi-context blending, etc.; c) The success of our multi-flow multimodal framework over images and text may inspire further diffusion-based universal AI research. Our code and models are open-sourced at https://github.com/SHI-Labs/Versatile-Diffusion.

cs.CV↗