arXiv subjects

Zehao Jin

Publications and source records attributed to Zehao Jin.

At least 19 recordsLinked to original sources

arXiv2026

AcFlow: Controlling Text-to-Image Diffusion Transformers via Learned Conditional Activation Flow

Text-to-image diffusion transformers (DiTs) are powerful generators, yet direct prompting provides limited control interface for style intensity and can fail to suppress unwanted concepts. To enable these controls, we introduce AcFlow, an inference-time controller that transports intermediate layer image-token activations through a learned concept-conditioned velocity field while keeping the base DiT frozen. A textual concept description specifies the desired intervention, while the integration horizon provides a continuous control parameter. The field produces token-varying, activation-dependent updates. With parameters shared across concepts within each task family, the field supports fine-grained descriptions and generalizes to concepts unseen during training without per-concept fitting. On style control, AcFlow achieves the best style--content trade-off among the evaluated baselines in the high-style-alignment regime. At a fixed operating point, AcFlow attains style--content alignment of 0.5365/0.2860, compared with 0.4397/0.2684 for the baseline with the highest style alignment. Qualitative results demonstrate suppression of diverse concepts, including cases where direct prompting fails. Our analyses support the learned velocity field as an adaptive control mechanism, with update directions varying across tokens and depend on their activation states. Our code is available at https://github.com/Nove1yst/AcFlow.

cs.CV↗

arXiv2026

Causes of Hot Jupiter Inflation from Causal Discovery

Hot Jupiters often have radii larger than predicted by standard cooling--contraction models, but it remains unclear which process supplies or preserves the extra internal heat. We analyze 328 short-period giant planets with measured $M_p$, $R_p$, $P_{\rm orb}$, and host-star $T_{\rm eff}$ using causal discovery, a statistical framework that asks which observed properties remain directly connected to planet radius after the others are accounted for. As a check, the same pipeline recovers the expected mass--radius connection for a super-Earth control sample. For hot Jupiters, the preferred graph links $R_p$ directly to $P_{\rm orb}$ and $T_{\rm eff}$, but not to $M_p$. Since incident flux increases with $T_{\rm eff}$ and decreases with $P_{\rm orb}$ at fixed stellar properties, this paired dependence is naturally interpreted as a population-level signature of irradiation-regulated inflation. Comparing the graph with analytic radius-excess scalings suggests a comparatively important role for Gold--Soter thermal tides, with kinetic/mechanical heating and ohmic dissipation potentially contributing alongside them. Purely period-controlled gravitational tides are disfavored as the sole explanation because they lack a leading dependence on stellar temperature. Distinguishing thermal tides, kinetic/mechanical heating, ohmic dissipation, and mixed scenarios will require radius-excess measurements that control for incident flux, age, composition, stellar properties, and selection effects. More broadly, this work shows how causal discovery can turn population-level exoplanet data into physically interpretable tests of hot-Jupiter inflation. Causal discovery complements parametric Bayesian population models by testing which observables retain direct conditional dependence on $R_p$ without imposing a specific radius relation, although the modest sample size limits the scope of the inferred graph.

astro-ph.EP↗

arXiv2026

Decompose Sparsely Where You Should, Absorb Densely Where You Should No

Sparse autoencoders (SAEs) are typically trained to reconstruct the \textbf{entire} residual stream through a sparse dictionary, implicitly assuming that all activation content is amenable to sparse, monosemantic decomposition. We question this assumption and hypothesize that activations contain a low-rank, dense component that is computationally important to the model yet inherently unsuitable for sparse representation, which serves as a major source of the persistent dense latents widely observed in trained SAEs. To test this, we add a small rank-$r$ linear bottleneck in parallel with standard SAEs (BatchTopK and Matryoshka), allowing dense structure to be absorbed before sparse reconstruction. On Gemma-2-2B layer 12, a rank-24 bottleneck reduces dense latent count by up to 84\% while improving sparse probing and targeted probe perturbation on both architectures at matched sparsity. The absorbed component is (i) \textbf{structurally identifiable} as the top principal components and outlier dimensions; (ii) \textbf{causally necessary}, with removing it raising next-token cross-entropy by 7.5$\times$, far exceeding the 2.8$\times$ from removing the geometrically near-identical top-24 PCA directions; and (iii) \textbf{redundantly encoded by sparse dictionaries}, with ablating 787 maximally aligned sparse features raising cross-entropy by only 2.9$\times$ and ablating 2,048 topic-aligned features leaving MMLU topic classification virtually unchanged, whereas removing the scaffold drops it from 98.7\% to chance. Together, our findings identify a compact, semantically informative and causally important component of residual stream activations (which we term a \textbf{computational scaffold}) that standard sparse dictionaries represent inefficiently, suggesting that the scope of sparsity-based interpretability methods warrants careful re-examination.

cs.LG↗

arXiv2026

Beyond Steering Vector: Flow-based Activation Steering for Inference-Time Intervention

Activation steering has emerged as a promising alternative for controlling language-model behavior at inference time by modifying intermediate representations while keeping model parameters frozen. However, large-scale evaluations such as AxBench show that existing steering methods are often outperformed by simple in-context prompting and generalize poorly to unseen concepts. We hypothesize that these limitations arise from unvalidated simplifying assumptions shared across prior methods, which typically restrict steering interventions to fixed, single-step, position-invariant transforms. We propose FLAS (Flow-based Activation Steering), which learns a general, concept-conditioned velocity field $v_t(h,t,c)$ that transports unsteered activations to steered ones without relying on these assumptions. On AxBench, FLAS is the first learned method to consistently outperform prompting, reaching held-out harmonic means of $1.015$ on Gemma-2-2B-IT and $1.113$ on Gemma-2-9B-IT without per-concept tuning. Analysis of the learned flow shows curved, multi-step, token-varying trajectories, which suggests that previous hypotheses on activation space geometry might be incomplete.

cs.CL↗

arXiv2026

How Far Are VLMs from Privacy Awareness in the Physical World? An Empirical Study

As Vision-Language Models (VLMs) are increasingly deployed as autonomous cognitive cores for embodied assistants, evaluating their privacy awareness in physical environments becomes critical. Unlike digital chatbots, these agents operate in intimate spaces, such as homes and hospitals, where they possess the physical agency to observe and manipulate privacy-sensitive information and artifacts. However, current benchmarks remain limited to unimodal, text-based representations that cannot capture the demands of real-world settings. To bridge this gap, we present ImmersedPrivacy, an interactive audio-visual evaluation framework that simulates realistic physical environments using a Unity-based simulator. ImmersedPrivacy evaluates physically grounded privacy awareness across three progressive tiers that test a model's ability to identify sensitive items in cluttered scenes, adapt to shifting social contexts, and resolve conflicts between explicit commands and inferred privacy constraints. Our evaluation of 12 state-of-the-art models reveals consistent deficits. In cluttered scenes, all models exhibit monotonic performance decay as scene complexity grows due to perceptual deficit. When social context shifts, no model exceed 65% selection accuracy. Under conflicting commands, the best model gemini-3.1-pro perfectly balances task completion and privacy preservation in only 51% of cases. These findings reveal that current VLMs in the physical world suffer from perceptual fragility and fail to let their knowledge of privacy cues govern their situated behavior. Our code and data is available at https://github.com/immersed-privacy/immersed-privacy .

cs.CR↗

arXiv2026

Stochastic Attention: Connectome-Inspired Randomized Routing for Expressive Linear-Time Attention

The whole-brain connectome of a fruit fly comprises over 130K neurons connected with a probability of merely 0.02%, yet achieves an average shortest path of only 4.4 hops. Despite being highly structured at the circuit level, the network's long-range connections are broadly distributed across brain regions, functioning as stochastic shortcuts that enable efficient global communication. Inspired by this observation, we propose Stochastic Attention (SA), a drop-in enhancement for sliding-window attention (SWA) that applies a random permutation to the token sequence before windowed attention and restores the original order afterward. This transforms the fixed local window into a stochastic global one within the same $O(nw)$ per-layer budget. Through depth, independently sampled permutations yield exponentially growing receptive fields, achieving full sequence coverage in $O(\log_w n)$ layers versus $O(n/w)$ for SWA. We validate SA in two settings: pre-training language models from scratch, where a gated SA + SWA combination achieves the best average zero-shot accuracy, and training-free inference on Qwen3-8B and Qwen3-30B-A3B, where SA consistently outperforms SWA and matches or exceeds Mixture of Block Attention at comparable compute budgets. These results suggest that connectome-inspired stochastic routing is a practical primitive for improving the expressivity of efficient attention, complementary to existing linear and sparse approaches.

cs.CL↗

arXiv2026

Whole-Brain Connectomic Graph Model Enables Whole-Body Locomotion Control in Fruit Fly

Animals perform coordinated whole-body movements under the control of neural systems shaped by brain-wide connectivity. The mapping of the whole-brain neural connections, or the connectomes, provides a natural graph for modeling sensorimotor information flow, yet its potential as a neural controller for embodied agents remains largely unexplored. Here, we introduce the Fly-connectomic Graph Model, which directly instantiates the whole-brain connectome of an adult Drosophila as a graph-structured neural controller for movements of a simulated biomechanical fruit fly via deep reinforcement learning. We achieve stable performance across diverse locomotion tasks, as well as better sample efficiency compared to both graph and non-graph baselines. Our results demonstrate a biologically informed way towards effective control policy design by translating whole-brain wiring principles into actionable architectural priors, while also improving the interpretability through dynamic information flow. This work also highlights the potential to bridge neuromechanics with embodied intelligence by providing a computational platform for investigating the sensorimotor transformation underlying animal behavior and a paradigm to advance the development of more nature-aligned intelligent systems.

cs.LG↗

arXiv2026

Causal Reversal in the $M_\unicode{x25CF}\unicode{x2013}\sigma_0$ Relation: Implications for High-Redshift Supermassive Black Hole Mass Estimates

The nascent methodology of applying the principles of causal discovery to astrophysical data has produced affirming results about deeply held theories concerning the causal nature behind the observed coevolution of supermassive black holes (SMBHs) with their host galaxies. The key results from observations have demonstrated an apparent causal reversal across different galaxy morphologies$\unicode{x2014}$SMBHs causally influence the evolution of the physical parameters of their spiral galaxy hosts, whereas SMBHs in elliptical galaxies are passive companions that grow in near lockstep with their hosts. To further explore and ascertain insights, it is necessary to utilize galaxy simulations to track the time evolution of the observed causal relations to learn more about the temporal nature of the changing SMBH/galaxy evolutionary directions. We conducted experiments with the NIHAO suite of cosmological zoom-in hydrodynamical simulations to follow the evolution of individual galaxies along with their central SMBH masses ($M_\unicode{x25CF}$) and properties, including central stellar velocity dispersion ($\sigma_0$). We reproduce the causal results from real galaxies, but add clarity by observing that the SMBH/galaxy causal directions are noticeably inverted between the epochs before and after the peak of star formation. The implications for causal reversal of the $M_\unicode{x25CF}\unicode{x2013}\sigma_0$ relation portend larger concerns about the reliability of SMBH masses estimated at high redshifts and presumptions of overmassive black holes at early epochs. Toward this problem, we apply updated causally-informed scaling relations that predict high-$z$ black hole masses that are approximately two orders of magnitude less massive, and thus not overmassive with respect to local $z=0$ SMBH$\unicode{x2013}$galaxy mass ratios.

astro-ph.GA↗

arXiv2025

SOP-Maze: Evaluating Large Language Models on Complicated Business Standard Operating Procedures

As large language models (LLMs) are widely deployed as domain-specific agents, many benchmarks have been proposed to evaluate their ability to follow instructions and make decisions in real-world scenarios. However, business scenarios often involve complex standard operating procedures (SOPs), and the evaluation of LLM capabilities in such contexts has not been fully explored. To bridge this gap, we propose SOP-Maze, a benchmark constructed from real-world business data and adapted into a collection of 397 instances and 3422 subtasks from 23 complex SOP scenarios. We further categorize SOP tasks into two broad classes: Lateral Root System (LRS), representing wide-option tasks that demand precise selection; and Heart Root System (HRS), which emphasizes deep logical reasoning with complex branches. Extensive experiments reveal that nearly all state-of-the-art models struggle with SOP-Maze. We conduct a comprehensive analysis and identify three key error categories: (i) route blindness: difficulty following procedures; (ii) conversational fragility: inability to handle real dialogue nuances; and (iii) calculation errors: mistakes in time or arithmetic reasoning under complex contexts. The systematic study explores LLM performance across SOP tasks that challenge both breadth and depth, offering new insights for improving model capabilities. We have open-sourced our work on: https://github.com/meituan-longcat/SOP-Maze.

cs.CL↗

arXiv2025

Causal evidence for the primordiality of colours in trans-Neptunian objects

The origins of the colours of Trans-Neptunian Objects (TNOs) represent a crucial unresolved question, central to understanding the history of our Solar System. Recent observational surveys revealed correlations between the eccentricity and inclination of TNOs, and their colours. This rekindled the long-standing debate on whether these colours reflect the conditions of TNO formation or their subsequent evolution. We address this question using a model-agnostic, data-driven approach that unanimously converges to a common causal graph from the analysis of two different datasets, each from two different conditional independence test methods. For evaluation, we demonstrate how our model is consistent with the currently-accepted paradigms of TNOs' dynamical histories, without involving any orbital modelling or physics-based assumptions. Our causal model (with no knowledge of the existence of Neptune) predicts the need for an unknown confounding variable, consistent with Neptune's effects. The model predicts that the colour of TNOs is the root cause of their inclination distribution, rather than the other way around. This strongly suggests that the colours of TNOs reflect an underlying dynamical property, most likely their formation location. Our model excludes formation scenarios that invoke substantial colour modification by subsequent evolution. We conclude that the colours of TNOs are predominantly primordial.

astro-ph.EP↗

arXiv2025

Causal Evidence for the Primordiality of Colors in Trans-Neptunian Objects

The origins of the colors of Trans-Neptunian Objects (TNOs) represent a crucial unresolved question, central to understanding the history of our Solar System. Recent observational surveys have revealed correlations between the eccentricity and inclination of TNOs and their colors. This has rekindled the long-standing debate on whether these colors reflect the conditions of TNO formation or their subsequent collisional evolution. In this study, we address this question with 98.7% certainty, using a model-agnostic, data-driven approach based on causal graphs. First, as a sanity check, we demonstrate how our model can replicate the currently accepted paradigms of TNOs' dynamical history, blindly and without any orbital modeling or physics-based assumptions. In fact, our causal model (with no knowledge of the existence of Neptune) predicts the existence of an unknown perturbing body, i.e., Neptune. We then show how this model predicts, with high certainty, that the color of TNOs is the root cause of their inclination distribution, rather than the other way around. This strongly suggests that the colors of TNOs reflect an underlying dynamical property, most likely their formation location. Moreover, our causal model excludes formation scenarios that invoke substantial color modification by subsequent irradiation. We therefore conclude that the colors of TNOs are predominantly primordial.

astro-ph.EP↗

arXiv2025

Causal Discovery of Latent Variables in Galactic Archaeology

Galactic archaeology--the study of stellar migration histories--provides insights into galaxy formation and evolution. However, establishing causal relationships between observable stellar properties and their birth conditions remains challenging, as key properties like birth radius are not directly observable. We employ Rank-based Latent Causal Discovery (RLCD) to uncover the causal structure governing the chemodynamics of a simulated Milky Way galaxy. Using only five observable properties (metallicity, age, and orbital parameters), we recover in a purely data-driven manner a causal graph containing two latent nodes that correspond to real physical properties: the birth radius and guiding radius of stars. Our study demonstrates the potential of causal discovery models in astrophysics.

astro-ph.GA↗

arXiv2025

ZTF IC 10 variable catalog

To study how massive variable stars effect their environment, we search for variability among Zwicky Transient Facility (ZTF) sources located within the optical extent of a nearby starburst galaxy IC 10. We present the ZTF IC 10 catalog, which classifies 1516 $r$ band sources and 864 $g$ band sources within a $225''$ radius around IC 10 into three categories: 1388 (767) $r$ ($g$) band non-variables, 150 (85) $r$ ($g$) band non-periodic variables, and 37 (12) $r$ ($g$) band periodic variables. Among them 101 (48) $r$ ($g$) band non-periodic variables, and 22 (4) $r$ ($g$) band periodic variables are inside IC 10. We verify our classification by cross-matching with previous variability catalogs and machine learning powered classifications. Various analysis including population demographics, color-magnitude diagrams, and cross matching with a set of different surveys and database such as Gaia, XMM-Newton, Chandra, and SIMBAD are also presented. Based on source density and parallax, we distinguish sources within IC 10 from non-IC 10 sources. For IC 10 sources, we highlight flaring super giants, a source with long secondary period, periodic super giants including possible S Doradus luminous blue variable and candidate Miras. For non-IC 10 sources, we present super red sources and compact objects such as a possible long period subdwarf and a periodic X-ray source. The catalog can serve as a useful database to study the connection between various type of massive stars and their host galaxies.

astro-ph.GA↗

arXiv2024

Beyond Causal Discovery for Astronomy: Learning Meaningful Representations with Independent Component Analysis

We present the first steps toward applying causal representation learning to astronomy. Following up on previous work that introduced causal discovery to the field for the first time, here we solve a long standing conundrum by identifying the direction of the causal relation between supermassive black hole (SMBH) mass and their host galaxy properties. This leverages a score-based causal discovery approach with an exact posterior calculation. Causal relations between SMBHs and their host galaxies are further clarified by Independent Component Analysis (ICA). The astrophysical problem we focus on is one of the most important open issues in the field and one that has not seen a definitive resolution in decades. We consider the space of six physical properties of galaxies, subdivided by morphology: elliptical, lenticular, and spiral, plus SMBH mass. We calculate an exact posterior over the space of directed acyclic graphs for these variables based on a flat prior and the Bayesian Gaussian equivalent score. The nature of the causal relation between galaxy properties and SMBH mass is found to vary smoothly with morphology, with galaxy properties determining SMBH mass in ellipticals and vice versa in spirals. This settles a long-standing debate and is compatible with our theoretical understanding of galaxy evolution. ICA reveals a decreasing number of meaningful Independent Components (ICs) from ellipticals and lenticular to spiral. Moreover, we find that only one IC correlates with SMBH mass in spirals while multiple ones do in ellipticals, further confirming our finding that SMBH mass causes galaxy properties in spirals, but the reverse holds in ellipticals.

astro-ph.GA↗

arXiv2024

Bridging Simulations and Observations: New Insights into Galaxy Formation Simulations via Out-of-Distribution Detection and Bayesian Model Comparison

Cosmological simulations are a powerful tool to advance our understanding of galaxy formation and many simulations model key properties of real galaxies. A question that naturally arises for such simulations in light of high-quality observational data is: How close are the models to reality? Due to the high-dimensionality of the problem, many previous studies evaluate galaxy simulations using simplified summary statistics of physical properties. In this work, we combine simulation-based Bayesian model comparison with a novel misspecification detection technique to compare simulated galaxy images of 6 hydrodynamical models observations. Since cosmological simulations are computationally costly, we address the problem of low simulation budgets by first training a $k$-sparse variational autoencoder (VAE) on the abundant dataset of SDSS images. The VAE learns to extract informative latent embeddings and delineates the typical set of real images. To reveal simulation gaps, we then perform out-of-distribution detection (OOD) based on the logits of classifiers trained on the embeddings of simulated images. Finally, we perform amortized Bayesian model comparison using probabilistic classification, identifying the relatively best-performing model along with partial explanations through SHAP values.

astro-ph.GA↗

arXiv2024

Causal Discovery in Astrophysics: Unraveling Supermassive Black Hole and Galaxy Coevolution

Correlation does not imply causation, but patterns of statistical association between variables can be exploited to infer a causal structure (even with purely observational data) with the burgeoning field of causal discovery. As a purely observational science, astrophysics has much to gain by exploiting these new methods. The supermassive black hole (SMBH)--galaxy interaction has long been constrained by observed scaling relations, that is low-scatter correlations between variables such as SMBH mass and the central velocity dispersion of stars in a host galaxy's bulge. This study, using advanced causal discovery techniques and an up-to-date dataset, reveals a causal link between galaxy properties and dynamically-measured SMBH masses. We apply a score-based Bayesian framework to compute the exact conditional probabilities of every causal structure that could possibly describe our galaxy sample. With the exact posterior distribution, we determine the most likely causal structures and notice a probable causal reversal when separating galaxies by morphology. In elliptical galaxies, bulge properties (built from major mergers) tend to influence SMBH growth, while in spiral galaxies, SMBHs are seen to affect host galaxy properties, potentially through feedback in gas-rich environments. For spiral galaxies, SMBHs progressively quench star formation, whereas in elliptical galaxies, quenching is complete, and the causal connection has reversed. Our findings support theoretical models of hierarchical assembly of galaxies and active galactic nuclei feedback regulating galaxy evolution. Our study suggests the potentiality for further exploration of causal links in astrophysical and cosmological scaling relations, as well as any other observational science.

astro-ph.GA↗

arXiv2024

Identification of Intermediate-mass Black Hole Candidates Among a Sample of Sd Galaxies

We analyzed images of every northern hemisphere Sd galaxy listed in the Third Reference Catalogue of Bright Galaxies (RC3) with a relatively face-on inclination ($\theta\leq30{\deg}$). Specifically, we measured the spiral arms' winding angle, $\phi$, in 85 galaxies. We applied a novel black hole mass planar scaling relation involving the rotational velocities (from the literature) and pitch angles of each galaxy to predict central black hole masses. This yielded 23 galaxies, each having at least a 50% chance of hosting a central intermediate-mass black hole (IMBH), $10^2 $1.22% of bright galaxies ($B_{\rm T}\lesssim15.5$ mag) in the local Universe host an IMBH (i.e., the "occupation fraction"), which implies a number density $>$$4.96\times10^{-6}$ Mpc$^{-3}$ for central IMBHs. Finally, we observe that Sd galaxies exhibit an unexpected diversity of properties that resemble the general population of spiral galaxies, albeit with an enhanced signature of the eponymous prototypical traits (i.e., low masses, loosely wound spiral arms, and smaller rotational velocities).

astro-ph.GA↗

arXiv2024

Quantitatively rating galaxy simulations against real observations with anomaly detection

Cosmological galaxy formation simulations are powerful tools to understand the complex processes that govern the formation and evolution of galaxies. However, evaluating the realism of these simulations remains a challenge. The two common approaches for evaluating galaxy simulations is either through scaling relations based on a few key physical galaxy properties, or through a set of pre-defined morphological parameters based on galaxy images. This paper proposes a novel image-based method for evaluating the quality of galaxy simulations using unsupervised deep learning anomaly detection techniques. By comparing full galaxy images, our approach can identify and quantify discrepancies between simulated and observed galaxies. As a demonstration, we apply this method to SDSS imaging and NIHAO simulations with different physics models, parameters, and resolution. We further compare the metric of our method to scaling relations as well as morphological parameters. We show that anomaly detection is able to capture similarities and differences between real and simulated objects that scaling relations and morphological parameters are unable to cover, thus indeed providing a new point of view to validate and calibrate cosmological simulations against observed data.

astro-ph.GA↗