arXiv ScienceSearch

arXiv subjects

Chuang Ma

Publications and source records attributed to Chuang Ma.

At least 19 recordsLinked to original sources

Mechanistic Diagnostics of Spatial Lexical Bias in Multimodal Large Language Model Spatial Reasoning

Multimodal large language models (MLLMs) remain unreliable on spatial multiple-choice questions, and their failures are often attributed to poorly attended visual information. We identify a complementary failure mode, spatial lexical bias: a spatial relation word added to the answer options can act as a lexical-semantic distractor that draws the model's decision toward that option. Using nine open-weight MLLMs, we show that this phenomenon is widespread. We then isolate diagnostic cases in which a model answers a binary spatial question correctly yet consistently chooses a newly added third spatial option, which we call binary-stable but ternary-fragile cases. Leveraging mechanistic interpretability tools on these cases, we find that the failure arises on the language side rather than the visual side: visual attention analyses and residual-stream probes show the correct spatial relation remains internally available, while irrelevant-option controls, activation patching, and sparse component interventions trace the bias to specific LLM-side channels and neurons. Accordingly, we show that a lightweight LLM-only DPO update on tiny single-object-pair synthetic data mitigates the bias, lifting four-way robust accuracy by up to 100 points on synthetic data, and by 68.0, 32.6, and 20.1 points on broader evaluation datasets WhatsUp, SpatialMQA-Direct, and VSR.

cs.CL

Awakening the Hydra: Stabilizing Multi-Concept Backdoor Injection in Text-to-Image Diffusion Models

Text-to-image diffusion models are increasingly developed through open-source reuse and repeated downstream fine-tuning, where reused checkpoints are difficult to verify and thus more susceptible to hidden backdoor behaviors. In such ecosystems, a single pretrained model may be sequentially adapted and redistributed by multiple independent parties, allowing multiple concept-specific trigger-target associations to accumulate in the same model. When these associations coexist, semantic conflicts can be amplified in the shared representation space, leading to cross-concept entanglement and degraded generation quality. Notably, instead of strengthening the attack, such accumulation can destabilize previously injected behaviors and reduce attack reliability. In this work, we systematically investigate backdoor attacks under this interference-prone setting and propose Hydra, a unified framework for robust and controlled multi-concept backdoor injection under cumulative and decentralized reuse. Our core insight is that stable backdoor injection under large-scale multi-concept settings requires explicitly constraining trigger semantics while coordinating cross-task interactions during optimization. Specifically, Hydra performs evolutionary trigger search in the text encoder space to identify triggers that are semantically aligned with their target concepts while remaining stable across other injected concepts. It further combines multi-task fine-tuning with trigger-clean regularization to improve training stability under dense multi-concept injection. Extensive experiments across multiple diffusion backbones under rigorous multi-concept settings show that Hydra maintains effective backdoor activation while preserving clean generation fidelity and image quality. For instance, across 8 attackers and 500 concept pairs, Hydra maintains ~95% ASR and strong clean generation.

cs.CR

Path-Lock Expert: Separating Reasoning Mode in Hybrid Thinking via Architecture-Level Separation

Hybrid-thinking language models expose explicit /think and /no_think modes, but current designs do not separate them cleanly. Even in /no_think mode, models often emit long and self-reflective responses, causing reasoning leakage. Existing work reduces this issue through better data curation and multi-stage training, yet leakage remains because both modes are still encoded in the same feed-forward parameters. We propose Path-Lock Expert (PLE), an architecture-level solution that replaces the single MLP in each decoder layer with two semantically locked experts, one for /think and one for /no_think, while keeping attention, embeddings, normalization, and the language-model head shared. A deterministic control-token router selects exactly one expert path for the entire sequence, so inference preserves the dense model's per-token computation pattern and each expert receives mode-pure updates during supervised fine-tuning. Across math and science reasoning benchmarks, PLE maintains strong /think performance while producing a substantially stronger mode separation, a /no_think mode with higher accuracy and far less reasoning leakage. On Qwen3-4B, for example, compared to the SFT-only baseline on AIME24, PLE generates 17x fewer reflective tokens (6.01 vs. 0.35 per answer) and 2x shorter outputs (8665 vs. 4101 tokens), and improves /no_think accuracy from 35.33% to 44.67%, while maintaining /think-mode performance (61.33% vs. 60.00%). These results suggest that controllable hybrid thinking is fundamentally an architectural problem, and separating mode-specific feed-forward pathways is a simple and effective solution.

cs.CL

AgentCE-Bench: Agent Configurable Evaluation with Scalable Horizons and Controllable Difficulty under Lightweight Environments

Existing Agent benchmarks suffer from two critical limitations: high environment interaction overhead (up to 41\% of total evaluation time) and imbalanced task horizon and difficulty distributions that make aggregate scores unreliable. To address these issues, we propose AgentCE-Bench built around a unified grid-based planning task, where agents must fill hidden slots in a partially completed schedule subject to both local slot constraints and global constraints. Our benchmark offers fine-grained control through two orthogonal axes: \textbf{Scalable Horizons}, controlled by the number of hidden slots $H$, and \textbf{Controllable Difficulty}, governed by a decoy budget $B$ that determines the number of globally misleading decoy candidates. Crucially, all tool calls are resolved via static JSON files under a \textbf{Lightweight Environment} design, eliminating setup overhead and enabling fast, reproducible evaluation suitable for training-time validation. We first validate that $H$ and $B$ provide reliable control over task horizon and difficulty, and that AgentCE-Bench exhibits strong domain consistency and model discriminability. We then conduct comprehensive experiments across 13 models of diverse sizes and families over 6 domains, revealing significant cross-model performance variation and confirming that AgentCE-Bench provides interpretable and controllable evaluation of agent reasoning.

cs.AI

Large-data solutions in multi-dimensional thermoviscoelasticity with temperature-dependent viscosities

This paper investigates a quasilinear parabolic system arising in thermoviscoelasticity of Kelvin-Voigt type with temperature-dependent viscosity and coupled terms. The system, given by \begin{equation*} \begin{cases} u_{tt}=\nabla\cdot\big(\gamma(\Theta)\nabla u_t\big)+a\Delta u-\nabla\cdot f(\Theta), & x \in \Omega,\ t > 0, \Theta_t=\Delta\Theta+\gamma(\Theta)|\nabla u_t|^2-f(\Theta)\nabla u_t, & x \in \Omega,\ t > 0, u=0,\quad\frac{\partial\Theta}{\partial\nu}=0, & x \in \partial\Omega,\ t > 0, u(x,0)=u_0(x),\; u_t(x,0)=u_{0t}(x),\;\Theta(x,0)=\Theta_0(x), & x \in \Omega, \end{cases} \end{equation*} models heat generation by acoustic waves in solid materials and can be derived as a scalar simplification of more complex piezoelectric-thermoviscoelastic model. Under the assumptions that $u_0\in H_0^1(\Omega)$, $u_{0t}\in L^2(\Omega)$, $\Theta_0\in L^1(\Omega)$ with $\Theta_0\geqslant0$ a.e.~in $\Omega$, that $\gamma,f\in C^0([0,\infty))$ satisfy $f(0)=0$, and that there exist constants $k_\gamma,K_\gamma,K_f>0$ and $0<\alpha<\frac{N+2}{2N}$ such that $$k_\gamma\leqslant\gamma(\xi)\leqslant K_\gamma\quad\text{and}\quad |f(\xi)|\leqslant K_f(1+\xi)^\alpha\qquad\forall~\xi\geqslant0,$$ we establish the global existence of weak solutions for arbitrarily large initial data in bounded domains $\Omega\subset\mathbb{R}^N$ ($N\geqslant1$). The result extends recent one-dimensional finding \cite{WinklerZAMP} to the multi-dimensional setting without requiring any smallness condition on the data.

math.AP

Asymptotic behavior of the solution with positive temperature in nonlinear 3D thermoelasticity

In this paper, we study a hyperbolic-parabolic coupled system arising in nonlinear three-dimensional thermoelasticity. We establish the global well-posedness and asymptotic behavior of solutions. Our main result shows that, a thermoelastic body asymptotically converges to an equilibrium state with a uniform temperature distribution for every initial data, determined by energy conservation. The proof of the global well-posedness is divided into some steps. To begin with, we introduce an approximate problem and derive its solvability. Next, we establish a time-independent upper bound for the temperature via Moser iteration technique. Together with an estimate of gradient of entropy, we use a functional involving the Fisher information of the temperature, which enables us to handle a delicate Gronwall-type inequality, to obtain required estimates of the higher-order derivatives. Further, we prove the strict positivity of temperature by applying Moser iteration again on the negative part of the logarithm of the temperature, followed by a uniqueness argument for the weak solution. Finally, we define a dynamical system on a proper functional phase space and analyze the $\omega$-limit set for every initial data. This work provides a complete proof of the global well-posedness and the long-time behavior in the nonlinear three-dimensional thermoelasticity system.

math.AP

When Domains Interact: Asymmetric and Order-Sensitive Cross-Domain Effects in Reinforcement Learning for Reasoning

Group Relative Policy Optimization (GRPO) has become a key technique for improving reasoning abilities in large language models, yet its behavior under different domain sequencing strategies is poorly understood. In particular, the impact of sequential (one domain at a time) versus mixed-domain (multiple domain at a time) training in GRPO has not been systematically studied. We provide the first systematic analysis of training-order effects across math, science, logic, and puzzle reasoning tasks. We found (1) single-domain generalization is highly asymmetric: training on other domains improves math reasoning by approximately 25\% accuracy, while yielding negligible transfer to logic and puzzle; (2) cross-domain interactions are highly order-dependent: training in the order math$\rightarrow$science achieves 83\% / 41\% accuracy on math / science, while reversing the order to science$\rightarrow$math degrades performance to 77\% / 25\%; (3) no single strategy is universally optimal in multi-domain training: sequential training favors math (up to 84\%), mixed training favors science and logic, and poor ordering can incur large performance gaps (from 70\% to 56\%). Overall, our findings demonstrate that GRPO under multi-domain settings exhibits pronounced asymmetry, order sensitivity, and strategy dependence, highlighting the necessity of domain-aware and order-aware training design.

cs.LG

A Penny for Your Thoughts: Decoding Speech from Inexpensive Brain Signals

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to align EEG-derived embeddings with embeddings from a pre-trained transformer-based speech model. Building on the state-of-the-art EEG decoder from Meta, we introduce three architectural modifications: (i) subject-specific attention layers (+0.15% WER improvement), (ii) personalized spatial attention (+0.45%), and (iii) a dual-path RNN with attention (-1.87%). Two of the three modifications improved performance, highlighting the promise of personalized architectures for brain-to-speech decoding and applications in brain-computer interfaces.

cs.SD

MPFNet: A Multi-Prior Fusion Network with a Progressive Training Strategy for Micro-Expression Recognition

Micro-expression recognition (MER), a critical subfield of affective computing, presents greater challenges than macro-expression recognition due to its brief duration and low intensity. While incorporating prior knowledge has been shown to enhance MER performance, existing methods predominantly rely on simplistic, singular sources of prior knowledge, failing to fully exploit multi-source information. This paper introduces the Multi-Prior Fusion Network (MPFNet), leveraging a progressive training strategy to optimize MER tasks. We propose two complementary encoders: the Generic Feature Encoder (GFE) and the Advanced Feature Encoder (AFE), both based on Inflated 3D ConvNets (I3D) with Coordinate Attention (CA) mechanisms, to improve the model's ability to capture spatiotemporal and channel-specific features. Inspired by developmental psychology, we present two variants of MPFNet--MPFNet-P and MPFNet-C--corresponding to two fundamental modes of infant cognitive development: parallel and hierarchical processing. These variants enable the evaluation of different strategies for integrating prior knowledge. Extensive experiments demonstrate that MPFNet significantly improves MER accuracy while maintaining balanced performance across categories, achieving accuracies of 0.811, 0.924, and 0.857 on the SMIC, CASME II, and SAMM datasets, respectively. To the best of our knowledge, our approach achieves state-of-the-art performance on the SMIC and SAMM datasets.

cs.CV

MMME: A Spontaneous Multi-Modal Micro-Expression Dataset Enabling Visual-Physiological Fusion

Micro-expressions (MEs) are subtle, fleeting nonverbal cues that reveal an individual's genuine emotional state. Their analysis has attracted considerable interest due to its promising applications in fields such as healthcare, criminal investigation, and human-computer interaction. However, existing ME research is limited to single visual modality, overlooking the rich emotional information conveyed by other physiological modalities, resulting in ME recognition and spotting performance far below practical application needs. Therefore, exploring the cross-modal association mechanism between ME visual features and physiological signals (PS), and developing a multimodal fusion framework, represents a pivotal step toward advancing ME analysis. This study introduces a novel ME dataset, MMME, which, for the first time, enables synchronized collection of facial action signals (MEs), central nervous system signals (EEG), and peripheral PS (PPG, RSP, SKT, EDA, and ECG). By overcoming the constraints of existing ME corpora, MMME comprises 634 MEs, 2,841 macro-expressions (MaEs), and 2,890 trials of synchronized multimodal PS, establishing a robust foundation for investigating ME neural mechanisms and conducting multimodal fusion-based analyses. Extensive experiments validate the dataset's reliability and provide benchmarks for ME analysis, demonstrating that integrating MEs with PS significantly enhances recognition and spotting performance. To the best of our knowledge, MMME is the most comprehensive ME dataset to date in terms of modality diversity. It provides critical data support for exploring the neural mechanisms of MEs and uncovering the visual-physiological synergistic effects, driving a paradigm shift in ME research from single-modality visual analysis to multimodal fusion. The dataset will be publicly available upon acceptance of this paper.

cs.CV

Neural Collapse in Cumulative Link Models for Ordinal Regression: An Analysis with Unconstrained Feature Model

A phenomenon known as ''Neural Collapse (NC)'' in deep classification tasks, in which the penultimate-layer features and the final classifiers exhibit an extremely simple geometric structure, has recently attracted considerable attention, with the expectation that it can deepen our understanding of how deep neural networks behave. The Unconstrained Feature Model (UFM) has been proposed to explain NC theoretically, and there emerges a growing body of work that extends NC to tasks other than classification and leverages it for practical applications. In this study, we investigate whether a similar phenomenon arises in deep Ordinal Regression (OR) tasks, via combining the cumulative link model for OR and UFM. We show that a phenomenon we call Ordinal Neural Collapse (ONC) indeed emerges and is characterized by the following three properties: (ONC1) all optimal features in the same class collapse to their within-class mean when regularization is applied; (ONC2) these class means align with the classifier, meaning that they collapse onto a one-dimensional subspace; (ONC3) the optimal latent variables (corresponding to logits or preactivations in classification tasks) are aligned according to the class order, and in particular, in the zero-regularization limit, a highly local and simple geometric relationship emerges between the latent variables and the threshold values. We prove these properties analytically within the UFM framework with fixed threshold values and corroborate them empirically across a variety of datasets. We also discuss how these insights can be leveraged in OR, highlighting the use of fixed thresholds.

cs.LG

Computing persistent homology by spanning trees and critical simplices

Topological data analysis can extract effective information from higher-dimensional data. Its mathematical basis is persistent homology. The persistent homology can calculate topological features at different spatiotemporal scales of the dataset; that is, establishing the integrated taxonomic relation among points, lines and simplices. Here, the simplicial network composed of all-order simplices in a simplicial complex is essential. Because the sequence of nested simplicial subnetworks can be regarded as a discrete Morse function from the simplicial network to real values, a method based on the concept of critical simplices can be developed by searching all-order spanning trees. Employing this new method, not only the Morse function values with the theoretical minimum number of critical simplices can be obtained, but also the Betti numbers and composition of all-order cavities in the simplicial network can be calculated quickly. Finally, this method is used to analyze some examples and compared with other methods, showing its effectiveness and feasibility.

math.AT

Stiffness minimisation of graded microstructural configurations using asymptotic analysis and machine learning

The article is aimed to address a mutually boosting use of asymptotic analysis and machine learning, for fast stiffness design of configurations infilled with smoothly-varying graded microstructures. The discussion is conducted in the context of an improved asymptotic-homogenisation topology optimisation (AHTO plus) framework. It is demonstrated that on one hand, machine learning can be employed to represent the key but implicit inter-relationships revealed from asymptotic analysis, and the evaluations of the homogenised quantities, as well as the sensitivities of the design variables, become quite efficient. On the other hand, the use of asymptotic analysis identifies a computational routine for data acquisition, thus the training data here are inexhaustible in theory. Key issues regarding integration of the two methods, such as ensuring the positive definiteness of the homogenised elasticity tensor represented with neural networks, are also discussed. The accuracies and the efficiencies of the present scheme are numerically demonstrated. For two-dimensional optimisation, it takes the present algorithm roughly 300 seconds on a standard desktop computer, and this qualifies the present scheme as one of the most efficient algorithms used for the compliance optimisation of configurations infilled with complex microstructures.

math.NA

Computing Cliques and Cavities in Networks

Complex networks contain complete subgraphs such as nodes, edges, triangles, etc., referred to as simplices and cliques of different orders. Notably, cavities consisting of higher-order cliques play an important role in brain functions. Since searching for maximum cliques is an NP-complete problem, we use k-core decomposition to determine the computability of a given network. For a computable network, we design a search method with an implementable algorithm for finding cliques of different orders, obtaining also the Euler characteristic number. Then, we compute the Betti numbers by using the ranks of boundary matrices of adjacent cliques. Furthermore, we design an optimized algorithm for finding cavities of different orders. Finally, we apply the algorithm to the neuronal network of C. elegans with data from one typical dataset, and find all of its cliques and some cavities of different orders, providing a basis for further mathematical analysis and computation of its structure and function.

cs.NE

Effect of overlap on spreading dynamics on multiplex networks

In spite of the study of epidemic dynamics on single-layer networks has received considerable attention, the epidemic dynamics on multiplex networks is still limited and is facing many challenges. In this work, we consider the susceptible-infected-susceptible-type (SIS) epidemic model on multiplex networks and investigate the effect of overlap among layers on the spreading dynamics. To do so, we assume that the prerequisite of one $S$-node to be infected is that there is at least one infectious neighbor in each layer. A remarkable result is that the overlap can alter the nature of the phase transition for the onset of epidemic outbreak. Specifically speaking, the system undergoes a usual continuous phase transition when two layers are completely overlapped. Otherwise, a discontinuous phase transition is observed, accompanied by the occurrence of a bistable region in which a disease-free phase and an endemic phase are coexisting. As the degree of the overlap decreases, the bistable region is enlarged. The results are validated by both simulation and mean-field theory.

cond-mat.stat-mech

Spontaneous symmetry breaking and discontinuous phase transition for spreading dynamics in multiplex networks

We propose a spreading model in multilayer networks and study the nature of nonequilibrium phase transition in the model. The model integrates the susceptible-infected-susceptible (or susceptible-infected-recovered) spreading dynamics with a biased diffusion process among different layers. A parameter $\alpha$ is introduced to control the bias of the diffusion process, such that each individual prefers to move to one layer with more infected (or recovered) neighbors for larger values of $\alpha$. Using stochastic simulations and mean-field theory, we show that the type of phase transition from a disease-free phase to an endemic phase depends on the value of $\alpha$. When $\alpha$ is small enough, the system undergoes a usual continuous phase transition as an effective spreading rate $\beta$ increases, as in single-layer networks. Interestingly, when $\alpha$ exceeds a critical value the system shows either a hybrid two-step phase transition or a one-step discontinuous phase transition as $\beta$ increases. The former contains a continuous transition between the disease-free phase and a low-prevalence endemic phase, and a discontinuous transition between the low-prevalence endemic phase and a high-prevalence endemic phase. For the latter, only a discontinuous transition occurs from the disease-free phase directly to the high-prevalence endemic phase. Moreover, we show that the discontinuous transition is always accompanied by a spontaneous symmetry breaking in occupation probabilities of individuals in each layer.

physics.soc-ph

An improved belief propagation algorithm for detecting meso-scale structure in complex networks

The framework of statistical inference has been successfully used to detect the meso-scale structures in complex networks, such as community structure, core-periphery (CP) structure. The main principle is that the stochastic block model (SBM) is used to fit the observed network and the learnt parameters indicate the group assignment, in which the parameters of model are often calculated via an expectation-maximization (EM) algorithm and a belief propagation (BP) algorithm is implemented to calculate the decomposition itself. In the derivation process of the BP algorithm, some approximations were made by omitting the effects of node's neighbors, the approximations do not hold if networks are dense or some nodes holding large degrees. As a result, for example, the BP algorithm cannot well detect CP structure in networks and even yields wrong detection because the nodal degrees in core group are very large. In doing so, we propose an improved BP algorithm to solve the problem in the original BP algorithm without increasing any computational complexity. By comparing the improved BP algorithm with the original BP algorithm on community detection and CP detection, we find that the two algorithms yield the same performance on the community detection when the network is sparse, for the community structure in dense networks or CP structure in networks, our improved BP algorithm is much better and more stable. The improved BP algorithm may help us correctly partition different types of meso-scale structures in networks.

physics.soc-ph