arXiv Science⌕ Search

arXiv subjects

Jie Fu

Publications and source records attributed to Jie Fu.

At least 19 recordsLinked to original sources

Revisiting Privacy Risks in Quantized Deep Neural Networks

Model quantization has become a fundamental technique for enabling the efficient deployment of large-scale deep neural networks (DNNs) in data-intensive applications by reducing model size. Despite its widespread adoption, the impact of quantization on training data privacy --- particularly vulnerability to membership inference attacks (MIAs) --- remains largely unexplored. In this paper, we present the first comprehensive empirical study of privacy risks in quantized DNNs, evaluating eight state-of-the-art MIA attacks across six representative quantization methods. Our results reveal that practical quantization levels (4-8 bits) have limited impact on membership privacy risks, with quantized models remaining largely as vulnerable as their full-precision counterparts. Although aggressive low-bit quantization (e.g., 2-bit) can provide meaningful privacy gains, these benefits come at the cost of substantial utility degradation. To understand the underlying causes of these observations, we systematically analyze how different quantization strategies affect model behaviors and outputs, and how these changes influence privacy vulnerability. Beyond evaluating attack risks, we further investigate whether existing privacy defenses developed for full-precision DNNs can effectively protect QNNs. Our results show that these defenses provide only limited additional privacy protection when applied to quantized models, while further amplifying utility degradation. Our study provides practical guidance for privacy-aware deployment of quantized DNNs and motivates the development of new attack and defense mechanisms for QNNs. Our code and datasets are publicly available at https://github.com/JeffffffFu/Priv-QDNN.

cs.CR↗

When Can LLM Reasoning Reliably Reuse Intermediate Results?

Sampling complete solutions gives large language models more chances to solve a problem, but each attempt starts again. For tasks with several subproblems, all required answers must be correct in the same attempt. Retaining intermediate results can avoid repeating correct work, but errors in those results may affect later attempts. We study when this reuse is reliable and how much computation it requires. For local retries that stop when no candidate passes within the retry budget, we give conditions for correct completion and bound the average number of attempts. We also show how checking cost and the chance of passing a check affect total computation. Experiments across eight reasoning models examine composite mathematics and arithmetic. Across four DeepSeek models, average success on the second subproblem is 36.2 percent without first-subproblem context, 57.2 percent with its answer, and 58.3 percent with its reasoning and answer. These scores measure second-subproblem coverage and include continuations made when selection fails. Arithmetic experiments show that similar first-attempt accuracies can lead to very different coverage after repeated attempts. Code is available at https://github.com/SempraETY/Intermediate-State-Reuse.

cs.AI↗

Active Inference via Incentive Design: Eliciting Divergent Behaviors under Partial Observability

We introduce Active Inference through Incentive Design, a framework in which a leader offers strategic incentive to elicit diverging behaviors from followers of different types, thereby improving intent inference under imperfect observations. We analyze two settings: Case 1: a perfectly observable leader with two homogeneous followers with different original/unmodified reward functions, under the assumption that followers' best responses induce Gibbs trajectory distributions in their respective Markov decision processes, we show that this inference problem can be reformulated as maximizing the difference in expected cumulative return, under a modified reward for one follower, between the best-response policies of the two followers; Case 2 considers a partially observable leader who aims to distinguish among heterogeneous followers differing in dynamics and/or rewards. The leader balances incentive cost against information gain, measured by the posterior entropy over follower types, consider the follower's best responses to the incentive design. We develop an efficient first-order gradient-based algorithm to optimize the information-theoretic inference objective. Experiments in stochastic gridworld environments demonstrate significant improvements in both inference accuracy and efficiency over unincentivized baselines.

eess.SY↗

Remarks on Lattice Actions Corresponding to Automorphism Groups of Smooth Cubic Fourfolds

The automorphism groups of smooth cubic fourfolds over the complex numbers, together with actions on defining equations, are classified in previous works. In this paper, we complete the calculation of group actions on the primitive integral cohomology lattice for all of the $156$ families in the classification. We distinguish similar families, determine the remaining action-maximal cases, and use restriction to complete the list. We also determine the generic algebraic lattices for each family. The calculation depends mainly on OSCAR.

math.AG↗

Circuit Claims Depend on What Is Extracted and How It Is Compared

Circuit extraction identifies model components whose presence preserves a target behavior under ablation, but preserving behavior does not single out one circuit. We study this in a synthetic Lean tactic-prediction benchmark with fixed proof rules and randomized surface form. Across dense and weight-sparse checkpoints of the same transformer, evaluated on atomic and compositional proofs, we vary which extracted object is reported: a compact prediction-preserving circuit, a broader graph retaining surrounding read, write, and routing structure, or a subgraph extracted with a post-ablation loss budget. First, overlap between groups of component-to-component connections is low, sometimes close to a random baseline. Overlap is much higher for selected attention-head sets under deterministic selection, but falls sharply when selection among equally scored heads is randomized. Second, the normalized graph-size ranking of conditions that differ in which supervised checkpoint initializes reinforcement learning (RL) agrees between repeated extractions of the compact circuit and between joint and separate query/key representations of each of the other two graphs. For the loss-budgeted graph, query/key ordering agreement persists through the budget sweep. Finally, across those same conditions, the largest exact-match accuracy gains from RL on compositional proofs come with the largest proportion of components in the compositional circuit that lie outside the corresponding atomic circuits. Ablating these additional components in the sparse RL model reduces compositional accuracy while largely preserving accuracy on the corresponding atomic tasks. A circuit-level claim therefore requires specifying which circuit is reported and how it is extracted and compared; behavior alone does not determine its interpretation. We distill these requirements into a reporting practice for circuit-extraction studies.

cs.LG↗

OR-License: Evaluating LLM Agents as Real-World Operations Research Practitioners

Can large language model (LLM) agents deliver expert-level operations research (OR) solutions directly from original client materials, without prior expert reformulation? Existing OR benchmarks typically begin with self-contained descriptions or predefined optimization tasks, underrepresenting the translation of original business materials into professionally validated solutions. We introduce OR-License, an end-to-end benchmark of 31 instances across 10 industrial scenarios from paid OR engagements totaling USD 3.68 million. It preserves original requirements, input data, deliverable formats, and information boundaries after de-identification. To study information acquisition, we introduce ORSim, a controlled client simulator that discloses business facts without supplying OR expertise. Hidden evaluation checks feasibility and compares objective quality against original expert solutions accepted by clients before benchmark construction. Deployment-Adjusted Quality (DAQ) averages expert-relative quality across instances, assigning zero to infeasible deliveries. Across 11 frontier LLMs using coding-agent harnesses, several exceed the expert reference in conditional objective quality, but none matches its DAQ; the strongest primary Claude Code configuration achieves 88.39% strict feasibility and a DAQ of 0.87 against the expert reference of 1. Client information acquisition extends beyond clarification into solution development and validation, with some later stages showing higher confirmed issue-resolution proportions. Trajectory analysis identifies formulation and implementation failures, while task-equalized research-chain completion rates range from 24% to 45% across models on evaluable tasks. These findings motivate sustained information-gap resolution, faithful problem formulation, and evidence-linked self-improvement for reliable long-horizon agents.

cs.CL↗

A Sharp Bound for the Second Betti Number of Hyperkähler Sixfolds

Let $X$ be a smooth compact irreducible hyperkähler manifold of dimension six. We prove that the second Betti number satisfies $b_2(X) \le 23$. Furthermore, we show that the third cohomology vanishes whenever $b_2(X) \ge 19$, and that all odd cohomology vanishes when $b_2(X) = 23$. If the second Chern class lies in the subalgebra generated by $H^2(X,\mathbb{Q})$, then $b_2(X) \in \{5,8,23\}$. The proof uses the Looijenga--Lunts--Verbitsky decomposition, curvature inequalities for Segre classes, and the Hodge--Riemann bilinear relations on the projective cotangent bundle.

math.AG↗

A Proof of Mongardi's Conjecture on Finite Symplectic Group Actions on Hyperkähler Manifolds of $K3^{[n]}$ Type

Let a finite group act faithfully by symplectic automorphisms on a manifold of $K3^{[n]}$ type for $n\geq2$. We prove Mongardi's conjecture that the strict inequality $\mathrm{rk}(S)+\ell(A_S)<24$ holds for its associated Leech coinvariant lattice $S$. The converse was already proved independently by Huybrechts and Mongardi: any Leech coinvariant lattice $S$ satisfying the strict inequality and of rank at most $20$ is realized by such an action for some $n\geq2$. The key idea is to consider the minimum norms of vectors representing discriminant classes of $S$. The absence of numerical walls gives lower bounds for certain classes, while the structure of Leech lattice implies upper bounds for all discriminant classes. Comparing these bounds reduces the proof to finitely many values of $n$. We exclude the remaining cases using further lattice arguments, together with Höhn--Mason's classification of fixed-point sublattices of Leech lattice, thereby proving Mongardi's conjecture.

math.AG↗

Policy Synthesis for Finite Populations of MDP Agents under Aggregate Reach-Avoid Chance Constraints

Consider a finite population of agents with decoupled Markov transition dynamics and empirical-density feedback, subject to the following constraints: with probability at least $1-δ_r$, at least a fraction $α_r$ of agents must reach a target region at some time $t^*$, while, at each time up to $t^*$, the unsafe population fraction must remain below $β_u$ with probability at least $1-δ_u$. However, standard mean-field methods enforce these constraints only in expectation, which fails to account for stochastic fluctuations at finite fleet size $N$. To address this control problem, we propagate the second-order moment (variance) of the empirical density alongside the mean-field trajectory via a discrete-time Lyapunov recursion, and apply the Cantelli inequality to convert chance constraints into tractable deterministic conditions on the moments of the empirical density. We then incorporate these moment-based surrogate constraints into a gradient-based sequential convex approximation procedure for density-feedback policy synthesis. We further introduce additional moment-error bounds to construct a rigorous finite-$N$ certificate. The method is evaluated on a gridworld environment and a power-system EV-charging aggregation problem and compared with a standard deterministic population-level LP baseline.

eess.SY↗

Finite Symplectic Automorphisms of Hyperkähler Manifolds of $K3^{[n]}$-Type Act Trivially on Discriminant Groups

We give an alternative proof of Mongardi's result that every finite group of symplectic automorphisms of a hyperkähler manifold of $K3^{[n]}$-type acts trivially on the discriminant groups of its second cohomology lattice and its coinvariant lattice. The proof combines sphere-packing bounds, Vinberg's reflection chambers and structure results on even $2$-elementary lattices.

math.AG↗

DeltaTTT: Layerwise Optimization for Nonlinear Recurrent Memory

Sequential test-time training adapts a memory network through successive updates, each computing an inner-loop gradient based on the network's previous state. Intuitively, this state dependence should allow each update to account for what the memory has already learned and better incorporate new information. However, we find that this expected advantage does not consistently materialize in nonlinear memories: a fixed-base parallel TTT baseline outperforms its serial counterpart. Our exploratory experiments point to a key underlying difficulty: nonlinear memories can be harder to optimize than linear ones within a single pass over the sequence. To alleviate this optimization difficulty, we introduce DeltaTTT, which replaces joint inner-loop optimization of a two-layer memory network with layerwise learning. Each layer is assigned a local prediction target and updated through a state-dependent delta rule. This formulation retains a nonlinear readout while enabling chunkwise parallel computation. Experiments on DeltaNet and LaCT backbones show improvements in language modeling and retrieval over their recurrent baselines.

cs.LG↗

EgoRefine: Ego-Referenced Predictive Alignment and Trajectory-Conditioned Reliability-Aware Fusion for Asynchronous Collaborative Perception

Collaborative perception enables connected agents to share complementary observations for 3D object detection, extending sensing range and mitigating occlusion. Under asynchronous communication, however, cooperative features arrive with temporal delay. Existing prediction-based methods compensate for these features mainly from the transmitting agent's own history, leaving residual misalignment with the ego agent's current observation; subsequent fusion also often overlooks spatial variations in alignment quality. We propose EgoRefine, an ego-referenced predictive alignment and reliability-aware fusion framework for asynchronous collaborative perception. Its Ego-referenced Predictive Alignment module uses the current ego feature to guide cooperative trajectory-field prediction and refines the sampling offsets along an ego-referenced trajectory direction. Its Trajectory-conditioned Reliability-aware Fusion module treats the trajectory discrepancy between the ego and cooperative streams and the directional refinement magnitude as alignment cues, using them to condition the relation between aligned features and adaptively reweight the two streams before convolutional fusion. Experiments on V2V4Real and DAIR-V2X-Seq show that EgoRefine outperforms TraF-Align by 1.6 and 2.9 points on average in AP@0.5 and AP@0.7, respectively. The source code will be made publicly available at https://github.com/godk0509/EgoRefine.

cs.CV↗

Incentive Design for Multi-Agent Systems: A Bilevel Optimization Framework for Coordinating Independent Agents and Convergence Analysis

Incentive design aims to guide the performance of a system towards a human's intention or preference. We study this problem in a multi-agent system with one leader and multiple followers. Each follower independently solves a mdp to maximize its own expected total return with the same state space and action space. However, the leader's objective depends on the collective best-response policies of all followers. To influence these policies of followers, the leader provides side payments as incentives to individual followers at a cost, aiming to align the collective behaviors of followers with its own goal while minimizing this cost of incentive. Such a leader-followers interaction is formulated as a bilevel optimization problem: the lower level consists of followers individually optimizing their MDPs given the side payments, and the upper level involves the leader optimizing its objective function given the followers' best responses. The main challenge to solve the incentive design is that the leader's objective is generally non-concave and the lower level optimization problems can have multiple local optima. To this end, we employ a constrained optimization reformation of this bi-level optimization problem and develop an algorithm that provably converges to a stationary point of the original problem, by leveraging several smoothness properties of value functions in MDPs. We validate our algorithm in a stochastic gridworld by examining its convergence, verifying that the constraints are satisfied, and evaluating the improvement in the leader's performance.

eess.SY↗

Non-symplectic Indices of Automorphism Groups of Smooth Cubic Fourfolds

We study the full automorphism groups of smooth cubic fourfolds with prescribed symplectic automorphism group. Our starting point is the classification of symplectic automorphism groups by Laza and Zheng. We focus on the non-symplectic index, namely, the index of the symplectic automorphism group in the full automorphism group. We prove general restrictions on this index. We also compute bounds by group-theoretic and lattice-theoretic methods. In several cases, we determine all possible indices. For coinvariant lattices of rank 19, we classify all possible pairs consisting of the symplectic automorphism group and the full automorphism group.

math.AG↗

Classification of Automorphism Groups of Smooth Cubic Threefolds and Fourfolds

We classify the automorphism groups of smooth cubic threefolds and fourfolds. We also show that there are $156$ (respectively, $40$) connected families of smooth cubic fourfolds (respectively, threefolds) with specified automorphism group action. For each family, the group action and defining equations are also given. The classification combines both representation theory (based on GAP) and lattice theory (based on SageMath).

math.AG↗

Trajectory CPHD Filtering for Multiple Turning Vehicles With Decoupled Orientation and Axial-Scale Estimation

Reliable estimation of vehicle orientation, centroid, and footprint is important for representing road-user occupancy during vehicle turns at intersections and other common road maneuvers. During a turn, the vehicle orientation and direction of motion may differ, and coupling the orientation with the axial scales can degrade both orientation and extent estimates. This paper proposes a trajectory cardinalized probability hypothesis density filter with a Decoupled Orientation and Axial-Scale Estimation (DOAM) model for multiple-vehicle tracking. The model represents the kinematic, orientation, and squared semi-axis-length states separately within each trajectory component, reducing the mutual interference between orientation variation and scale estimation without introducing an additional interacting multiple-model structure. A structured coordinate-ascent variational inference recursion jointly updates these state sequences and the measurement-source variables. The trajectory-component likelihood and weight update associated with the decoupled representation are derived while retaining the standard cardinality recursion. A fixed-lag trajectory implementation further uses current measurements to correct historical states within the smoothing window. Evaluation with signalized-intersection simulations and real onboard LiDAR measurements shows improved estimation of vehicle orientation, centroid, and extent, particularly during turns. The resulting vehicle-state and footprint estimates provide information for road-user occupancy perception and subsequent collision-risk assessment and motion planning.

eess.SP↗

Automorphism Groups of Smooth Cubic Fourfolds through Lattice Theory

Laza and the second author have classified all possible symplectic automorphism groups of smooth cubic fourfolds. There are $34$ such groups, and by Koike, there are $48$ families of cubic fourfolds with speficied symplectic automorphism group. For $42$ among those families, we complete the classification of all possible automorphism groups. The approach of this paper is mainly lattice theoretic, starting from known results about the period map of cubic fourfolds by Voisin, Hassett, Looijenga and Laza. We use a lattice-enumeration algorithm implemented in OSCAR.

math.AG↗

QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization

Weight-only post-training quantization (PTQ) can alleviate the computational burden of serving large language models (LLMs) at scale. However, existing PTQ methods often fail to generalize across models and suffer severe accuracy loss below 2 bits. Many leverage unstructured sparsity to mitigate this loss, but at the cost of regularity and GPU-friendly execution. We present QTEA, a sub-2-bit PTQ framework that quantizes weights into ternary values and uses salient weights as residual error compensators. To maintain hardware efficiency, residuals are assigned to selected columns with semi-structured $1:4$ sparsity within the salient columns. We further add column-wise rescale refinement to GPTQ-style column-by-column quantization, alternately updating per-column scales and ternary assignments to reduce reconstruction error. We also identify order-dependent error propagation in GPTQ and introduce error decay to attenuate late-stage error accumulation. On Qwen3-14B, QTEA compresses all weights to an effective 1.7 bits per weight while improving average accuracy over the strongest ternary PTQ baseline by 16.7%. It also achieves 1.40$\times$ and 2.61$\times$ lower perplexity on WikiText and C4 respectively. This trend holds on Llama3-8B, where QTEA obtains a 6.6% accuracy gain and 1.34$\times$ / 1.95$\times$ lower perplexity on the same datasets. Finally, we develop a lookup-table based kernel that achieves 7.2$\times$ faster per-token generation over an FP16 baseline. Code is available at https://github.com/Intelligent-Microsystems-Lab/QTEA.

cs.LG↗