arXiv Science⌕ Search

arXiv subjects

Ruixiang Zhang

Publications and source records attributed to Ruixiang Zhang.

At least 19 recordsLinked to original sources

Power loss for the local Mizohata--Takeuchi estimate on smooth hypersurfaces

We prove power-type lower bounds for the local Mizohata--Takeuchi constants for $C^{2,β}$ hypersurfaces with $0<β\leq1$ whose second fundamental form is nonzero at some point. This result, in particular, disproves the so-called local Mizohata--Takeuchi conjectures for the paraboloid and the sphere and, in turn, presents an obstruction to a general weighted approach to the theory of Fourier restriction of those classical surfaces.

math.CA↗

Small measure expansion in connected noncompact groups

Assuming $G$ is unimodular and $K>1$, and that $μ(A^2) < K μ(A)$. We show that this is a continuous surjective group homomorphism $χ: G \to L$ with a compact kernel, where $L$ is a Lie group satisfying $$\dim(L) \leq \lfloor\log K\rfloor(\lfloor\log K\rfloor+1)/2.$$ This dimension bound is sharp, We also establish the relationship between $A$ and its image under the quotient map, and obtain a more general version of this result for the product set $AB$ without assuming unimodularity. We present two applications: (1) An inverse Kemperman theorem in noncompact groups. Let $G$ be a connected, noncompact, locally compact group with a left Haar measure $μ$, and let $A$ and $B$ be nonempty, compact subsets of $G$. We classify all cases where $G$, $A$, and $B$ exhibit nearly minimal expansion properties (in the unimodular case, this means $μ(AB)$ is close to $μ(A) + μ(B)$). This result completes the noncompact cases of the Kemperman inverse problem and resolves a question posed by Griesmer and Tao. (2) An effective generalized Margulis lemma for discrete subgroups of almost-connected locally compact groups acting properly by isometries. If $B(x,4r)$ can be covered by $K$ translates of $B(x,r)$ at one point and one scale, it gives a small radius $r/2M$, and the group generated at this radius has a subgroup of index at most $M \exp((\log K)^4)$ which is nilpotent modulo a finite normal subgroup. The nilpotency step is bounded by $(\log K)^2$, and \[ M\leq K^{\exp(C(\log K)^4\log\log K)} \] and $C$ is an absolute constant.

math.GR↗

Global Mizohata-Takeuchi for Indicator Weights of Bounded Complexity in $\mathbb{R}^2$

We prove the global Mizohata-Takeuchi estimate for bounded complexity weights in $\mathbb{R}^2$ and an arbitrary $C^2$ uniformly convex curve on the Fourier side, with an implied constant depending only on the complexity and the curve. A version with a logarithmic loss follows from a short argument using the $T^*T$ method and the main estimate of Basu, Guo, Zhang, and Zorin-Kranich (2026). The main effort of this paper is devoted to removing the logarithmic factor. To achieve this, we use tools from semialgebraic geometry and adapt and develop ideas of Ricci and Stein (1987). As a by-product, we obtain a uniform geometric inequality for planar regions of bounded complexity that may be of independent interest.

math.CA↗

Decoding Looped Transformers Better for (Almost) Free

Looped Transformers achieve parameter efficiency by repeatedly executing a shared block across recurrent loops. Each loop yields an intermediate representation decodable for the same next token, yet standard decoding discards earlier states. Because earlier loops embody less computation, recurrence inherently supplies aligned weak-and-strong prediction pairs without auxiliary models or external training. We introduce LoopCD, a training-free contrastive decoding framework that guides token selection by contrasting the final prediction with an earlier recurrent pass, operating either in logit space with one extra output pass (LoopCD-Logits) or in hidden-state space with zero output overhead (LoopCD-Hidden). Across four looped Transformer families, LoopCD delivers substantial, consistent gains at full recurrent depth: LoopCD-Logits raises Ouro-2.6B-Thinking's AIME 2024 pass@1 from 61.88% to 73.33%, while LoopCD-Hidden lifts Huginn's HumanEval pass@1 from 22.56% to 31.71%. Crucially, these performance gains enable halving the number of recurrent loops while still matching or exceeding full-depth unguided baselines, reducing forward FLOPs by 22.5% to 48.2%. By transforming intermediate recurrent states into effective guidance signals, LoopCD achieves superior decoding quality while substantially reducing inference compute.

cs.LG↗

On $C^k$ convex variants of Stein's Weighted $L^2$ Conjecture for Bochner-Riesz means

We prove power-loss results for some variants of Stein's Weighted $L^2$ Conjecture for Bochner-Riesz means. The variants concern multipliers by convex bodies with $C^k$ boundaries in every dimension $n$. The counterexamples are related to recently-constructed counterexamples to the Mizohata-Takeuchi Conjecture. Related results like logarithmic blowups for the endpoint case of the original conjecture are also discussed.

math.CA↗

Mixed-norm Brascamp-Lieb inequalities

Christ [Chr01] looked at a certain boundedness problem for trilinear operators. In this paper we set up a framework of mixed-norm Brascamp-Lieb inequalities and identify a new interesting regime not covered by the study of classical Brascamp-Lieb. Positive results in [Chr01] can be viewed as the first nontrivial progress in this new regime. We will also prove another mixed-norm Brascamp-Lieb inequality, showcasing how one can use a tensor product trick to slightly sharpen Christ's argument and also obtain the endpoint case. We then discuss the connections between mixed-norm Brascamp-Lieb and the Kakeya Conjectures, as well as unique new difficulties for these mixed-norm Brascamp-Lieb inequalities compared to the classical setting.

math.CA↗

Curved Kakeya problems and the projective geometry of paths

We introduce a general framework for curved Kakeya problems in $\mathbb{R}^n$, encompassing those arising from Hörmander-type oscillatory integrals. Every family of curves determines a spray geometry, which allows us to use the projective geometry of paths in the study of curved Kakeya problems. We focus on the two extremes of the "best" and "worst" possible behaviors of curved Kakeya sets. We characterize when the incidence structure underlying Wolff's hairbrush argument persists. In particular, we prove that the existence of many totally geodesic surfaces, as required by Wolff's hairbrush argument, is equivalent to projective flatness of the associated spray. Within this projectively flat class, Bourgain's condition provides a clean dichotomy: when it holds, the family is direction-equivalent to a Bochner--Riesz type family of lines and satisfies the Katz--Wolff condition, and thus the Wang--Zahl result is applicable; when it fails, every totally geodesic surface supports a two-dimensional Kakeya set. We also show that under an extra semi-algebraic assumption, a family of curves in $\mathbb{R}^3$ admits a curved Kakeya set of Hausdorff dimension $2$ if and only if it admits a curved Kakeya set contained in a surface. Equivalently, if this compression is absent, every associated curved Kakeya set has dimension strictly greater than $2$.

math.CA↗

ChipChat: Low-Latency Cascaded Conversational Agent in MLX

The emergence of large language models (LLMs) has transformed spoken dialog systems, yet the optimal architecture for real-time on-device voice agents remains an open question. While end-to-end approaches promise theoretical advantages, cascaded systems (CSs) continue to outperform them in language understanding tasks, despite being constrained by sequential processing latency. In this work, we introduce ChipChat, a novel low-latency CS that overcomes traditional bottlenecks through architectural innovations and streaming optimizations. Our system integrates streaming (a) conversational speech recognition with mixture-of-experts, (b) state-action augmented LLM, (c) text-to-speech synthesis, (d) neural vocoder, and (e) speaker modeling. Implemented using MLX, ChipChat achieves sub-second response latency on a Mac Studio without dedicated GPUs, while preserving user privacy through complete on-device processing. Our work shows that strategically redesigned CSs can overcome their historical latency limitations, offering a promising path forward for practical voice-based AI agents.

eess.AS↗

Embarrassingly Simple Self-Distillation Improves Code Generation

Can a large language model (LLM) improve at code generation using only its own raw outputs, without a verifier, a teacher model, or reinforcement learning? We answer in the affirmative with simple self-distillation (SSD): sample solutions from the model with certain temperature and truncation configurations, then fine-tune on those samples with standard supervised fine-tuning. SSD improves Qwen3-30B-Instruct from 42.4% to 55.3% pass@1 on LiveCodeBench v6, with gains concentrating on harder problems, and it generalizes across Qwen and Llama models at 4B, 8B, and 30B scale, including both instruct and thinking variants. To understand why such a simple method can work, we trace these gains to a precision-exploration conflict in LLM decoding and show that SSD reshapes token distributions in a context-dependent way, suppressing distractor tails where precision matters while preserving useful diversity where exploration matters. Taken together, SSD offers a complementary post-training direction for improving LLM code generation. Our code is available at https://github.com/apple/ml-ssd

cs.CL↗

CSPMNet: Pareto-Efficient Automatic Modulation Classification With Learnable Complex Subband Phase Motion

Automatic modulation classification (AMC) is an essential technique for noncooperative spectrum monitoring and intelligent wireless receivers. However, practical AMC models must identify modulation formats from short and noisy I/Q observations while maintaining low computational and storage overhead. Existing deep-learning approaches often improve recognition accuracy by expanding generic neural backbones, which increases deployment cost and weakens their suitability for resource-constrained receivers. To bridge the gap between recognition performance and model efficiency, this letter proposes a Complex Subband Phase-Motion Network, designated as CSPMNet, for lightweight AMC from raw I/Q samples. Specifically, learnable complex subband filters are introduced to adaptively extract frequency-selective baseband responses while preserving the algebraic coupling between in-phase and quadrature components. Then, an amplitude-preserving phase-motion module captures multi-lag temporal rotation dynamics within each subband, and a lightweight temporal classifier performs efficient sequence aggregation. Rigorous experimental evaluations on public RadioML benchmark datasets demonstrate that CSPMNet achieves highly competitive recognition accuracy while requiring substantially lower model complexity than many existing AMC models.

eess.SP↗

Primal Generation, Dual Judgment: Self-Training from Test-Time Scaling

Code generation is typically trained in the primal space of programs: a model produces a candidate solution and receives sparse execution feedback, often a single pass/fail bit. Test-time scaling enriches the inference procedure by sampling multiple candidates and judging among them, but the comparative information this process reveals is discarded after inference. We argue that this information defines a dual judgment space that provides a far richer training signal: the model learns not from an isolated success or failure, but from the relative correctness structure across its own plausible attempts, identifying which succeed, which fail, and what distinguishes them. We introduce DuST (Dual Self-Training), a framework for self-training from the dual judgment space. DuST samples candidate programs from the model's own distribution, labels them through sandbox execution, retains groups containing both successes and failures, and trains the model to rank candidates by execution correctness using GRPO. The objective is purely discriminative: the model is never directly rewarded for generating correct programs. Dual self-training improves both judgment and generation. Across five models spanning two families and three scales (4B to 30B), DuST consistently improves Best-of-4 test-time scaling on LiveCodeBench. For Qwen3-30B-Thinking on LiveCodeBench v6, judgment quality improves by +6.2 NDCG, single-sample pass@1 improves by +3.1, and Best-of-4 accuracy improves by +4.1. The trained model's single rollout matches the base model's Best-of-4 performance. SFT on the same ranking data improves judgment without improving generation, confirming that on-policy RL is the mechanism that transfers dual-space learning back into primal generation.

cs.LG↗

SEI-SHIELD: Robust Specific Emitter Identification Under Label Noise Via Self-Supervised Filtering and Iterative Rescue

Specific Emitter Identification (SEI) provides physical-layer device authentication for wireless communications and Internet of Things (IoT) systems. While deep learning (DL) has significantly advanced SEI performance, label noise severely degrades system reliability in non-cooperative environments. Label noise originates from channel-induced ambiguities, annotation errors, and deliberate data poisoning by intelligent jammers injecting misleading signals. While recent SEI methods attempt to mitigate label noise, they fundamentally rely on corrupted supervised signals to guide sample selection, inevitably leading to confirmation bias and suboptimal feature spaces. To address this challenge, we propose SEI-SHIELD, a robust SEI framework that integrates self-supervised contrastive pre-training with iterative sample selection. Specifically, SEI-SHIELD employs Momentum Contrast (MoCo) with RF-tailored augmentations to extract intrinsically robust, label-independent representations directly from complex-valued I/Q signals. In addition, K-nearest neighbors (KNN)-based noise filtering identifies corrupted samples through neighborhood label consistency analysis in the learned feature space. Furthermore, an iterative rescue mechanism using prediction confidence and prototype cosine similarity progressively recovers correctly labeled hard samples inadvertently discarded during filtering. Comprehensive experiments on the POWDER and ORACLE datasets demonstrate that SEI-SHIELD achieves state-of-the-art (SOTA) accuracy under various noise rates, substantially outperforming existing noise-robust paradigms, including advanced regularization techniques and sample selection frameworks.

eess.SP↗

Generalized Small Object Detection:A Point-Prompted Paradigm and Benchmark

Small object detection (SOD) remains challenging due to extremely limited pixels and ambiguous object boundaries. These characteristics lead to challenging annotation, limited availability of large-scale high-quality datasets, and inherently weak semantic representations for small objects. In this work, we first address the data limitation by introducing TinySet-9M, the first large-scale, multi-domain dataset for small object detection. Beyond filling the gap in large-scale datasets, we establish a benchmark to evaluate the effectiveness of existing label-efficient detection methods for small objects. Our evaluation reveals that weak visual cues further exacerbate the performance degradation of label-efficient methods in small object detection, highlighting a critical challenge in label-efficient SOD. Secondly, to tackle the limitation of insufficient semantic representation, we move beyond training-time feature enhancement and propose a new paradigm termed Point-Prompt Small Object Detection (P2SOD). This paradigm introduces sparse point prompts at inference time as an efficient information bridge for category-level localization, enabling semantic augmentation. Building upon the P2SOD paradigm and the large-scale TinySet-9M dataset, we further develop DEAL (DEtect Any smalL object), a scalable and transferable point-prompted detection framework that learns robust, prompt-conditioned representations from large-scale data. With only a single click at inference time, DEAL achieves a 31.4% relative improvement over fully supervised baselines under strict localization metrics (e.g., AP75) on TinySet-9M, while generalizing effectively to unseen categories and unseen datasets. Our project is available at https://zhuhaoraneis.github.io/TinySet-9M/.

cs.CV↗

Power loss for the Mizohata-Takeuchi conjecture on $C^k$ convex hypersurfaces

We find a family of compact $C^k$ hypersurfaces where the local Mizohata-Takeuchi Conjecture fails with a power loss of $R^α$ for any $α<\frac{n-1}{n-1+k}$. Moreover, this family is dense in the $C^k$ topology, and so the local Mizohata-Takeuchi conjecture fails for many convex hypersurfaces. In particular, the local Mizohata-Takeuchi Conjecture fails with a power loss of $R^α$ for any $α<\frac{n-1}{n+1}$ for many $C^2$ convex hypersurfaces. This power matches the best known upper bound in a paper by Tony Carbery, Marina Iliopoulou and Hong Wang up to the endpoint. For the proof, our weight is positive definite as in the first author's recent $\log(R)$-loss counterexample, and our construction is based on a projection of a higher rank lattice. As a by-product, we also construct compact convex $C^2$ hypersurfaces whose rescaling contains many lattice points in any dimension.

math.CA↗

Sobolev Differentiability Properties of Logarithmic Modulus of Real Analytic Functions

Let $f$ be the germ of a real analytic function at the origin in $\mathbb{R}^n $ for $n \geq 2$, and suppose the codimension of the zero set of $f$ at $\mathbf{0}$ is at least $2$. We show that $\log |f|$ is $W^{1,1}_{\operatorname{loc}}$ near $\mathbf{0}$. In particular, this implies the differential inequality $|\nabla f |\leq V |f|$ holds with $V \in L^1_{\operatorname{loc}}$.

math.CA↗

Discrete Neural Flow Samplers with Locally Equivariant Transformer

Sampling from unnormalised discrete distributions is a fundamental problem across various domains. While Markov chain Monte Carlo offers a principled approach, it often suffers from slow mixing and poor convergence. In this paper, we propose Discrete Neural Flow Samplers (DNFS), a trainable and efficient framework for discrete sampling. DNFS learns the rate matrix of a continuous-time Markov chain such that the resulting dynamics satisfy the Kolmogorov equation. As this objective involves the intractable partition function, we then employ control variates to reduce the variance of its Monte Carlo estimation, leading to a coordinate descent learning algorithm. To further facilitate computational efficiency, we propose locally equivaraint Transformer, a novel parameterisation of the rate matrix that significantly improves training efficiency while preserving powerful network expressiveness. Empirically, we demonstrate the efficacy of DNFS in a wide range of applications, including sampling from unnormalised distributions, training discrete energy-based models, and solving combinatorial optimisation problems.

cs.LG↗

Continuously Augmented Discrete Diffusion model for Categorical Generative Modeling

Standard discrete diffusion models treat all unobserved states identically by mapping them to an absorbing [MASK] token. This creates an 'information void' where semantic information that could be inferred from unmasked tokens is lost between denoising steps. We introduce Continuously Augmented Discrete Diffusion (CADD), a framework that augments the discrete state space with a paired diffusion in a continuous latent space. This yields graded, gradually corrupted states in which masked tokens are represented by noisy yet informative latent vectors rather than collapsed 'information voids'. At each reverse step, CADD may leverage the continuous latent as a semantic hint to guide discrete denoising. The design is clean and compatible with existing discrete diffusion training. At sampling time, the strength and choice of estimator for the continuous latent vector enables a controlled trade-off between mode-coverage (generating diverse outputs) and mode-seeking (generating contextually precise outputs) behaviors. Empirically, we demonstrate CADD improves generative quality over mask-based diffusion across text generation, image synthesis, and code modeling, with consistent gains on both qualitative and quantitative metrics against strong discrete baselines.

stat.ML↗