arXiv Science⌕ Search

SEARCH · arXiv Science

Search arXiv Science

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3Linked to original sources
arXiv2026

Post-Training Large Language Models via Reinforcement Learning from Self-Feedback

Large Language Models (LLMs) often produce plausible but poorly-calibrated answers, limiting their reliability on reasoning-intensive tasks. Recent research suggests that Chain-of-Thought (CoT) reasoning paths are inherent in pre-trained LLMs and can be elicited by simply altering the decoding process, where the presence of a CoT path correlates with higher answer confidence. Building on these insights, we present Reinforcement Learning from Self-Feedback (RLSF), a post-training stage that utilises the model's intrinsic confidence as a self-generated reward. By generating multiple CoT decoding beams from a frozen LLM, we compute the confidence of each final answer span and rank the resulting traces accordingly to create synthetic preferences. These preferences are subsequently utilised to fine-tune the policy through standard preference optimisation, requiring no human labels, gold answers, or externally curated rewards. RLSF simultaneously (i) refines the model's probability estimates--restoring well-behaved calibration--and (ii) strengthens step-by-step reasoning, yielding improved performance on arithmetic reasoning and multiple-choice question answering. By converting a model's own uncertainty into structured self-feedback, RLSF affirms reinforcement learning on intrinsic model behaviour as a principled and data-efficient component of the LLM post-training pipeline. Our results demonstrate that leveraging these inherent reasoning capabilities provides a robust path for enhancing model reliability without manual prompt engineering or external supervision.

cs.CL↗
arXiv2026

Likelihood-free Posterior Density Learning for Uncertainty Quantification in Inference Problems

Generative models and those with computationally intractable likelihoods are widely used to describe complex systems in the natural sciences, social sciences, and engineering. Fitting these models to data requires likelihood-free inference methods that explore the parameter space without explicit likelihood evaluations, relying instead on sequential simulation, which comes at the cost of computational efficiency and extensive tuning. We develop an alternative framework called kernel-adaptive synthetic posterior estimation (KASPE) that uses deep learning to directly reconstruct the mapping between the observed data and a finite-dimensional parametric representation of the posterior distribution, trained on a large number of simulated datasets. We provide theoretical justification for KASPE and a formal connection to the likelihood-based approach of expectation propagation. Simulation experiments demonstrate KASPE's flexibility and performance relative to existing likelihood-free methods including approximate Bayesian computation in challenging inferential settings involving posteriors with heavy tails, multiple local modes, and over the parameters of a nonlinear dynamical system.

stat.ME↗
arXiv2026

Cryptanalysis of Isogeny-Based Quantum Money with Rational Points

Quantum money is a representative application in cryptography that utilizes quantum technology to achieve security that is unattainable with classical systems. Since the theoretical proposal by Wiesner in 1983, the most recent instantiation is the quantum money using class group actions on elliptic curves, proposed by Montgomery and Sharif in Asiacrypt'24. In this work, we propose a concrete cryptanalysis by leveraging the efficiency of evaluating division polynomials with the coordinates of rational points, offering a speedup of $O(\log^4p)$ compared to the brute-force attack. While the resulting attack still runs in exponential time, our method provides the first nontrivial algorithmic insight into their structural hardness. Furthermore, due to the algebraic properties of rational points and quadratic twists, our technique naturally yields a more efficient verification procedure for the underlying quantum money. We believe this new line of analysis opens promising directions for future research in elliptic-curve-based quantum cryptography.

cs.CR↗
arXiv2026

Shrinkers of the area-preserving curve-shortening flow: Classification and saddle-point property

We consider homothetic evolutions of the area-preserving curve-shortening flow (APCSF), that is, classical curve-shortening flow with an additional non-local forcing term. By using known results on $λ$-curves, we prove the existence of non-circular shrinkers for this flow. In our first main result, we present a full classification of such curves, similar to the well-known Abresch-Langer classification for shrinkers of curve-shortening flow. Finally, we also deduce a saddle-point property for all non-circular (APCSF)-shrinkers analogous to the known saddle-point property of Abresch-Langer curves.

math.DG↗
arXiv2026

Majority Bit-Aware Watermarking For Large Language Models

The growing deployment of Large Language Models (LLMs) has raised concerns about their misuse in generating harmful or deceptive content. To address this issue, watermarking methods have been proposed to embed identifiable multi-bit messages into generated text for misuse tracing. However, existing methods often suffer from a fundamental trade-off between text quality and decoding accuracy. In particular, they have to restrict the size of the preferred token set (i.e., green list) during encoding to maintain a detectable watermark signal for decoding, which inevitably degrades generation quality. To improve this trade-off, we propose a novel message encoding paradigm called \textit{majority bit-aware encoding}, which relaxes the watermark signal strength from the green list size. This strategy allows for a strong watermark signal to be preserved in generated texts even when using a large green list. We introduce two instantiations of this paradigm: MajorMark and MajorMark$^{+}$, where the latter is specifically optimized for long messages. Extensive experiments on state-of-the-art LLMs demonstrate that our methods achieve higher decoding accuracy and superior text quality compared to prior baselines. The code is at https://github.com/JiiahaoXU/MajorMark.

cs.CL↗
arXiv2026

Constraints on Compact Dark Matter Population from Micro-lensing Effect of Gravitational Wave for the third-generation gravitational Wave Detector

Since the first direct detection of gravitational waves (GWs) from a binary black-hole merger by the LIGO-Virgo Collaboration, GWs have emerged as a powerful probe of astrophysics and cosmology. If extragalactic compact dark matter (DM) candidates, such as primordial black holes, constitute a non-negligible fraction of the DM component over a broad mass range, they can imprint distinctive microlensing signatures on GW signals. In this work, we develop a framework to infer the population properties of extragalactic compact DM by simulating microlensing GWs in the frequency band of the third-generation ground-based GW detector, the Einstein Telescope, and analyzing them via hierarchical Bayesian inference. For a population described by a power-law mass function, we show that the detection of only several microlensing GW events among $10^4$ binary black-hole coalescences can constrain the compact DMs abundance to the level of $\sim 10^{-3}$. This forecast demonstrates that searching for and identifying microlensing signatures in future GW observations can provide a complementary approach to constraining compact DM scenarios.

astro-ph.CO↗
arXiv2026

LSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding

Large-scale scene data is essential for training and testing in robot learning. Neural reconstruction methods have promised the capability of reconstructing large physically-grounded outdoor scenes from captured sensor data. However, these methods have baked-in static environments and only allow for limited scene control -- they are functionally constrained in scene and trajectory diversity by the captures from which they are reconstructed. In contrast, generating driving data with recent image or video diffusion models offers control, however, at the cost of geometry grounding and causality. In this work, we aim to bridge this gap and present a method that directly generates large-scale 3D driving scenes with accurate geometry, allowing for causal novel view synthesis with object permanence and explicit 3D geometry estimation. The proposed method combines the generation of a proxy geometry and environment representation with score distillation from learned 2D image priors. We find that this approach allows for high controllability, enabling the prompt-guided geometry and high-fidelity texture and structure that can be conditioned on map layouts -- producing realistic and geometrically consistent 3D generations of complex driving scenes.

cs.CV↗
arXiv2026

SAGE: A Set-based Adaptive Gradient Estimator

We introduce a set membership perspective on gradient estimation for black-box scalar functions, in which the gradient is not approximated as a single point estimate but characterised as a member of a set of admissible gradients consistent with available function samples and regularity assumptions. Bounds on gradient uncertainty, obtained from standard multivariate Taylor series results, are used to represent this admissible set through linear inequalities, making gradient uncertainty explicit and directly exploitable. Building on this formulation, we propose an adaptive strategy to refine the admissible gradient set to a desired precision by selectively acquiring new samples only when necessary. The resulting framework naturally accommodates function evaluations affected by noise with finite but a priori unknown bounds, yields the theoretical best attainable precision of the gradient set, and provides the optimal sampling distance from the point of interest to maximise information gain during refinement. Within this framework, we introduce the Set-Based Adaptive Gradient Estimator (SAGE), which extracts an estimate of the true gradient from the admissible set whilst preserving high sample efficiency and robustness to noise. Numerical experiments on large collections of random gradient-query points, as well as in the context of a first-order optimisation method, compared the performance of SAGE against commonly used gradient estimators from the literature. Our results show that SAGE achieved competitive gradient accuracy across noise levels without requiring any a priori noise characterisation. In a first-order optimisation setting, noise-informed competitors can outperform SAGE when such characterisation is available. Nevertheless, SAGE remained broadly competitive, making it particularly attractive in settings where noise characterisation is impractical to obtain.

math.OC↗
arXiv2026

A two-phase model of galaxy formation: IV. Seeding and growing supermassive black holes in dark matter halos

We present a theoretical framework for seeding and growing supermassive black holes (SMBHs) in dark matter halos along their assembly histories. Seeds are bred out of Pop-III stars formed during the first collapse of pristine gas in mini-halos that have reached the ${\rm H}_2$-cooling limit, modulated by UV radiation from star formation and dynamical heating from fast halo assembly. Such breeding persists until the enrichment of the intergalactic medium (IGM) enables Pop-II stars to form. Post-seeding growth of black holes (BHs) is driven by distinct channels, starting with episodic super-Eddington accretion associated with nuclear bursts induced by global disturbances of galaxies, followed by sustained sub-Eddington accretion via capturing sub-clouds formed in self-gravitating gas clouds (SGCs) in halos of fast assembly, and ending with merger-dominated, quiescent growth. We implement the model in subhalo merger trees to build a coherent framework to follow SMBH-galaxy-halo co-evolution across the whole history and structural hierarchy. BH seeds are bred with a broad mass spectrum of $M_{\rm BH} = 10$--$10^5\,{\rm M}_\odot$ at $z \approx 20$--$30$ in mini-halos with masses of $10^5$--$10^8\,{\rm M}_\odot$. Nuclear bursts provide the key condition for seeds to grow into SMBHs. The $M_{\rm BH}$-$M_*$ relation is a multi-piece, redshift-dependent function shaped by the interplay among different growth channels. Our model predictions are broadly consistent with existing observations; in particular, a population of BHs reminiscent of `little red dots' (LRDs) discovered by JWST naturally results from the seeding and growing processes. Potential future tests of the model are discussed.

astro-ph.GA↗
arXiv2026

Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models

We introduce Genome-Factory, the first integrated Python library for tuning, deploying, and interpreting genomic foundation models. Our core contribution is to simplify and unify the workflow for genomic model development: data collection, model tuning, inference, benchmarking, and interpretability. For data collection, Genome-Factory offers an automated pipeline to download genomic sequences and preprocess them. For model tuning, Genome-Factory supports both full and parameter-efficient fine-tuning across diverse genomic models. For inference, Genome-Factory enables both embedding extraction and DNA sequence generation. For benchmarking, we include two existing benchmarks and provide a flexible interface to incorporate additional benchmarks. For interpretability, Genome-Factory introduces an open-source biological interpreter based on a sparse auto-encoder. We validate the utility of Genome-Factory across three dimensions: (i) Compatibility with diverse models and fine-tuning methods; (ii) Benchmarking downstream performance using two open-source benchmarks; (iii) Biological interpretation of learned representations with DNABERT-2. These results highlight its practical value for real-world genomic analysis. GitHub: https://github.com/WeiminWu2000/Genome_Factory.

q-bio.GN↗
arXiv2026

Federated Learning in the Wild: A Comparative Study for Cybersecurity under Non-IID and Unbalanced Settings

Machine Learning (ML) techniques have shown strong potential for network traffic analysis; however, their effectiveness depends on access to representative, up-to-date datasets, which is limited in cybersecurity due to privacy and data-sharing restrictions. To address this challenge, Federated Learning (FL) has recently emerged as a novel paradigm that enables collaborative training of ML models across multiple clients while ensuring that sensitive data remains local. Nevertheless, Federated Averaging (FedAvg), the canonical FL algorithm, has shown poor convergence in heterogeneous environments characterised by non-independent and identically distributed (i.i.d.) data distributions and unbalanced dataset sizes across clients, conditions frequently observed in cybersecurity contexts. To overcome these challenges, several alternative FL algorithms have been developed, yet their applicability to network intrusion detection remains insufficiently explored. This study systematically evaluates a range of FL algorithms in the context of network intrusion detection for DDoS attacks. Using a dataset of recent network attacks, the evaluation considers detection performance, training time, and communication overhead under non-i.i.d. settings, providing practical insights into the selection of FL solutions for network intrusion detection.

cs.CR↗
arXiv2026

Machine Learning Algorithms for Improving Black Box Optimization Solvers

Black-box optimization (BBO) addresses problems where objectives are accessible only through costly queries without gradients or explicit structure. Classical derivative-free methods---line search, direct search, and model-based solvers such as Bayesian optimization---form the backbone of BBO, yet often struggle in high-dimensional, noisy, or mixed-integer settings. Recent advances use machine learning (ML) and reinforcement learning (RL) to enhance BBO: ML provides expressive surrogates, adaptive updates, meta-learning-based algorithm selection, and generative models, while the RL--BBO interface includes dynamic operator configuration, robust policy search, and meta-optimization across tasks. This paper surveys these developments, covering representative algorithms such as the modular model-based optimization framework (mlrMBO), zeroth-order adaptive momentum methods (ZO-AdaMM), automated BBO (ABBO), distributed block-wise optimization (DiBB), partition-based Bayesian optimization (SPBOpt), the transformer-based optimizer (B2Opt), diffusion-model-based BBO, surrogate-assisted RL for differential evolution (Surr-RLDE), robust BBO (RBO), coordinate-ascent MORE with step size adaptation (CAS-MORE), log-barrier stochastic gradient descent (LB-SGD), policy improvement with black-box (PIBB), and offline Q-learning with Mamba backbones (Q-Mamba). We further review benchmark efforts such as the NeurIPS 2020 BBO Challenge and the MetaBox framework. A controlled numerical study further confirms that ML-based candidate screening can improve the evaluation-budget performance of direct search and differential evolution, while the benefit remains solver-dependent.

cs.LG↗
arXiv2026

Stylos: Multi-View 3D Stylization with Single-Forward Gaussian Splatting

We present Stylos, a single-forward 3D Gaussian framework for 3D style transfer that operates on unposed content, from a single image to a multi-view collection, conditioned on a separate reference style image. Stylos synthesizes a stylized 3D Gaussian scene without per-scene optimization or precomputed poses, achieving geometry-aware, view-consistent stylization that generalizes to unseen categories, scenes, and styles. At its core, Stylos adopts a Transformer backbone with two pathways: geometry predictions retain self-attention to preserve geometric fidelity, while style is injected via global cross-attention to enforce visual consistency across views. With the addition of a voxel-based 3D style loss that aligns aggregated scene features to style statistics, Stylos enforces view-consistent stylization while preserving geometry. Experiments across multiple datasets demonstrate that Stylos delivers high-quality zero-shot stylization, highlighting the effectiveness of global style-content coupling, the proposed 3D style loss, and the scalability of our framework from single view to large-scale multi-view settings. Our codes are available at https://github.com/HanzhouLiu/Stylos.

cs.CV↗
arXiv2026

HomID : Benchmarking Intrinsic Dimension Estimators on Homogenous Manifolds with Anisotropic Embeddings

The manifold hypothesis suggests that data lies on manifolds with smaller intrinsic dimension (ID) than their ambient dimension. However there is no empirical agreement on the estimates for ID from different estimators for realistic datasets. Thus it is important to test ID estimators (IDEs) with targeted stressors. In this work, we consider the role of anisotropy. To this end, we propose HomID, a collection of homogeneous spaces with anisotropic embedding, for benchmarking ID estimators. We observe that methods that perform well on standard benchmarks systematically degrade on HomID under identical resource allocation. We further observe that anisotropic distortion of such benchmarks also results in performance degradation. Finally, we demonstrate that controlled anisotropic distortions induce systematic shifts in the distributions on which these methods rely, providing a concrete mechanism for the resulting estimation errors in two particular IDEs. The code for the project is available at https://github.com/a-writes-code/homid

cs.LG↗
arXiv2026

Image Generation Based on Image Style Extraction

Image generation based on text-to-image generation models is a task with practical application scenarios that fine-grained styles cannot be precisely described and controlled in natural language, while the guidance information of stylized reference images is difficult to be directly aligned with the textual conditions of traditional textual guidance generation. This study focuses on how to maximize the generative capability of the pretrained generative model, by obtaining fine-grained stylistic representations from a single given stylistic reference image, and injecting the stylistic representations into the generative body without changing the structural framework of the downstream generative model, so as to achieve fine-grained controlled stylized image generation. In this study, we propose a three-stage training style extraction-based image generation method, which uses a style encoder and a style projection layer to align the style representations with the textual representations to realize fine-grained textual cue-based style guide generation. In addition, this study constructs the Style30k-captions dataset, whose samples contain a triad of images, style labels, and text descriptions, to train the style encoder and style projection layer in this experiment.

cs.CV↗
arXiv2026

QuantDemoire: Quantization with Outlier Aware for Image Demoiréing

Demoiréing aims to remove moiré artifacts that often occur in images. While recent deep learning-based methods have achieved promising results, they typically require substantial computational resources, limiting their deployment on edge devices. Model quantization offers a compelling solution. However, directly applying existing quantization methods to demoiréing models introduces severe performance degradation. The main reasons are distribution outliers and weakened representations in smooth regions. To address these issues, we propose QuantDemoire, a post-training quantization framework tailored to demoiréing. It contains two key components. First, we introduce an outlier-aware quantizer to reduce errors from outliers. It uses sampling-based range estimation to reduce activation outliers and keeps a few extreme weights in FP16 with negligible cost. Second, we design a frequency-aware calibration strategy. It emphasizes low- and mid-frequency components during fine-tuning, which mitigates banding artifacts caused by low-bit quantization. Experiments validate that our QuantDemoire achieves large reductions in parameters and computation while maintaining quality. Meanwhile, it outperforms existing quantization methods by over 4 dB on W4A4. We implement a CUDA kernel for the mixed-precision branch and achieve a 2.3$\times$ end-to-end speedup on an RTX 4090 GPU. Code is released at: https://github.com/zhengchen1999/QuantDemoire.

cs.CV↗
arXiv2026

On singular vectors and associated Weyl elements for simply-laced universal affine vertex operator algebras

Given a finite-dimensional complex simple Lie algebra $\mathfrak{g}$ and a complex number $κ$, let $V^κ(\mathfrak{g})$ be the associated universal affine vertex algebra. Gorelik and Kac [GK07] gave a sufficient and necessary condition for $V^κ(\mathfrak{g})$ to be simple. In this paper, for simply-laced $\mathfrak{g}$ and non-critical $κ$, we determine the weights of singular vectors of $V^κ(\mathfrak{g})$ with minimal conformal weights, when $V^κ(\mathfrak{g})$ is not simple. We further determine all the longest Weyl elements in the Kashiwara-Tanisaki character theorem [KT00] which correspond to the weights of the singular vectors.

math.QA↗
arXiv2026

Model fit vs prediction performance: contrasting fixed-coefficient models with mixture models

Mixture models such as mixed logit and latent class routinely achieve large gains in fit on panel data, yet several studies have found that these gains do not carry over to out-of-sample prediction. This paper explains why, building on the distinction between population-level and person-level prediction familiar from statistics. The panel log-likelihood of a mixture is exactly the cumulative score of forecasts that condition each choice on the person's earlier choices. Models are instead usually validated and applied with unconditional forecasts, which use only the estimated distribution of tastes and are scored by the cross-sectional log-likelihood. The difference between the two log-likelihoods, which we call choice consistency, comes from reproducing the dependence between a person's choices, and unconditional forecasts cannot use it. Decomposing the fit gain into choice consistency and heterogeneity, we show that when the assumed mixing distribution cannot reproduce this dependence exactly, pursuing choice consistency distorts the estimated heterogeneity, so that a mixture may predict single choices worse than a model without mixing. In two case studies, on revealed preference and stated choice data, choice consistency accounts for more than 90% of the fit gain for each of the fourteen panel mixtures. In our data, the part of the fit gain that helps to forecast single choices shrinks as people make more choices, and with many choices per person it becomes negative, leaving the mixture worse than a model without mixing. Mixtures forecast single choices clearly better only when the forecast can condition on the person's own earlier choices, which is often not possible in practice. For forecasting, the score of a panel mixture on single choices should therefore be reported alongside its fit, which requires only one further evaluation of the likelihood.

econ.EM↗