arXiv subjects

Anirban Das

Publications and source records attributed to Anirban Das.

At least 19 recordsLinked to original sources

arXiv2026

The Rise of Verbal Reinforcement Learning

Natural language is emerging as a primary feedback channel for improving language agents, capable of conveying intent, preferences, and causal structure in forms interpretable by both humans and modern language models. We call this paradigm Verbal Reinforcement Learning (VRL) and offer the first unified account of it. We organize the field around a single axis, \textit{when} verbal feedback takes effect in an agent's lifecycle and \textit{what} it modifies, yielding three pillars: (1) \textbf{Language as Grounding Signal}, where language defines the task itself by specifying goals, states, and reward structures; (2) \textbf{Language as Deliberative Feedback}, where natural language guides reasoning at test time without the need to update model parameters; (3) \textbf{Language as Learning Signal}, where language-based feedback shapes model parameters through training. Within each pillar, we synthesize representative work, distinguish key subcategories of approaches, and outline the distinct role language plays in shaping agent behavior. Together, this taxonomy shows how verbal reinforcement is reshaping agent development, while also defining the challenges and opportunities for building more capable and aligned agents.

cs.CL↗

arXiv2026

AcCoRD: Evaluating User-Agent Collaboration Under Realistic User Preference Dynamics

User preferences in user-agent collaboration are rarely static and fully-specified upfront: preferences are formed, revealed, adjusted, and relaxed during interaction. Existing benchmarks for evaluating user-agent collaboration focus almost exclusively on resolving underspecified preferences, thereby failing to capture the richer dynamics of real-world interaction. We introduce AcCoRD, a user-agent collaboration benchmark requiring agents to handle diverse user preference dynamics in two domains: online shopping and travel planning. We evaluate five frontier LLMs under two prompting strategies: vanilla ReAct, and an uncertainty-guided variant that prompts models to identify and resolve ambiguity about user preferences. Our results reveal that frontier models can handle underspecification but struggle to satisfy preferences that emerge or evolve mid-interaction and require more sophisticated uncertainty modeling. Further, prompting alone fails to elicit the required uncertainty recognition. We release AcCoRD as a resource for developing agents that can navigate the full complexity of real-world user preferences.

cs.AI↗

arXiv2026

Structured Thoughts For Improved Reasoning And Context Pruning

Large language models (LLMs) excel at generating long chains of thought, but long reasoning traces are often verbose and memory-inefficient. In this work, we introduce Structured Thoughts, a framework that organizes reasoning into alternating and blocks: captures exploratory scratch work, while contains the distilled conclusion of that step. We construct a dataset of structured thoughts by segmenting reasoning traces into blocks and prompting an LLM to summarize each step into its corresponding . Fine-tuning pretrained foundation models on this reformatted data produces models that adopt the structured reasoning style, leading to performance gains of up to 8.08\% on reasoning benchmarks compared to standard SFT. The explicit structure also enables context pruning: after each / pair, the can be pruned, allowing the model to retain conclusions without keeping the full scratch work in the context. A proof-of-concept pruning implementation achieves an average of 85\% memory / context savings with an 8.67\% performance drop across mathematical tasks.

cs.CL↗

arXiv2026

Project Auto-World: Towards Automated Benchmarking of Neural Relational Reasoners

Reasoning about relational structures remains a significant challenge for neural models, particularly when they must systematically apply learned knowledge to problem instances that are harder than those seen in training. Progress is hampered by the difficulty of evaluating such generalization, since a priori, it is rarely clear what makes an instance hard. We study how this issue can be addressed by using large language models (LLMs) to automate benchmark generation, learning to produce increasingly challenging instances in an end-to-end manner. Concretely, given a world parametrized by Datalog rules, and an Edge Transformer as the reasoning evaluator, we use LLM-driven evolutionary search (based on FunSearch) and autonomous agentic search to discover sampling functions that yield hard problem instances. We also show that the Edge Transformer can be improved using this data such that it generalizes well to further data perturbations. Finally, we show that the same machinery can be applied to novel worlds proposed by LLMs, opening the door to autonomous research on neural relational reasoning.

cs.AI↗

arXiv2026

T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains

Recent advances in reasoning and tool-calling capabilities of large language models (LLMs) have enabled increasingly capable agentic systems. However, existing benchmarks remain limited in task complexity, realism, and domain diversity, and often fail to capture interactions that span multiple domains, limiting their ability to evaluate agents in realistic multi-step settings that require sustained reasoning and coordination. To address these limitations, we introduce T1-Bench, a high-fidelity, comprehensive benchmark for evaluating agentic systems in realistic customer-facing, multi-domain environments, featuring interleaved scenarios that require structured reasoning across multi-turn user-assistant interactions and substantially increasing both compositional complexity and evaluative rigor across 25 domains of varying difficulty. We evaluate T1-Bench using 12 proprietary and open-weight models, providing a reproducible and standardized framework for assessing agent behavior, tool utilization, and conversational quality in complex, multi-step environments. We further complement automatic evaluation with human judgments to strengthen the assessment of qualitative performance. Overall, T1-Bench substantially advances prior benchmarks by increasing task complexity, interaction depth, and domain coverage in simulated multi-domain environments. To facilitate future research on agentic systems, we will publicly release data and evaluation code as open source.

cs.CL↗

arXiv2026

Probing freeze-in dark matter using Bose-Einstein condensate in neutron star

Neutron star (NS) is one of the most promising astrophysical targets to probe non-gravitational interaction of dark matter (DM) with visible matter. Their compactness makes them an ideal object which can capture particle DM efficiently over its lifetime using the DM-nucleon scattering cross-section. If DM particles are bosonic, then the captured DM population may form a Bose-Einstein condensate at the center of the NS, increasing the DM density significantly. In this work, we study the phenomenology of such scenario with enhanced DM annihilation rate due to the increased density in a condensate. The enhanced DM annihilation makes the NS surface `hotter' than in the standard cooling scenario. We show that the annihilation rate is enhanced by a factor of $\mathcal{O}(10^{15}-10^{20})$ if DM forms a condensate, and DM with freeze-in value annihilation cross-section can heat up the NS to higher temperatures, bringing it within the reach of James Webb Space Telescope. It also allows us to probe DM-nucleon scattering cross section within the neutrino fog regime which will complement the terrestrial direct detection searches. Moreover, the enhanced annihilation from the condensate changes the lower limits on s-wave DM annihilation cross-section for capture-annihilation equilibrium and the formation of a black hole inside the NS. Finally, we show an example of a scalar DM model where such small annihilation and DM-nucleon scattering cross sections can generically arise.

hep-ph↗

arXiv2026

AVSD: Adaptive-View Self-Distillation by Balancing Consensus and Teacher-Specific Privileged Signals

Self-distillation enables language models to learn on-policy from their own trajectories by using the same model as both student and teacher, with the teacher being conditioned on privileged information unavailable to the student. Such information can come in different types or views, such as solutions, demonstrations, feedback, or final answers. This setup provides dense token-level feedback without relying on a separate external model, but creates a fundamental asymmetry: the teacher may rely on view-specific information that the student cannot access at inference time. Moreover, the best type of privileged information is often task-dependent, making it difficult to choose a single teacher view. In this work, we address both these challenges jointly by introducing AVSD (Adaptive-View Self-Distillation), a novel method of self-distillation with multiple privileged-information views, which reconstructs token-level supervision by separating stable cross-view consensus from view-specific residual signals. AVSD identifies the consensus signal shared across views, which provides a reliable update direction, and then selectively adds the view-specific residual signal to adjust the update magnitude when it both aligns with the consensus direction and remains proportionate to the consensus signal. Experiments on math competition benchmarks (AIME24, AIME25, and HMMT25) show that AVSD consistently outperforms both single-view self-distillation baselines and GRPO, achieving average Avg@8 gains of 3.1% and 2.2% over the strongest baselines on Qwen3-8B and Qwen3-4B, respectively. Moreover, on code-generation benchmarks (Codeforces, LiveCodeBench v6) using Qwen3-8B, AVSD outperforms the single-view self-distillation baseline by 2.4% on average.

cs.LG↗

arXiv2026

Dive deeper with SUBMARINE: SUB-Mev dArk matter diRect detectIon using bilayer grapheNE

Novel target materials with anisotropic response will play a key role in detecting low-mass dark matter in upcoming experiments. Bilayer graphene is one such material that has been proposed for the detection of sub-MeV mass dark matter particles via electronic excitations. In this work, we calculate scattering rate via a massive mediator in bilayer graphene. With an exposure as small as $\sim$ 0.5 mg-year, bilayer graphene can probe new regions of the parameter space. The anisotropic response function of bilayer graphene leads to a sidereal-day modulation in the scattering rate, depending on its orientation with respect to the Galactic dark matter wind. We find significant modulation in the scattering rate for sub-MeV mass dark matter, demonstrating bilayer graphene's promise for a future experiment. We hope that our work will motivate the community to investigate bilayer graphene as a novel target material, and that it may lead us to discover the particle nature of dark matter.

hep-ph↗

arXiv2026

Know Thy Reasoner: Not All Language Models Explore Alike

Compute scaling for LLM reasoning trades off exploring solution approaches (\emph{breadth}) against refining promising ones (\emph{depth}), yet why a given trade-off works, and why it often fails to transfer across models, remains unclear. We argue that \textbf{the optimal strategy depends on the model's \emph{diversity profile}, the spread of probability mass across solution approaches, and that this must be characterized before any exploration strategy is adopted.} We formalize this with a framework decomposing reasoning uncertainty, deriving when depth-based refinement outperforms parallel sampling, and validate it across three model families at both inference and training. Our central finding is that the diversity regime dictates the strategy: low-diversity aligned models benefit from depth-based refinement with lightweight intrinsic signals, whereas high-diversity base models are often harmed by it, and instead need breadth or stronger signals to compensate.

cs.AI↗

arXiv2026

Can Large Language Models Understand, Reason About, and Generate Code-Switched Text?

Code-switching is a pervasive phenomenon in multilingual communication, yet the robustness of large language models (LLMs) in mixed-language settings remains insufficiently understood. In this work, we present a comprehensive evaluation of LLM capabilities in understanding, reasoning over, and generating code-switched text. We introduce CodeMixQA a novel benchmark with high-quality human annotations, comprising 16 diverse parallel code-switched language-pair variants that span multiple geographic regions and code-switching patterns, and include both original scripts and their transliterated forms. Using this benchmark, we analyze the reasoning behavior of LLMs on code-switched question-answering tasks, shedding light on how models process and reason over mixed-language inputs. We further conduct a systematic evaluation of LLM-generated synthetic code-switched text, focusing on both naturalness and semantic fidelity, and uncover key limitations in current generation capabilities. Our findings reveal persistent challenges in both reasoning and generation under code-switching conditions and provide actionable insights for building more robust multilingual LLMs. We release the dataset and code as open source.

cs.CL↗

arXiv2025

When No Paths Lead to Rome: Benchmarking Systematic Neural Relational Reasoning

Designing models that can learn to reason in a systematic way is an important and long-standing challenge. In recent years, a wide range of solutions have been proposed for the specific case of systematic relational reasoning, including Neuro-Symbolic approaches, variants of the Transformer architecture, and specialised Graph Neural Networks. However, existing benchmarks for systematic relational reasoning focus on an overly simplified setting, based on the assumption that reasoning can be reduced to composing relational paths. In fact, this assumption is hard-baked into the architecture of several recent models, leading to approaches that can perform well on existing benchmarks but are difficult to generalise to other settings. To support further progress in the field of systematic relational reasoning with neural networks, we introduce NoRA, a new benchmark which adds several levels of difficulty and requires models to go beyond path-based reasoning.

cs.AI↗

arXiv2025

Impostor Among $\nu$s: Dark Radiation Masquerading as Self-Interacting Neutrinos

Multiple cosmological observations hint at neutrino self-interactions beyond the Standard Model, yet such interactions face severe constraints from terrestrial experiments. We resolve this tension by introducing a model where active neutrinos resonantly convert to self-interacting dark radiation after BBN but before CMB epoch. This exploits the fact that cosmological observables cannot distinguish between neutrinos and dark radiation with the same abundance and free-streaming properties. Our mechanism, based on a simple type-I seesaw framework along with a keV-scale scalar mediator, achieves two objectives: (i) it produces strongly self-interacting dark radiation that imitates neutrino self-interactions favored by cosmological data, and (ii) it depletes the active neutrino energy density, relaxing cosmological neutrino mass bounds and easing the tension with neutrino oscillation data. The model naturally evades laboratory constraints through suppression of the neutrino-mediator coupling by the squared mass ratio of active and sterile neutrinos. We show that this scenario is favored over $\Lambda$CDM by the combined Planck and DESI data, while being consistent with all other constraints. Our mechanism is testable in future laboratory probes of absolute neutrino mass and searches for sterile neutrinos.

hep-ph↗

arXiv2025

T1: A Tool-Oriented Conversational Dataset for Multi-Turn Agentic Planning

Large Language Models (LLMs) have demonstrated impressive capabilities as intelligent agents capable of solving complex problems. However, effective planning in scenarios involving dependencies between API or tool calls-particularly in multi-turn conversations-remains a significant challenge. To address this, we introduce T1, a tool-augmented, multi-domain, multi-turn conversational dataset specifically designed to capture and manage inter-tool dependencies across diverse domains. T1 enables rigorous evaluation of agents' ability to coordinate tool use across nine distinct domains (4 single domain and 5 multi-domain) with the help of an integrated caching mechanism for both short- and long-term memory, while supporting dynamic replanning-such as deciding whether to recompute or reuse cached results. Beyond facilitating research on tool use and planning, T1 also serves as a benchmark for evaluating the performance of open-weight and proprietary large language models. We present results powered by T1-Agent, highlighting their ability to plan and reason in complex, tool-dependent scenarios.

cs.CL↗

arXiv2025

Shedding Infrared Light on QCD Axion and ALP Dark Matter with JWST

James Webb Space Telescope (JWST) has opened up a new chapter in infrared astronomy. Besides the discovery and a deeper understanding of various astrophysical sources, JWST can also uncover the non-gravitational nature of dark matter (DM). If DM is QCD axion or an eV-scale Axion-like particle (ALP), it can decay into two photons in the infrared band. This will produce a distinct line signature in the spectroscopic observations made by JWST. Using the latest NIRSpec IFU spectroscopic observations from JWST, we put the strongest bound on the photon coupling for QCD axion/ ALP DM in the mass range between 0.47 and 2.55 eV. In particular, we are able to probe a new mass range for ALP DM between $\sim$ 0.47 eV to 0.78 eV beyond what can be probed by globular cluster observations. We constrain well-motivated and UV complete models of QCD axion and ALP DM, including predictions from some models derived from string theory and/ or various Grand Unification scenarios. Future JWST observations of DM-rich systems with a better understanding of the astrophysical and instrumental backgrounds can thus enable us to potentially discover QCD axion and ALP DM. The datasets used in this work are available at: https://dx.doi.org/10.17909/3e5f-nv69

hep-ph↗

arXiv2025

Continual Pre-training of MoEs: How robust is your router?

Sparsely-activated Mixture of Experts (MoE) transformers are promising architectures for foundation models. Compared to dense transformers that require the same amount of floating-point operations (FLOPs) per forward pass, MoEs benefit from improved sample efficiency at training time and achieve much stronger performance. Many closed-source and open-source frontier language models have thus adopted an MoE architecture. Naturally, practitioners will want to extend the capabilities of these models with large amounts of newly collected data without completely re-training them. Prior work has shown that a simple combination of replay, learning rate re-warming, and re-decaying can enable the continual pre-training (CPT) of dense decoder-only transformers with minimal performance degradation compared to full re-training. In the case of decoder-only MoE transformers, however, it is unclear how the routing algorithm will impact continual pre-training performance: 1) do the MoE transformer's routers exacerbate forgetting relative to a dense model?; 2) do the routers maintain a balanced load on previous distributions after CPT?; 3) are the same strategies applied to dense models sufficient to continually pre-train MoE LLMs? In what follows, we conduct a large-scale study training a 500M parameter dense transformer and four 500M-active/2B-total parameter MoE transformers. Each model is trained for 600B tokens. Our results establish a surprising robustness to distribution shifts for MoEs using both Sinkhorn-Balanced and Z-and-Aux-loss-balanced routing algorithms, even in MoEs continually pre-trained without replay. Moreover, we show that MoE LLMs maintain their sample efficiency (relative to a FLOP-matched dense model) during CPT and that they can match the performance of a fully re-trained MoE at a fraction of the cost.

cs.LG↗

arXiv2024

WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines

Vision Language Models (VLMs) often struggle with culture-specific knowledge, particularly in languages other than English and in underrepresented cultural contexts. To evaluate their understanding of such knowledge, we introduce WorldCuisines, a massive-scale benchmark for multilingual and multicultural, visually grounded language understanding. This benchmark includes a visual question answering (VQA) dataset with text-image pairs across 30 languages and dialects, spanning 9 language families and featuring over 1 million data points, making it the largest multicultural VQA benchmark to date. It includes tasks for identifying dish names and their origins. We provide evaluation datasets in two sizes (12k and 60k instances) alongside a training dataset (1 million instances). Our findings show that while VLMs perform better with correct location context, they struggle with adversarial contexts and predicting specific regional cuisines and languages. To support future research, we release a knowledge base with annotated food entries and images along with the VQA data.

cs.CL↗

arXiv2024

Dynamical freezing in the thermodynamic limit: the strongly driven ensemble

The ergodicity postulate, a foundational pillar of Gibbsian statistical mechanics predicts that a periodically driven (Floquet) system in the absence of any conservation law heats to a featureless `infinite temperature' state. Here, we find--for a clean and interacting generic spin chain subject to a {\it strong} driving field--that this can be prevented by the emergence of {\it approximate but stable} conservation-laws not present in the undriven system. We identify their origin: they do not necessarily owe their stability to familiar protections by symmetry, topology, disorder, or even high energy costs. We show numerically, {\it in the thermodynamic limit,} that when required by these emergent conservation-laws, the entanglement-entropy density of an infinite subsystem remains zero over our entire simulation time of several decades in natural units. We further provide a recipe for designing such conservation laws with high accuracy. Finally, we present an ensemble description, which we call the strongly driven ensemble incorporating these constraints. This provides a way to control many-body chaos through stable Floquet-engineering. Strong signatures of these conservation-laws should be experimentally accessible since they manifest in all length and time scales. Variants of the spin model we have used, have already been realized using Rydberg-dressed atoms.

cond-mat.stat-mech↗

arXiv2024

RainbowPO: A Unified Framework for Combining Improvements in Preference Optimization

Recently, numerous preference optimization algorithms have been introduced as extensions to the Direct Preference Optimization (DPO) family. While these methods have successfully aligned models with human preferences, there is a lack of understanding regarding the contributions of their additional components. Moreover, fair and consistent comparisons are scarce, making it difficult to discern which components genuinely enhance downstream performance. In this work, we propose RainbowPO, a unified framework that demystifies the effectiveness of existing DPO methods by categorizing their key components into seven broad directions. We integrate these components into a single cohesive objective, enhancing the performance of each individual element. Through extensive experiments, we demonstrate that RainbowPO outperforms existing DPO variants. Additionally, we provide insights to guide researchers in developing new DPO methods and assist practitioners in their implementations.

cs.AI↗