arXiv Science⌕ Search

arXiv subjects

Ashwanth Krishnan

Publications and source records attributed to Ashwanth Krishnan.

6 recordsLinked to original sources

One molecule, many outputs; many molecules, one output: exact diagnostics for atom-level compositional quantum encoders

Quantum natural language processing (QNLP) turns the grammar of a sentence into a tensor network and then into a quantum circuit with trainable angles. We build such a model for molecules: each heavy atom is a word with one wire per bond, and each bond is a ``cup'' joining two wires, so the circuit's wiring is the molecular graph. We work out exactly what these circuits keep. With the typed angle sharing of lambeq, the circuits separate every isomer pair we tested. Yet for isomers that simpler sharing confuses, the output states stay almost the same, before and after training. On 7 Tox21 pairs and 1,988 MOSES pairs, nearly all the difference lies in how often the measurements succeed, which a standard readout ignores. Simpler sharing, by element and bond type, shows why: the output then depends only on a graph whose vertices are the bonds. This explains all but one of the identical-output pairs we certify, including 1.19\% of 232{,}191 MOSES molecules, and for alkyl side chains it reduces to a tree shape that tells chains apart up to 15 atoms but not from 16. On small pairs, this circuit and the 1-WL graph test each separate pairs the other misses. We also show that SMILES writing order can change the output, that a run succeeds with probability at most $2^{-n}$ for $n$ bonds, and that a cup-free design avoids this cost. No circuit beats a simple atom-count model on Tox21, and we claim no quantum advantage.

quant-ph↗

How Far Can Root Cause Analysis Go on Real-World Telemetry Data?

Root cause analysis (RCA) of microservice failures requires reasoning over telemetry far larger than a model's context, so a language agent reasons over extracted evidence. We start from an error analysis of such an agent on OpenRCA. A reverse reasoning agent reconstructs an evidence chain to each labelled cause and compares it against the agent's own trace, locating failures where a grounded chain existed but was not followed; its labels agree with two site reliability engineers. Being label-conditioned, it audits evidence rather than testing forward identifiability, leaving open what the agent lacked: procedure or telemetry-specific knowledge. Existing systems cannot separate them, extracting evidence inside the reasoning loop. We compute the evidence once, offline, and supply it identically to every arm. Rules mined from the audit reports of one Market cloudbed raise Full Score on a held-out cloudbed from 14.10 to 35.90, surviving correction for multiple testing, against 24.36 for manual rules and 19.23 for a label-and-schema control. The rules add 17 solved cases on top of the five-step procedure but 11 without it, the repairs overlapping. Removing the procedure raises Full Score in all three conditions tested, though no contrast survives correction. Deleting only its earliest-onset criterion yields a net gain of 8 cases against 11 for the whole procedure, which we report descriptively. Mining is label-supervised, and all results are specific to OpenRCA.

cs.AI↗

Same Entity, Different Script: Diagnosing Cross-Script Entity Matching Failures in Language Models

Multilingual language models can give different identity judgments when the same people's names are written in different scripts. We study this effect using 601 audited identity pairs with attested Devanagari and Latin forms, holding the question and relation fixed. Qwen2.5-7B's same-person accuracy falls from 35.1% in Latin to 8.5% in Devanagari under Marathi prompts, while different-person accuracy remains above 98%. Evaluation across five models reveals distinct response biases, and reduced tokenization fragmentation does not reliably close the gap. Replicating the design on 374 audited Malayalam pairs built from the same entities reproduces the effect in a second script and language family: same-person accuracy falls to 5.3%, about half the matched Devanagari rate, while the margin still ranks matching above non-matching names at 0.925 AUROC. Latin-trained probes recover label information from Devanagari states, exceeding a string-feature baseline under similarity-matched negatives. Scalar calibration recovers 87% of the raw model-probe balanced-accuracy gap, identifying decision criterion placement as a major contributor. Activation patching localises causal sensitivity to the second entity in Qwen's middle layers; one shared sensitivity direction transfers about half the full-state margin correction. A fact-independent intervention at this site raises held-out Marathi same-person accuracy from 6.5% to 33.5%, with 98.5% different-person accuracy. Together, these results distinguish script-dependent discrimination from criterion placement and identify a causal site for improving identity judgments.

cs.CL↗

Active Causal Discovery Benchmark: Evaluating LLM Agents Under Budgeted Interventions

We introduce the Active Causal Discovery Benchmark (ACDB), an SCM-grounded environment for evaluating whether LLM agents recover causal graph structure from observations and budget-constrained hard interventions. ACDB pairs a linear-Gaussian world generator with a fixed observe-intervene-submit API and a three-layer scoring contract that separates skeleton recovery, DAG recovery, and intervention efficiency. On the current six-level ladder, PC with a greedy active orientation heuristic is the strongest non-oracle method (directed F1 42.7%, SHD 4.79), ahead of Claude Sonnet 4.6 raw active (31.7%, 7.25) and GPT-5.4 raw active (22.9%, 9.27). The most informative diagnostic is the precision-recall decomposition: PC under-commits with high precision, LLMs over-commit with lower precision, and statistical-tool access often increases abstention rather than useful intervention. A structure-blind random DAG baseline reaches 23.6% directed F1 on this dense v0 ladder; a density probe lowers this floor to 16.9%, motivating the v1 calibration pass. The current results should therefore be read as a benchmark audit and calibration report, not as evidence that current LLMs solve active causal discovery.

cs.LG↗

STOCKTAKE: Measuring the Gap Between Perception and Action in LLM Agents with a Fair Oracle

LLM agents are increasingly evaluated on multi-week decision tasks in which the state that drives cost is never directly observed. On such tasks the final cost cannot say why an agent failed: it may have misread the world, or read it correctly and still failed to act (the knowing-doing gap). Existing evaluations cannot separate these two failures; their reference policies either read privileged information the agent never sees, or are missing altogether. We introduce STOCKTAKE, a 26-week supply-chain replenishment benchmark built as a factored partially observable Markov decision process with six hidden factor processes, designed so that a fair reference policy is computable: an exact Bayes filter per factor drives a rollout policy on the identical observation stream the agent receives. Scoring each run between a symptom-blind base-stock floor (0) and this oracle (1) yields a skill score, and grading each week's written rationale yields a stated-belief detection lag and a knowing-doing rate, so state estimation and control are measured separately. On fifty seeds with curated stress profiles, Claude Sonnet 5, GPT-5.4, DeepSeek-V4-Pro, and Grok 4.5 detect 84-88% of hidden failures, typically within a week of onset, yet span skill scores from 0.62 to -0.23: two of the four end below the symptom-blind floor while naming factors slightly faster than the two that beat it. The failure has two faces. Where stress persists, 34-43% of correctly diagnosed stress weeks still end in stockout for every model, a rate that partly reflects the severity of the weeks models notice. That rate also runs opposite to skill: the two models under the floor stock out least on diagnosed weeks, so under-response is only one face of the gap, and their traces point to the other, responses whose cost exceeds what they protect. STOCKTAKE measures both directions of that failure.

cs.AI↗

ReTreVal: Reasoning Tree with Validation and Cross-Problem Memory for Large Language Models

Every existing inference-time reasoning framework discards all failure context at problem boundaries, leaving a model solving problem 500 no wiser than it was on problem 1. We present ReTreVal (Reasoning Tree with Validation), a training-free framework that closes this gap through adaptive tree exploration with tool-augmented node refinement, typed-failure backtracking that injects categorized error context into the recovered branch, and a self-rewriting memory that accumulates and revises strategy entries across problems, enabling inference-time cross-problem learning on any fixed, unmodified LLM without fine-tuning. ReTreVal achieves 85.8% pass@1 on MATH-500 (+8.6 pp over Zero-Shot CoT, +8.6 pp over the strongest baseline Self-Refine) and 54.4% on MMLU-Pro (+15.3 pp over Self-Refine), with a 3.4:1 win-to-regression ratio confirming genuine error recovery rather than noise. These capabilities, previously requiring gradient updates, allow a 32B model to compete with much larger single-pass systems.

cs.AI↗