arXiv subjects

Rohan Mittal

Publications and source records attributed to Rohan Mittal.

3 recordsLinked to original sources

arXiv2026

MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A

Recent advances in multimodal retrieval-augmented generation (MM-RAG) have shifted toward minimal parsing, relying on page-level images for producing retriever embeddings and for answer generation. While efficient, this trend often neglects explicit handling of the rich, structured information in complex enterprise documents, instead depending on pre-trained embeddings or vision-language models to implicitly capture such structure. In this work, we take a more direct approach: MM-BizRAG proactively extracts and represents document structure via a document structure-aware split that dynamically routes documents through orientation-specific ingestion pipelines, applying explicit layout-aware parsing for vertically structured documents (e.g., reports) and holistic page-level representations for horizontally structured documents (e.g., slide decks). A unified LLM-driven artifact transformation pipeline with placeholder-based positional alignment preserves natural reading order, while inference-time multimodal assembly decouples retrieval representations from generation context, enabling richer, more grounded answers without any finetuning requirement. Through experiments on a large, heterogeneous enterprise dataset and two public benchmarks (SlideVQA and FinRAGBench-V), MM-BizRAG consistently outperforms state-of-the-art vision-centric baselines by up to 32% points, with especially strong gains on report-style layouts. Furthermore, we introduce FastRAGEval, a single-call LLM Judge metric for fine-grained generative recall that halves RAGChecker's cost while achieving stronger human alignment.

cs.CL↗

arXiv2025

Fermion quantum criticality far from equilibrium

Driving a quantum system out of equilibrium while preserving its subtle quantum mechanical correlations on large scales presents a major challenge, both fundamentally and for technological applications. At its core, this challenge is pinpointed by the question of how quantum effects can persist at asymptotic scales, analogous to quantum critical points in equilibrium. In this work, we construct such a scenario using fermions as building blocks. These fermions undergo an absorbing-to-absorbing state transition between two topologically distinct and quantum-correlated dark states. Starting from a microscopic, interacting Lindbladian, we derive an effective Lindblad-Keldysh field theory in which critical fermions couple to a bosonic bath with hydrodynamic fluctuations associated with particle number conservation. A key feature of this field theory is an emergent symmetry that protects the purity of the fermions' state even in the presence of the thermal bath. We quantitatively characterise the critical point using a leading-order expansion around the upper critical dimension, thereby establishing the first non-equilibrium universality class of fermions. The symmetry protection mechanism, which exhibits parallels to the problem of directed percolation, suggests a pathway toward a broader class of robust, universal quantum phenomena in fermionic systems.

cond-mat.stat-mech↗

arXiv2023

Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization

Large Language Models (LLMs) like the GPT and LLaMA families have demonstrated exceptional capabilities in capturing and condensing critical contextual information and achieving state-of-the-art performance in the summarization task. However, community concerns about these models' hallucination issues continue to rise. LLMs sometimes generate factually hallucinated summaries, which can be extremely harmful in the clinical domain NLP tasks (e.g., clinical note summarization), where factually incorrect statements can lead to critically erroneous diagnoses. Fine-tuning LLMs using human feedback has shown the promise of aligning LLMs to be factually consistent during generation, but such training procedure requires high-quality human-annotated data, which can be extremely expensive to get in the clinical domain. In this work, we propose a new pipeline using ChatGPT instead of human experts to generate high-quality feedback data for improving factual consistency in the clinical note summarization task. We focus specifically on edit feedback because recent work discusses the shortcomings of human alignment via preference feedback in complex situations (such as clinical NLP tasks that require extensive expert knowledge), as well as some advantages of collecting edit feedback from domain experts. In addition, although GPT has reached the expert level in many clinical NLP tasks (e.g., USMLE QA), there is not much previous work discussing whether GPT can generate expert-level edit feedback for LMs in the clinical note summarization task. We hope to fill this gap. Finally, our evaluations demonstrate the potential use of GPT edits in human alignment, especially from a factuality perspective.

cs.CL↗