arXiv subjects

Sudeep Das

Publications and source records attributed to Sudeep Das.

At least 19 recordsLinked to original sources

arXiv2026

One Hierarchy, Two Systems: Semantic Product IDs for Discovery-Surface Ranking and Search-Page Query Reformulation

Multi-merchant e-commerce catalogs contain equivalent and related products under different merchant-scoped identifiers, fragmenting behavioral evidence across merchants. Expert-defined taxonomies, meanwhile, are often too coarse for fine-grained discovery. We investigate whether a single hierarchical Semantic ID (\sid{}) representation can support personalized ranking and query reformulation. Learned once from product-content embeddings, the hierarchy defines product concepts at multiple granularities that each application combines with its own behavioral and serving context. For ranking, we aggregate consumer affinity and product performance over \sid{} prefixes and derive sequence features for candidate products and consumer histories. Controlled ablations show improved offline relevance, while online evaluation of the full ranking treatment shows stronger top-slot add-to-cart engagement and broader exposure for less-popular products. For query reformulation, we ground queries and session transitions in \sid{} concepts, use the hierarchy for navigation and refinement, and filter suggestions against the merchant's assortment. Offline evaluation shows finer intent preservation than taxonomy and higher-quality suggestions than raw query-string transitions; online evaluation shows reduced search effort and earlier access to purchasable products. These results show that a shared semantic product hierarchy can support both recommendation and search while preserving the task-specific context required by each application.

cs.IR↗

arXiv2026

TRACE: Agentic Catalog Enrichment with Multi-source Evidence Grounding

Product catalogs underpin search, discovery, and recommendation in e-commerce, yet they are often attribute-sparse: the attributes shoppers and downstream systems rely on are either buried in unstructured content such as titles and images or missing from the catalog altogether. Manually enriching e-commerce catalogs is impractical given their scale and rapid growth. This paper introduces TRACE, a novel framework for automated catalog attribute enrichment using agentic Large Language Models (LLMs). A ScoutAgent triangulates multimodal evidence across merchant catalogs, syndicated feeds, and identity-matched web search to propose candidate attribute values with supporting evidence, while a JudgeAgent verifies the proposed value for each attribute value against its supporting evidence and decides whether to publish it or route it to human review. On an offline human evaluation dataset, TRACE's proposed attribute values were 98.2% accurate at 74.7% attribute coverage. Deployed in production on an industry-scale catalog, TRACE increased impression-weighted enrichment coverage across four business verticals by 90.4%. An online experiment subsequently showed that surfacing the enriched attributes on the product detail page increased checkout conversion by 0.48%.

cs.AI↗

arXiv2026

Decoupling Search from Reasoning: A Vendor-Agnostic Grounding Architecture for LLM Agents

Production LLM agents increasingly depend on real-time search, yet native search grounding bundles retrieval policy, provider choice, evidence injection, cost, latency, and generation behavior behind a single model-provider boundary. This coupling makes grounding hard to inspect, tune, reuse, or port, and can trigger Search-Induced Verbosity that breaks strict output contracts. We present Decoupled Search Grounding (DSG), a vendor-agnostic boundary that moves grounding outside the reasoning model through an MCP-compatible gateway, exposing provider routing, source-aware context rendering, configured fallback, retrieval-depth control, and exact plus semantic caching as first-class controls. Across five frontier models on SimpleQA, FreshQA, and HotpotQA, native search leads on recency-sensitive FreshQA, but DSG exposes a stronger frontier when control matters: on SimpleQA it nearly matches native accuracy (86.1% vs. 87.7%) at 91% lower search cost, preserves concise answer contracts, and reaches a 99.4% warm-cache hit rate with 68% lower latency. Deployed as a shared production grounding layer for large-scale agentic workloads with interchangeable models, DSG matches or slightly exceeds native-search accuracy on an e-commerce query-understanding (QIU) workload while cutting search cost by over 98%. Real-time grounding is best treated as an optimizable interface boundary, not a fixed model feature.

cs.AI↗

arXiv2026

Mind the Gap: Bridging Behavioral Silos with LLMs in Multi-Vertical Recommendations

In multi-vertical e-commerce platforms like DoorDash, relatively newer product verticals such as grocery and retail present a significant opportunity for personalization innovation. A key challenge lies in solving the "cold start" problem for users. This paper introduces a novel framework for enhancing recommendation quality by transferring knowledge from data-rich verticals (e.g., restaurants at DoorDash) to data-sparse ones. We leverage Large Language Models (LLMs) to perform generative inference, synthesizing sparse, high-dimensional features that encapsulate latent user affinities. Specifically, we employ a hierarchical Retrieval-Augmented Generation (RAG) pipeline to derive multi-level taxonomic features from user restaurant order histories and search queries. These generated features, encoding both long-term cross-vertical preferences and short-term intent, are integrated into a production Multi-Task Learning (MTL) ranking model. We demonstrate through extensive offline and online evaluation that this approach significantly improves personalization and engagement in emerging business verticals, effectively bridging the behavioral data gap.

cs.IR↗

arXiv2026

Joint Optimization of Relevance and Engagement in Multi-Task Ranking for E-Commerce with Efficient LLM Supervision

Optimizing industrial search ranking models solely for user engagement signals often introduces systematic biases, prioritizing popular or price-anchored items that may not satisfy semantic intent. We present a production-scale multi-task ranking system that integrates semantic relevance as a primary optimization objective, enabling explicit and controllable relevance-engagement trade-offs. Our architecture employs an ordinal relevance head that predicts cumulative probabilities over relevance thresholds, preserving the inherent ordering of labels. These outputs are integrated with engagement heads through a unified value model scoring function, enabling systematic balancing of semantic quality and short-term behavioral signals. To provide high-quality supervision for this multi-task framework, we utilize fine-tuned lightweight Large Language Models (LLMs) to generate three-level ordinal relevance labels: irrelevant, moderately relevant, and highly relevant. We address challenges regarding label distribution sensitivity and ensure high alignment with human annotations to enable efficient labeling for over 100 million query-item pairs. Evaluation across offline metrics, including NDCG@10, and online A/B experiments demonstrates that our approach significantly improves semantic alignment while preserving core engagement objectives.

cs.IR↗

arXiv2026

Build, Judge, Optimize: A Blueprint for Continuous Improvement of Multi-Agent Consumer Assistants

Conversational shopping assistants (CSAs) represent a compelling application of agentic AI, but moving from prototype to production reveals two underexplored challenges: how to evaluate multi-turn interactions and how to optimize tightly coupled multi-agent systems. Grocery shopping further amplifies these difficulties, as user requests are often underspecified, highly preference-sensitive, and constrained by factors such as budget and inventory. In this paper, we present a practical blueprint for evaluating and optimizing conversational shopping assistants, illustrated through a production-scale AI grocery assistant. We introduce a multi-faceted evaluation rubric that decomposes end-to-end shopping quality into structured dimensions and develop a calibrated LLM-as-judge pipeline aligned with human annotations. Building on this evaluation foundation, we investigate two complementary prompt-optimization strategies based on a SOTA prompt-optimizer called GEPA (Shao et al., 2025): (1) Sub-agent GEPA, which optimizes individual agent nodes against localized rubrics, and (2) MAMuT (Multi-Agent Multi-Turn) GEPA (Herrera et al., 2026), a novel system-level approach that jointly optimizes prompts across agents using multi-turn simulation and trajectory-level scoring. We release rubric templates and evaluation design guidance to support practitioners building production CSAs.

cs.AI↗

arXiv2026

Agentic Multi-Source Grounding for Enhanced Query Intent Understanding: A DoorDash Case Study

Accurately mapping user queries to business categories is a fundamental Information Retrieval challenge for multi-category marketplaces, where context-sparse queries such as "Wildflower" exhibit intent ambiguity, simultaneously denoting a restaurant chain, a retail product, and a floral item. Traditional classifiers force a winner-takes-all assignment, while general-purpose LLMs hallucinate unavailable inventory. We introduce an Agentic Multi-Source Grounded system that addresses both failure modes by grounding LLM inference in (i) a staged catalog entity retrieval pipeline and (ii) an agentic web-search tool invoked autonomously for cold-start queries. Rather than predicting a single label, the model emits an ordered multi-intent set, resolved by a configurable disambiguation layer that applies deterministic business policies and is designed for extensibility to personalization signals. This decoupled design generalizes across domains, allowing any marketplace to supply its own grounding sources and resolution rules without modifying the core architecture. Evaluated on DoorDash's multi-vertical search platform, the system achieves +10.9pp over the ungrounded LLM baseline and +4.6pp over the legacy production system. On long-tail queries, incremental ablations attribute +8.3pp to catalog grounding, +3.2pp to agentic web search grounding, and +1.5pp to dual intent disambiguation, yielding 90.7% accuracy (+13.0pp over baseline). The system is deployed in production, serving over 95% of daily search impressions, and establishes a generalizable paradigm for applications requiring foundation models grounded in proprietary context and real-time web knowledge to resolve ambiguous, context-sparse decision problems at scale.

cs.AI↗

arXiv2026

Mine and Refine: Optimizing Graded Relevance in E-commerce Semantic Search Retrieval

Embedding-based retrieval (EBR) for large-scale e-commerce search faces three intertwined challenges: graded (non-binary) relevance where engagement signals are noisy and intent-varying while business relevance guidelines admit acceptable-but-not-exact matches, false negatives in hard sample mining, and unstable similarity score separability across relevance levels, the last of which complicates hybrid search score fusion and downstream ranking. We propose Mine and Refine, a two-stage contrastive training framework that addresses all three. A lightweight LLM, fine-tuned with engagement-driven audit, serves as a guideline-aligned scalable labeler throughout training. Stage 1 establishes a robust global embedding space via label-aware supervised contrastive learning; Stage 2 mines hard samples, re-annotates them with the LLM labeler to mitigate spurious negatives, and refines the model through a multi-level extension of circle loss that enforces margin-controlled separation across relevance levels. Deployed in production e-commerce search across multiple product verticals, the approach delivers statistically significant lifts in user engagement and gross order value, and substantially improves retrieval and end-to-end relevance metrics.

cs.IR↗

arXiv2020

Learning Slab Classes to Alleviate Memory Holes in Memcached

We consider the problem of memory holes in slab allocators, where an item entered into memory occupies more memory than it actually requires due to a difference between the nearest larger slab class size and the size of the entered item. We solve this problem by using a greedy algorithm that analyses the pattern of the sizes of items previously entered into the memory and accordingly re-configuring the default slab classes to better suit the learned traffic pattern to minimize memory holes. Using this approach for a consistent data pattern, in our findings, has yielded significant reductions in memory wastage. We consider Memcached as it is one of the most widely used implementations of slab allocators today, and has native support to reconfigure its default slab classes.

cs.DC↗

arXiv2019

Challenges in Search on Streaming Services: Netflix Case Study

We discuss salient challenges of building a search experience for a streaming media service such as Netflix. We provide an overview of the role of recommendations within the search context to aid content discovery and support searches for unavailable (out-of-catalog) entities. We also stress the importance of keystroke-level instant search experience, and the technical challenges associated with implementing it across different devices and languages for a global audience.

cs.IR↗

arXiv2014

The Atacama Cosmology Telescope: CMB Polarization at $200<\ell<9000$

We report on measurements of the cosmic microwave background (CMB) and celestial polarization at 146 GHz made with the Atacama Cosmology Telescope Polarimeter (ACTPol) in its first three months of observing. Four regions of sky covering a total of 270 square degrees were mapped with an angular resolution of $1.3'$. The map noise levels in the four regions are between 11 and 17 $\mu$K-arcmin. We present TT, TE, EE, TB, EB, and BB power spectra from three of these regions. The observed E-mode polarization power spectrum, displaying six acoustic peaks in the range $200<\ell<3000$, is an excellent fit to the prediction of the best-fit cosmological models from WMAP9+ACT and Planck data. The polarization power spectrum, which mainly reflects primordial plasma velocity perturbations, provides an independent determination of cosmological parameters consistent with those based on the temperature power spectrum, which results mostly from primordial density perturbations. We find that without masking any point sources in the EE data at $\ell<9000$, the Poisson tail of the EE power spectrum due to polarized point sources has an amplitude less than $2.4$ $\mu$K$^2$ at $\ell = 3000$ at 95\% confidence. Finally, we report that the Crab Nebula, an important polarization calibration source at microwave frequencies, has 8.7\% polarization with an angle of $150.7^\circ \pm 0.6^\circ$ when smoothed with a $5'$ Gaussian beam.

astro-ph.CO↗

arXiv2014

The Atacama Cosmology Telescope: Cross Correlation with Planck maps

We present the temperature power spectrum of the Cosmic Microwave Background obtained by cross-correlating maps from the Atacama Cosmology Telescope (ACT) at 148 and 218 GHz with maps from the Planck satellite at 143 and 217 GHz, in two overlapping regions covering 592 square degrees. We find excellent agreement between the two datasets at both frequencies, quantified using the variance of the residuals between the ACT power spectra and the ACTxPlanck cross-spectra. We use these cross-correlations to calibrate the ACT data at 148 and 218 GHz, to 0.7% and 2% precision respectively. We find no evidence for anisotropy in the calibration parameter. We compare the Planck 353 GHz power spectrum with the measured amplitudes of dust and cosmic infrared background (CIB) of ACT data at 148 and 218 GHz. We also compare planet and point source measurements from the two experiments.

astro-ph.CO↗

arXiv2013

First Measurement of the Cross-Correlation of CMB Lensing and Galaxy Lensing

We measure the cross-correlation of cosmic microwave background lensing convergence maps derived from Atacama Cosmology Telescope data with galaxy lensing convergence maps as measured by the Canada-France-Hawaii Telescope Stripe 82 Survey. The CMB-galaxy lensing cross power spectrum is measured for the first time with a significance of 4.2{\sigma}, which corresponds to a 12% constraint on the amplitude of density fluctuations at redshifts ~ 0.9. With upcoming improved lensing data, this novel type of measurement will become a powerful cosmological probe, providing a precise measurement of the mass distribution at intermediate redshifts and serving as a calibrator for systematic biases in weak lensing measurements.

astro-ph.CO↗

arXiv2013

Can CMB Lensing Help Cosmic Shear Surveys?

Yes! Upcoming galaxy shear surveys have the potential to significantly improve our understanding of dark energy and neutrino mass if lensing systematics can be sufficiently controlled. The cross-correlations between the weak lensing shear, galaxy number counts from a galaxy redshift survey, and the CMB lensing convergence can be used to calibrate the shear multiplicative bias, one of the most challenging systematics in lensing surveys. These cross-correlations can significantly reduce the deleterious effects of the uncertainties in multiplicative bias.

astro-ph.CO↗

arXiv2013

Lensing Simulation and Power Spectrum Estimation for High Resolution CMB Polarization Maps

We present efficient algorithms for CMB lensing simulation and power spectrum es- timation for flat-sky CMB polarization maps. We build a pure B-mode estimator to remedy E to B leakage due to partial sky coverage. We show that our estimators are unbiased, and consistent with the projected errors. We demonstrate our algorithm using simulated observations of small sky patches with realistic noise and weights for upcoming CMB polarization experiments.

astro-ph.CO↗

arXiv2013

The Atacama Cosmology Telescope: Dusty Star-Forming Galaxies and Active Galactic Nuclei in the Southern Survey

We present a catalog of 191 extragalactic sources detected by the Atacama Cosmology Telescope (ACT) at 148 GHz and/or 218 GHz in the 2008 Southern survey. Flux densities span 14-1700 mJy, and we use source spectral indices derived using ACT-only data to divide our sources into two sub-populations: 167 radio galaxies powered by central active galactic nuclei (AGN), and 24 dusty star-forming galaxies (DSFGs). We cross-identify 97% of our sources (166 of the AGN and 19 of the DSFGs) with those in currently available catalogs. When combined with flux densities from the Australian Telescope 20 GHz survey and follow-up observations with the Australia Telescope Compact Array, the synchrotron-dominated population is seen to exhibit a steepening of the slope of the spectral energy distribution from 20 to 148 GHz, with the trend continuing to 218 GHz. The ACT dust-dominated source population has a median spectral index of 3.7+0.62-0.86, and includes both local galaxies and sources with redshifts as great as 5.6. Dusty sources with no counterpart in existing catalogs likely belong to a recently discovered subpopulation of DSFGs lensed by foreground galaxies or galaxy groups.

astro-ph.CO↗

arXiv2013

Using Cross-Correlations to Calibrate Lensing Source Redshift Distributions: Improving Cosmological Constraints from Upcoming Weak Lensing Surveys

Cross-correlations between the galaxy number density in a lensing source sample and that in an overlapping spectroscopic sample can in principle be used to calibrate the lensing source redshift distribution. In this paper, we study in detail to what extent this cross-correlation method can mitigate loss of cosmological information in upcoming weak lensing surveys (combined with a CMB prior) due to lack of knowledge of the source distribution. We consider a scenario where photometric redshifts are available, and find that, unless the photometric redshift distribution p(z_{ph}|z) is calibrated very accurately a priori (bias and scatter known to ~0.002 for, e.g., EUCLID), the additional constraint on p(z_{ph}|z) from the cross correlation technique to a large extent restores the cosmological information originally lost due to the uncertainty in dn/dz(z). Considering only the gain in photo-z accuracy and not the additional cosmological information, enhancements of the dark energy figure of merit of up to a factor of 4 (40) can be achieved for a SuMIRe (Subaru Measurement of Images and Redshifts, the combination of the Hyper Suprime Cam lensing survey and the Prime Focus Spectrograph redshift survey)-like (EUCLID-like) combination of lensing and redshift surveys. However, the success of the method is strongly sensitive to our knowledge of the galaxy bias evolution in the source sample. If this bias is modeled by a free parameter in each of a large number of redshift bins, we find that a prior of order 0.01 is needed on b_i \sqrt{\Delta z} in each redshift slice (where \Delta z is the bin width and b_i the value of the galaxy bias in the i-th source bin) to optimize the gains from the cross-correlation method (i.e. to approach the cosmology constraints attainable if the bias were known exactly).[abridged]

astro-ph.CO↗

arXiv2013

The Atacama Cosmology Telescope: Beam Measurements and the Microwave Brightness Temperatures of Uranus and Saturn

We describe the measurement of the beam profiles and window functions for the Atacama Cosmology Telescope (ACT), which operated from 2007 to 2010 with kilo-pixel bolometer arrays centered at 148, 218, and 277 GHz. Maps of Saturn are used to measure the beam shape in each array and for each season of observations. Radial profiles are transformed to Fourier space in a way that preserves the spatial correlations in the beam uncertainty, to derive window functions relevant for angular power spectrum analysis. Several corrections are applied to the resulting beam transforms, including an empirical correction measured from the final CMB survey maps to account for the effects of mild pointing variation and alignment errors. Observations of Uranus made regularly throughout each observing season are used to measure the effects of atmospheric opacity and to monitor deviations in telescope focus over the season. Using the WMAP-based calibration of the ACT maps to the CMB blackbody, we obtain precise measurements of the brightness temperatures of the Uranus and Saturn disks at effective frequencies of 149 and 219 GHz. For Uranus we obtain thermodynamic brightness temperatures T_U^{149} = 106.7 \pm 2.2 K and T_U^{219} = 100.1 \pm 3.1 K. For Saturn, we model the effects of the ring opacity and emission using a simple model and obtain resulting (unobscured) disk temperatures of T_S^{149} = 137.3 \pm 3.2 K and T_S^{219} = 137.3 \pm 4.7 K.

astro-ph.IM↗