arXiv subjects

Anurag Garg

Publications and source records attributed to Anurag Garg.

7 recordsLinked to original sources

arXiv2026

Advancing Open and Reproducible Relational Learning: RelArena-$\alpha$, TabPFN-Rel and RPI

This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we expect to accelerate research in the field towards meaningful real-world impact. We aim to steer further development based on feedback from, and in collaboration with, the community. Given the early stage of development, our $\alpha$-release targets researchers and early-adopting practitioners. Over the past years, a variety of datasets and tasks for relational learning have emerged, but the community has not converged on a reliable, reproducible way to compare different methods on these tasks. Our $\alpha$-release, RelArena-$\alpha$, provides a unified framework for running and comparing baselines on RelBench v1 by standardizing data loading, evaluation protocols, tuning regimes, and support for systems with custom tuning, inspired by established tabular benchmarks such as TabArena. We plan to work with the research community to further develop RelArena-$\alpha$ into a catalyst for progress in the relational learning community. We release the initial version of TabPFN-Rel, a purpose-built relational harness for TabPFN-3. Currently ranked first among models on RelArena-$\alpha$, TabPFN-Rel makes key improvements upon RDBLearn. Beyond its ranking, TabPFN-Rel serves as a strong baseline, adding to the growing evidence that flattening a relational database into a single table remains competitive with specialized relational architectures on real-world tasks. To facilitate adoption of relational learning methods in research and industry, we release an initial $\alpha$-version of our Relational Predictive Interface, RPI, an open-source, model-agnostic interface that enables early adopters to easily define problems on new databases and apply any model implemented in RelArena-$\alpha$, including TabPFN-Rel, to these problems.

cs.LG↗

arXiv2026

Testing the Generalization and Domain Stability of Compact Feature Representations for Photometric Supernova Classification

Photometric classification of supernovae increasingly requires models that are not only accurate within a single survey but also robust to changes in cadence, noise properties, filter coverage, and survey domain. We investigate the generalization and domain stability of a compact 16-feature representation for Type Ia supernova classification. The feature set consists of physically interpretable descriptors of brightness, color, variability, and temporal evolution. Using the Supernova Photometric Classification Challenge (SPCC) dataset as the reference domain, we confirm that a compact XGBoost classifier achieves strong within-survey performance, reaching an F1 score of 0.844 and a PR-AUC of 0.928 on a held-out test set. We then evaluate robustness under alternative classifiers, repeated resampling, feature perturbations, missing-band proxies, shortened temporal coverage, and cross-survey transfer to PLAsTiCC. The compact representation remains stable under resampling and moderate perturbations, but direct SPCC$\rightarrow$PLAsTiCC transfer produces a substantial performance degradation. Class-conditional centroid analysis shows that the SPCC and PLAsTiCC Type Ia populations occupy different regions of the compact feature space. The cross-survey Ia centroid shift exceeds the Ia/non-Ia separation within either survey, indicating that the transfer gap is driven primarily by feature-space domain shift rather than classifier instability. These results show that compact physically interpretable features are robust within a survey and useful for diagnostic analysis, but are not automatically survey-invariant. Cross-survey deployment therefore requires feature harmonization, domain adaptation, or restriction to a smaller set of survey-stable features.

astro-ph.HE↗

arXiv2026

TabPFN-3: Technical Report

Tabular data underpins most high-value prediction problems in science and industry, and TabPFN has driven the foundation model revolution for this modality. Designed with feedback from our users, TabPFN-3 builds on this foundation to scale state-of-the-art performance to datasets with 1M training rows and substantially reduce training and inference time. Pretrained exclusively on synthetic data from our prior, TabPFN-3 dramatically pushes the frontier of tabular prediction and brings substantial gains on time series, relational, and tabular-text data. On the standard tabular benchmark TabArena, a forward pass of TabPFN-3 outperforms all other models, including tuned and ensembled baselines, by a significant margin, and pareto-dominates the speed/performance frontier. On more diverse datasets, TabPFN-3 ranks first on datasets with many classes, and beats 8-hour-tuned gradient-boosted-tree baselines on datasets up to 1M training rows and 200 features. TabPFN-3 introduces test-time compute scaling to tabular foundation models. Our API offering TabPFN-3-Plus (Thinking) exploits this to beat all non-TabPFN models by over 200 Elo on TabArena, rising to 420 Elo on the largest data subset, and outperforms AutoGluon 1.5 extreme while being 10x faster, without using LLMs, real data, internet search or any other model besides TabPFN. TabPFN-3 extends the capabilities of our models, enabling SOTA prediction on relational data (new SOTA foundation model on RelBenchV1) and tabular-text data (SOTA on TabSTAR via TabPFN-3-Plus); and improves existing integrations: a specialized checkpoint, TabPFN-TS-3, ranks 2nd on the time-series benchmark fev-bench, and SHAP-value computation is up to 120x faster. TabPFN-3 achieves this performance while being up to 20x faster than TabPFN-2.5. In addition, a reduced KV cache and row-chunking scale to 1M rows on one H100 with fast inference speed.

cs.LG↗

arXiv2026

Compact and Physically Interpretable Feature Models for Photometric Type Ia Supernova Classification

Photometric classification of Type Ia supernovae is essential for modern time-domain surveys, where spectroscopic confirmation is not always feasible for the full transient sample. We investigate a compact and physically interpretable feature representation derived from multi-band light curves and evaluate its performance using gradient-boosted decision trees on the Supernova Photometric Classification Challenge (SPCC) dataset. The compact representation is derived from an initial pool of 31 light-curve features, reduced to 30 after removing redundant variables and further optimized to a 16-feature model through systematic ablation analysis. The final compact model achieves an F1-score of 0.844 on the held-out test set, consistent with k-fold cross-validation results (0.841 +/- 0.006). The precision-recall area under the curve (PR-AUC) is 0.928, with similarly low variance across folds. Ablation experiments show that temporal evolution provides the dominant classification signal, while brightness, color, and variability features contribute complementary information. A reduced core of approximately ten physically meaningful features retains most of the performance of the compact model, with only a small decrease in F1-score, indicating that reliable classification does not require large high-dimensional feature spaces. These results demonstrate that interpretable feature-based models can capture the essential astrophysical information needed for Type Ia photometric classification, with implications for survey cadence, filter coverage, and the design of transparent and efficient machine-learning pipelines for time-domain surveys.

astro-ph.IM↗

arXiv2025

TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models

The first tabular foundation model, TabPFN, and its successor TabPFNv2 have impacted tabular AI substantially, with dozens of methods building on it and hundreds of applications across different use cases. This report introduces TabPFN-2.5, the next generation of our tabular foundation model, built for datasets with up to 50,000 data points and 2,000 features, a 20x increase in data cells compared to TabPFNv2. TabPFN-2.5 is now the leading method for the industry standard benchmark TabArena (which contains datasets with up to 100,000 training data points), substantially outperforming tuned tree-based models and matching the accuracy of AutoGluon 1.4, a complex four-hour tuned ensemble that even includes the previous TabPFNv2. Remarkably, default TabPFN-2.5 has a 100% win rate against default XGBoost on small to medium-sized classification datasets (<=10,000 data points, 500 features) and a 87% win rate on larger datasets up to 100K samples and 2K features (85% for regression). For production use cases, we introduce a new distillation engine that converts TabPFN-2.5 into a compact MLP or tree ensemble, preserving most of its accuracy while delivering orders-of-magnitude lower latency and plug-and-play deployment. This new release will immediately strengthen the performance of the many applications and methods already built on the TabPFN ecosystem.

cs.LG↗

arXiv2025

Optimizing Supernova Classification with Interpretable Machine Learning Models

Photometric classification of Type Ia supernovae (SNe Ia) is critical for cosmological studies but remains difficult due to class imbalance and observational noise. While deep learning models have been explored, they are often resource-intensive and lack interpretability. We present a computationally efficient and interpretable classification framework that maintains high performance on imbalanced datasets. We emphasize the use of PR-AUC and F1-score as more informative metrics than ROC-AUC in severely imbalanced settings. Using an XGBoost ensemble optimized via Bayesian hyperparameter tuning, we classified light curves from the Supernova Photometric Classification Challenge (SPCC), comprising 21,318 events with a 3.19 imbalance ratio (non-Ia to Ia). Our model achieved a PR-AUC of $0.993^{+0.03}_{-0.02}$, an F1-score of $0.923 \pm 0.008$, and a ROC-AUC of $0.976 \pm 0.004$, matching or exceeding deep learning performance on precision-recall trade-offs while using fewer resources. Despite slightly lower overall accuracy, our method balances false positives and false negatives, improving the efficiency of spectroscopic follow-up. We show that optimized ensemble models offer a reproducible and lightweight alternative to complex architectures, particularly for large-scale surveys such as the Legacy Survey of Space and Time (LSST) where transparency and efficiency are essential.

astro-ph.HE↗

arXiv2025

Real-TabPFN: Improving Tabular Foundation Models via Continued Pre-training With Real-World Data

Foundation models for tabular data, like TabPFN, achieve strong performance on small datasets when pre-trained solely on synthetic data. We show that this performance can be significantly boosted by a targeted continued pre-training phase. Specifically, we demonstrate that leveraging a small, curated collection of large, real-world datasets for continued pre-training yields superior downstream predictive accuracy compared to using broader, potentially noisier corpora like CommonCrawl or GitTables. Our resulting model, Real-TabPFN, achieves substantial performance gains on 29 datasets from the OpenML AutoML Benchmark.

cs.LG↗