arXiv Science⌕ Search

arXiv subjects

Debarshi Chanda

Publications and source records attributed to Debarshi Chanda.

12 recordsLinked to original sources

Estimating the Volume of a Union of Convex Bodies

The \textit{Union Volume Estimation problem}, i.e. yielding an $(\varepsilon, δ)$-approximation of the volume of the union of convex bodies, is a classical problem in computational geometry and formal methods. In this paper, we first detect where and why the efficient union volume estimators with approximate sampling and PAC volume estimation oracles fail. Specifically, we show that having only TV-distance guarantees on the approximate sampler does not suffice, and demonstrate this bottleneck by constructing the sunflower families of convex bodies. In this context, we propose the concept of \textit{tail-controlled samplers} that can yield with high-probability almost-$\ell_{\infty}$ closeness. Secondly, we leverage this concept to propose a generic algorithmic framework \texttt{Alpona} that properly combines a PAC volume computation and approximate point sampling oracles with tail-controls to yield an $(\varepsilon, δ)$-estimate of the union volume for any collection of convex bodies. We show that \texttt{Alpona} needs only linear (in number of convex bodies) oracle calls to be $(\varepsilon, δ)$-correct. Finally, we provide a tail-controlled analysis of the Hit-and-Run sampler~\citep{lovasz2006fast}. We further provide a novel geometric analysis to improve the required walk length of Hit-and-Run. We further instantiate \texttt{Alpona}'s correctness for the sparse frequency streams of convex bodies: a special case of the union volume estimation problem where no convex body intersects more than $τ$ many other bodies.

cs.DS↗

Power of Conditional Sampling on Hypergraphs

Let $G=(V,E)$ be a $d$-uniform hypergraph with $|V|=n$ and $|E|=m$. Estimating $m$ from uniformly random hyperedge samples requires $Θ(\sqrt{m})$ samples by a birthday-paradox argument. We investigate the power of conditional sampling through a hierarchy of oracles: for an integer $1\le s\le d$, given pairwise disjoint subsets $X_1,\ldots,X_s\subseteq V$, the $s$-colorful oracle returns a hyperedge chosen uniformly at random from all hyperedges contained in $X_1\cup\cdots\cup X_s$ that intersect every $X_i$, provided one exists. For $s=1$, this samples a uniformly random hyperedge induced by $X_1$. For every $1\le s\le d$, we give a randomized algorithm that outputs $\widehat{m}\in[(1-\varepsilon)m,(1+\varepsilon)m]$ with probability at least $2/3$ using $O_{s,d}(\operatorname{poly}(1/\varepsilon,\log n))$ conditional samples, where the exponent of $\log n$ is an absolute constant independent of both $s$ and $d$. Conditional sampling thus yields an exponential separation over uniform hyperedge sampling. We also study the decision version, in which the oracle only reports whether a qualifying hyperedge exists. For every $1\le s<d$, we prove that any algorithm using the $s$-colorful decision oracle requires $\widetildeΩ_{s,d}(n^{\frac{d-s}{d-s+1}})$ queries. Hence, for $s<d$, access to uniformly random witness hyperedges (random certificates) is exponentially more powerful than existence queries. For $s=d$, decision queries alone achieve $\operatorname{poly}(1/\varepsilon,\log n)$ query complexity, but the exponent of $\log n$ is known to be $Θ(d)$. The colorful hierarchy thus exhibits a phase transition at $s=d$: for $s<d$, random certificates are essential for polylogarithmic-query estimation, whereas at $s=d$ decision queries suffice, yet random certificates still provably reduce the exponent of $\log n$ from $Θ(d)$ to an absolute constant.

cs.DS↗

Sublinear Algorithms for Wasserstein and Total Variation Distances: Applications to Fairness and Privacy Auditing

Resource-efficiently computing representations of probability distributions and the distances between them while only having access to the samples is a fundamental and useful problem across mathematical sciences. In this paper, we propose a generic framework to learn the probability and cumulative distribution functions (PDFs and CDFs) of a sub-Weibull, i.e. almost any light- or heavy-tailed, distribution while the samples from it arrive in a stream. The idea is to reduce these problems into estimating the frequency of an appropriately chosen subset of the support of a properly discretised distribution. We leverage this reduction to compute mergeable summaries of distributions from the stream of samples while requiring only sublinear space relative to the number of observed samples. This allows us to estimate Wasserstein and Total Variation (TV) distances between any two distributions while samples arrive in streams and from multiple sources. Our algorithms significantly improves on the existing methods for distance estimation incurring super-linear time and linear space complexities, and further extend the mergeable summaries framework to continuous distributions with possibly infinite support. Our results are tight with respect to the existing lower bounds for bounded discrete distributions. In addition, we leverage our proposed estimators of Wasserstein and TV distances to tightly audit the fairness and privacy of algorithms. We empirically demonstrate the efficiency of proposed algorithms across synthetic and real-world datasets.

cs.LG↗

On Estimating Degree Distribution in Streaming and Query Models

Given a graph $G=(V,E)$ with $n$ vertices and $m$ edges, let $C(d)=|\{v\in V:°(v)\ge d\}|$ denote its complementary cumulative degree histogram (CCDH), and let $h$ be the $h$-index of $G$. The goal is to compute a $(\varepsilon_D,\varepsilon_R)$-bi-criteria multiplicative approximation of $C$, where $\varepsilon_D$ and $\varepsilon_R$ control the approximation in the domain and range, respectively. In this work, we study the complexity of this problem in the streaming model and an augmented query model that provides access to uniformly random edge queries in addition to standard local queries. We design a model-agnostic algorithm that combines uniformly sampled vertices and edges to estimate the CCDH. Ignoring the dependence on the approximation parameters and polylogarithmic factors in $n$, the complexity in the streaming model is $Θ(m/h)$: the upper bound holds for a single-pass algorithm, while the lower bound holds even for multi-pass algorithms. In the query model, the complexity is $Θ(m/h)$ for adaptive algorithms. For non-adaptive algorithms, we give an upper bound of $O(n/h+m/h)$ and establish lower bounds through a reduction from estimating the number of distinct elements in a multiset when sampling without replacement. Our results resolve an open problem in sublinear graph algorithms posed in Sublinear.info (Problem 98). Finally, we validate our algorithm through extensive empirical evaluations on real-world graphs.

cs.DS↗

Improved Bounds for Estimating Average Degree of Graphs

We propose a randomized parameter-oblivious algorithm that, given query access to a graph $G$ with arboricity $α$, and average degree $d$, makes $\widetilde{O}\left(\fracα{\varepsilon^2d}\right)$ Degree and $\widetilde{O}\left(\frac{1}{\varepsilon^2}\right)$ RandEdge queries to obtain an estimate $\widehat{d}$ satisfying $\widehat{d} \in (1\pm\varepsilon)d$. This also yields an algorithm that uses $\widetilde{O}\left(\frac{1}{\varepsilon^2}\min(d,\fracα{d})\right)$ Degree and RandEdge queries. This improves the $\widetilde{O}_{\varepsilon,\log n}(\frac{1}{\varepsilon^2}$ $\min(d,\sqrt{\frac{n}{d}}))$ query algorithm of [Beretta et al., SODA 2026] that has access to Degree, Neighbour, and RandEdge queries. We show that any algorithm that has access to Degree, Neighbour, and RandEdge queries, must make at least $Ω\left(\min\left(d,\fracα{d}\right)\right)$ queries, even with the knowledge of $n$ and $α$. Even with Pair and FullNbr queries, an algorithm must make $Ω\left(\min\left(d,\fracα{d}\right)\right)$ queries for certain ranges of $α$. When $n$ is unknown, any algorithm with access to all the queries discussed above must make $Ω\left(\min\left(d,\fracα{d}\right)\right)$ queries. We also establish that any sublinear algorithm using Degree and RandEdge queries must make at least $Ω(\frac{1}{\varepsilon})$ RandEdge queries. Furthermore, any algorithm having access to Degree, FullNbr, and RandEdge queries that makes $o(\frac{1}{\varepsilon^2})$ RandEdge queries must make $Ω(\fracα{\varepsilon^2d})$ Degree and FullNbr queries. This settles the query complexity of estimating average degree using Degree and FullNbr queries.

cs.DS↗

Arboricity Matters in Triangle Counting with Random Edges

Given a simple, unweighted, undirected graph $G=(V,E)$ with $|V|=n$ and $|E|=m$, and parameters $0 < \varepsilon, δ<1$, along with Degree, Neighbour, Pair and RandomEdge query access to $G$, we provide a query-based randomized algorithm to generate an estimate $\widehat{T}$ of the number of triangles $T$ in $G$, such that $\widehat{T} \in [(1-\varepsilon)T , (1+\varepsilon)T]$ with probability at least $1-δ$. The query complexity of our algorithm is $\widetilde{O}\left({m α\log(1/δ)}/{\varepsilon^3 T}\right)$, where $α$ is the arboricity of $G$. Our work can be seen as a natural progression to the line of recent works [Eden et al., SIAM J Comp., 2017; Assadi et al., ITCS 2019; Eden et al., SODA 2020] that considered subgraph or triangle counting with or without the use of RandomEdge query. Of these works, Eden et al. [SODA 2020] considers the role of arboricity. Our work is the first to consider how RandomEdge query can leverage the structural property of arboricity. Furthermore, continuing in the line of work of Assadi et al. [APPROX/RANDOM 2022], we also provide a lower bound of $\widetildeΩ\left({m α\log(1/δ)}/{\varepsilon^2 T}\right)$ that matches the upper bound exactly on arboricity, $δ$, and almost on $\varepsilon$.

cs.DS↗

Counting Triangles in Graph Streams with Repeatable and Forgettable Edges

Most existing graph streaming algorithms assume the ideal scenario where each edge arrives only once. Real-world graph streams, such as communication or transaction logs, often contain many repeated occurrences of the same edge. In general, the algorithms developed for the single-edge arrival case can fail when edges can arrive multiple times. Motivated by this, we study the {\em repeated-edge arrival graph streaming model} where an edge is allowed to arrive multiple times. In this work, we study the triangle counting problem in the repeated-edge arrival model: approximate the number of triangles in the underlying {\em simple graph} despite arbitrary edge repetitions. We design the first algorithms for triangle counting with optimal space complexity. In particular, we present a single-pass algorithm that computes an $(\varepsilon,δ)$-approximation of the number of triangles with optimal space complexity. We introduce {\em right-to-be-forgotten graph streaming} (RFGS) model, where a forget operation can cause all previous occurrences of an edge to disappear. We show that our single-pass algorithm can be extended to the RFGS model with optimal space complexity. Finally, we present optimal constant-pass algorithms that compute an $(\varepsilon,δ)$-approximation of the number of triangles and cliques for the repeated-edge arrival graph streams.

cs.DS↗

Computing over Data Streams using Catalytic Space

We introduce a streaming model with \emph{catalytic memory}, an auxiliary workspace that must be returned to its initial state at the end of the computation. We show that catalytic space yields dramatic space savings for data stream algorithms. We first study the exact computation of frequency moments in insertion-only data streams. For every $k\ge1$, we give an exact four-pass algorithm for computing $\mathbb{F}_{k}$ using $O(k\log m)$ clean space, where $m$ is the stream length. We also present a $(k+1)$-pass algorithm with the same clean-space complexity that uses a factor of $k$ less catalytic space than the four-pass algorithm. For small moments, we obtain stronger results. In particular, we show that $\mathbb{F}_{2}$ and $\mathbb{F}_{3}$ can be computed exactly in two and three passes, respectively, using only $O(\log m)$ clean space. Additionally, we show that exact $\mathbb{F}_{0}$ computation reduces to computing $\mathbb{F}_{k}$ for a suitably chosen large value of $k$, resulting in an exact four-pass algorithm for $\mathbb{F}_{0}$ using only $O(\log m)$ clean space. We further show how our frequency-moment algorithms can be used to exactly count induced occurrences of any fixed graph $H$ in a graph stream, yielding a four-pass algorithm that uses $O_H(\log n)$ clean space, where $n$ is the number of vertices in the graph. As a special case, we obtain an exact three-pass algorithm for triangle counting using $O(\log n)$ clean space. All of our algorithms are multi-pass. We complement these algorithmic results with a matching limitation showing that catalytic memory does not provide additional power in the single-pass setting. Specifically, we prove that every randomized or deterministic single-pass streaming algorithm using $s$ bits of clean memory and catalytic space can be simulated in the standard streaming model, without catalytic memory, using $O(s)$ space.

cs.DS↗

From Decision to Random Certificates: Exponential Separation for Edge Estimation with Independent Set Queries

We study the problem of estimating the number of edges in an undirected, unweighted graph using sublinear query access. We consider a query model that preserves the structure of Independent Set (IS) queries, but augments their output with a random certificate: given a vertex subset, the oracle returns a uniformly random edge from the induced subgraph if one exists, and returns null otherwise. Using this access, we give a randomized algorithm that outputs a $(1 \pm \varepsilon)$-approximation to the number of edges with constant success probability using $\widetilde{O}(\log^{2} m)$ queries. This implies an exponential separation from both standard IS queries and global random edge-sampling models: estimating the number of edges using standard IS queries require $\widetildeΘ\!\left(\min\left\{\sqrt{m},\, \frac{n}{\sqrt{m}}\right\}\right)$ queries, while direct random edge-sample access requires $\widetildeΘ(\sqrt{m})$ samples. Beyond separation in query complexity, our algorithm is output-sensitive: its query complexity is polylogarithmic in the number of edges in the graph. This aligns with the classical objective in group testing, where one seeks algorithms that are both worst-case optimal and instance-adaptive. Conceptually, our model connects group testing, the decision-versus-counting dichotomy, graph property testing, and the "power of a random certificate", and can be viewed as a structured form of conditional sampling of edges in graphs.

cs.DS↗

Optimal non-adaptive algorithm for edge estimation

We present a simple nonadaptive randomized algorithm that estimates the number of edges in a simple, unweighted, undirected graph, possibly containing isolated vertices, using only degree and random edge queries. For an $n$-vertex graph, our method requires only $\widetilde{O}(\sqrt{n})$ queries, achieving sublinear query complexity. The algorithm independently samples a set of vertices and queries their degrees, and also independently samples a set of edges, using the answers to these queries to estimate the total number of edges in the graph. We further prove a matching lower bound, establishing the optimality of our algorithm and resolving the non-adaptive query complexity of this problem with respect to degree and random-edge queries.

cs.DS↗

Dimension Agnostic Testing of Survey Data Credibility through the Lens of Regression

Assessing whether a sample survey credibly represents the population is a critical question for ensuring the validity of downstream research. Generally, this problem reduces to estimating the distance between two high-dimensional distributions, which typically requires a number of samples that grows exponentially with the dimension. However, depending on the model used for data analysis, the conclusions drawn from the data may remain consistent across different underlying distributions. In this context, we propose a task-based approach to assess the credibility of sampled surveys. Specifically, we introduce a model-specific distance metric to quantify this notion of credibility. We also design an algorithm to verify the credibility of survey data in the context of regression models. Notably, the sample complexity of our algorithm is independent of the data dimension. This efficiency stems from the fact that the algorithm focuses on verifying the credibility of the survey data rather than reconstructing the underlying regression model. Furthermore, we show that if one attempts to verify credibility by reconstructing the regression model, the sample complexity scales linearly with the dimensionality of the data. We prove the theoretical correctness of our algorithm and numerically demonstrate our algorithm's performance.

cs.LG↗

Testing Credibility of Public and Private Surveys through the Lens of Regression

Testing whether a sample survey is a credible representation of the population is an important question to ensure the validity of any downstream research. While this problem, in general, does not have an efficient solution, one might take a task-based approach and aim to understand whether a certain data analysis tool, like linear regression, would yield similar answers both on the population and the sample survey. In this paper, we design an algorithm to test the credibility of a sample survey in terms of linear regression. In other words, we design an algorithm that can certify if a sample survey is good enough to guarantee the correctness of data analysis done using linear regression tools. Nowadays, one is naturally concerned about data privacy in surveys. Thus, we further test the credibility of surveys published in a differentially private manner. Specifically, we focus on Local Differential Privacy (LDP), which is a standard technique to ensure privacy in surveys where the survey participants might not trust the aggregator. We extend our algorithm to work even when the data analysis has been done using surveys with LDP. In the process, we also propose an algorithm that learns with high probability the guarantees a linear regression model on a survey published with LDP. Our algorithm also serves as a mechanism to learn linear regression models from data corrupted with noise coming from any subexponential distribution. We prove that it achieves the optimal estimation error bound for $\ell_1$ linear regression, which might be of broader interest. We prove the theoretical correctness of our algorithms while trying to reduce the sample complexity for both public and private surveys. We also numerically demonstrate the performance of our algorithms on real and synthetic datasets.

cs.LG↗