arXiv subjects

Timothy Chan

Publications and source records attributed to Timothy Chan.

6 recordsLinked to original sources

arXiv2026

Evaluating for the long term: Learnings from industry

Online platforms prioritize long-term business outcomes, yet typical experiments are far too short to measure these outcomes directly. Our goal in this paper is to collect and share industry knowledge on how to make decisions from short-term experiments that are better aligned with long-term outcomes. Based on a daylong workshop with 26 experts from 15 online platforms and 4 universities, we formulate a series of propositions that reflect current industry knowledge. Participants largely agreed that reversals of sign from short-run to long-run treatment effects are rare, with reversals concentrating in specific cases such as treatments involving content quality signals, hyper-monetization, and pricing. Although the magnitude of treatment effects can shift over time, a "univariate autosurrogate", corresponding to the short-run treatment effect on the long-run metric of interest, is often hard to beat. A recurring theme was the importance of surrogates that are not only (or even primarily) unbiased for true long-run outcomes, but that improve decision-making. Thus, participants generally agreed that simple, interpretable surrogates were generally preferable to elaborate but hard-to-explain surrogate indices. Participants also agreed that, due to concerns about confounding and transportability, experimentally-learned surrogates are generally preferable to observationally-learned surrogates. However, the drawback is that learning good surrogates from experiments typically requires a large, representative portfolio of long-run experiments that few platforms possess. We conclude that there is no substitute for a well-run long-term experiment, whether for learning surrogates or validating them, and we highlight open challenges including evolving treatments, persistent treatments not fully mediated by short-term proxies, and mismatch between experimental samples and the target population.

stat.AP↗

arXiv2024

Robust Confidence Bands for Stochastic Processes Using Simulation

We propose a robust optimization approach for constructing confidence bands for stochastic processes using a finite number of simulated sample paths. Our approach can be used to quantify uncertainty in realizations of stochastic processes or validate stochastic simulation models by checking whether historical paths from the actual system fall within the constructed confidence band. Unlike existing approaches in the literature, our methodology is widely applicable and directly addresses optimization bias within the constraints, producing tight confidence bands with accurate coverage probabilities. It is tractable, being only slightly more complex than the state-of-the-art baseline approach, and easy to use, as it employs standard techniques. Additionally, our approach is also applicable to continuous-time processes after appropriately discretizing time. In our first case study, we show that our approach achieves the desired coverage probabilities with an order-of-magnitude fewer sample paths than the state-of-the-art baseline approach. In our second case study, we illustrate how our approach can be used to validate stochastic simulation models.

math.OC↗

arXiv2022

Controlling ball progression in soccer

In this paper, we examine how soccer players can use their spatial relationships to control parts of the field and safely move play up the field via chains of ``safe configurations,'' i.e. configurations of players on a team ensuring the possessor of the ball has a collection of open passing options all connected by open passing lanes. An underlying philosophy behind our work is that it is most difficult to disrupt an attacking team's progression forward (with the ball) when this attacking team has multiple ``good'' options of how to proceed at each moment in time. We provide some evidence of this. Our main construction is a directed weighted graph where the nodes encode the configurations of players, the directed edges encode transformations between these configurations, and the weights encode the relative frequencies of the transformations. We conclude with a few applications and proposed further investigations. We believe that our work can serve as a launching platform for significant further investigation into how teams can ``safely progress'' the ball up the field, strategy development, and sophisticated decision making metrics. For coaches and players, we aim to streamline the process of moving safely up the field. In particular, we aim to construct a framework for creating new successful patterns of movement and aim that our framework allows for the development of new strategy. At the same time, our work could help identify configurations on the field which often result in turnovers or that allow for a lot of strategic flexibility (also impeding defensive containment of the attacking team). *Because the contributions of the female authors to this paper were by no means less than those of the male authors, we have chosen to reverse convention and to list the authors in reverse alphabetical order to ensure that the female authors were not listed only after the male authors.

physics.soc-ph↗

arXiv2019

Dynamics of heavy and buoyant underwater pendulums

The humble pendulum is often invoked as the archetype of a simple, gravity driven, oscillator. Under ideal circumstances, the oscillation frequency of the pendulum is independent of its mass and swing amplitude. However, in most real-world situations, the dynamics of pendulums is not quite so simple, particularly with additional interactions between the pendulum and a surrounding fluid. Here we extend the realm of pendulum studies to include large amplitude oscillations of heavy and buoyant pendulums in a fluid. We performed experiments with massive and hollow cylindrical pendulums in water, and constructed a simple model that takes the buoyancy, added mass, fluid (nonlinear) drag, and bearing friction into account. To first order, the model predicts the oscillation frequencies, peak decelerations and damping rate well. An interesting effect of the nonlinear drag captured well by the model is that for heavy pendulums, the damping time shows a non-monotonic dependence on pendulum mass, reaching a minimum when the pendulum mass density is nearly twice that of the fluid. Small deviations from the model's predictions are seen, particularly in the second and subsequent maxima of oscillations. Using Time- Resolved Particle Image Velocimetry (TR-PIV), we reveal that these deviations likely arise due to the disturbed flow created by the pendulum at earlier times. The mean wake velocity obtained from PIV is used to model an extra drag term due to incoming wake flow. The revised model significantly improves the predictions for the second and subsequent oscillations.

physics.flu-dyn↗

arXiv2015

Instance Optimal Geometric Algorithms

We prove the existence of an algorithm $A$ for computing 2-d or 3-d convex hulls that is optimal for every point set in the following sense: for every sequence $\sigma$ of $n$ points and for every algorithm $A'$ in a certain class $\mathcal{A}$, the running time of $A$ on input $\sigma$ is at most a constant factor times the maximum running time of $A'$ on the worst possible permutation of $\sigma$ for $A'$. We establish a stronger property: for every sequence $\sigma$ of points and every algorithm $A'$, the running time of $A$ on $\sigma$ is at most a constant factor times the average running time of $A'$ over all permutations of $\sigma$. We call algorithms satisfying these properties instance-optimal in the order-oblivious and random-order setting. Such instance-optimal algorithms simultaneously subsume output-sensitive algorithms and distribution-dependent average-case algorithms, and all algorithms that do not take advantage of the order of the input or that assume the input is given in a random order. The class $\mathcal{A}$ under consideration consists of all algorithms in a decision tree model where the tests involve only multilinear functions with a constant number of arguments. To establish an instance-specific lower bound, we deviate from traditional Ben-Or-style proofs and adopt a new adversary argument. For 2-d convex hulls, we prove that a version of the well known algorithm by Kirkpatrick and Seidel (1986) or Chan, Snoeyink, and Yap (1995) already attains this lower bound. For 3-d convex hulls, we propose a new algorithm. We further obtain instance-optimal results for a few other standard problems in computational geometry. Our framework also reveals connection to distribution-sensitive data structures and yields new results as a byproduct, for example, on on-line orthogonal range searching in 2-d and on-line halfspace range reporting in 2-d and 3-d.

cs.CG↗

arXiv2014

On Hardness of Jumbled Indexing

Jumbled indexing is the problem of indexing a text $T$ for queries that ask whether there is a substring of $T$ matching a pattern represented as a Parikh vector, i.e., the vector of frequency counts for each character. Jumbled indexing has garnered a lot of interest in the last four years. There is a naive algorithm that preprocesses all answers in $O(n^2|\Sigma|)$ time allowing quick queries afterwards, and there is another naive algorithm that requires no preprocessing but has $O(n\log|\Sigma|)$ query time. Despite a tremendous amount of effort there has been little improvement over these running times. In this paper we provide good reason for this. We show that, under a 3SUM-hardness assumption, jumbled indexing for alphabets of size $\omega(1)$ requires $\Omega(n^{2-\epsilon})$ preprocessing time or $\Omega(n^{1-\delta})$ query time for any $\epsilon,\delta>0$. In fact, under a stronger 3SUM-hardness assumption, for any constant alphabet size $r\ge 3$ there exist describable fixed constant $\epsilon_r$ and $\delta_r$ such that jumbled indexing requires $\Omega(n^{2-\epsilon_r})$ preprocessing time or $\Omega(n^{1-\delta_r})$ query time.

cs.DS↗