arXiv Science⌕ Search

arXiv · 2611.16992

Media Trading with Censored Auction Prices: A Stochastic Control and Reinforcement Learning Approach

Abstract

In real-time bidding, marketing agencies must balance campaign performance, transaction margins and the use of a finite advertising budget. A key difficulty is that market-clearing prices are typically observed only when bids are successful, so the information available for subsequent decisions depends on the bidding policy. We formulate this problem using a continuous-time stochastic control model with a latent price process. To construct a price signal, we consider parallel exploratory subcampaigns in which bids are randomized subject to an upper bound. Under a stylized cross-sectional sampling model, the resulting price estimator is consistent and satisfies a mean-square error bound of order $N^{-1}$, where $N$ is the number of exploratory observations. We then describe a model-based approach combining forward-equation calibration with Hamilton-Jacobi-Bellman policy iteration and a physics-informed neural network, alongside an entropy-regularized actor-critic approach based on observable information in a model-free setting. Synthetic experiments illustrate the estimator and the computational procedures. The framework clarifies the decision and information trade-offs faced by the agency, while distinguishing full-information benchmarks and estimated-price policies from the genuinely partially observed control problem.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yun-Ithry Gamrani, Huyên Pham. 2026-11-12. Media Trading with Censored Auction Prices: A Stochastic Control and Reinforcement Learning Approach. https://arxiv.science/abs/2611.16992

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

Drift-invariant kernels for discount curve models

Kernel ridge regression estimates the discount curve as the minimizer of a pricing error plus a penalty given by the norm of a reproducing kernel Hilbert space. By the representer theorem, the estimate lies in a finite-dimensional affine space that depends only on the kernel and on the cash flow dates of the instruments. We ask when this space is invariant under the risk-neutral drift of the discount curve, so that the estimated curves can be the states of a continuous-time arbitrage-free model. We show that this holds for every grid of cash flow dates if and only if the kernel is of the form $k(x,y)=\e^{b(x+y)}\big(c\,\e^{axy}+1-c\big)$, apart from kernels whose Hilbert space has dimension at most two. For this kernel the estimated curve is an affine combination of flat discount curves, each corresponding to a constant continuously compounded yield. The drift-invariant subspaces correspond to sub-grids of the cash flow dates, and the discounted coefficients have linear risk-neutral dynamics.

q-fin.MF↗

Total Positivity Properties of American Options

Call option prices, viewed as functions of strike and time-to-expiration, are totally positive of order 2 (TP2) if the ratio of the price of a higher-strike call to a lower-strike call increases with time-to-expiration. A corresponding property applies to put option prices. Prior work has developed conditions for these properties to hold for European options; here we establish these properties for American options. The key condition we require is that log returns on the underlying asset have a log-concave density. Gaussian densities provide an important special case. Within our framework, we show that total positivity properties hold more broadly for American than European options. Empirically, we find that violations of TP2 properties are infrequent, typically small, and reverse quickly. Trades that bet against violations achieve high hit rates. Violations are more frequent among European than American options, a pattern that is qualitatively consistent with our theoretical results.

q-fin.MF↗

Beyond Marginal Risk: ESG and Multidimensional Fragility in Equity Markets

Do ESG characteristics provide financial resilience beyond conventional risk, and is that inference stable to the financial state and ESG score being measured? We study a point-in-time panel of nonfinancial S&P 500 constituents from January 2019 through November 2025. Once ex ante return, volatility, and liquidity exposures are modeled explicitly, the broad downside-resilience pattern attenuates and none of the three primary marginal ESG $\times$ Down tests survives Holm adjustment under either conventional or wild-cluster-bootstrap inference. A post-primary exact decomposition then shows that the negative Return+RVOL coefficient is almost entirely allocated to observations that also breach the CHL trading-cost tail, while the mutually exclusive Return+RVOL-only component is essentially zero. Finally, a paired standardized comparison on an identical sample shows that MSCI's downstream Industry Adjusted Score and upstream Weighted Average Key Issue Score imply materially different fitted associations in adverse market states: at a 5% market decline, the difference is about one probability percentage point per score standard deviation. Sector-time, leave- one-month-out, and observed-change timing diagnostics preserve most of this contrast, although the result remains exploratory and inference is sensitive to multiplicity and market-state support. The evidence therefore favors a narrower interpretation of ESG resilience: the apparent association weakens once conventional risk is modeled, while the remaining relation depends on both the adverse state and the MSCI score field used to represent ESG.

q-fin.MF↗