arXiv Science⌕ Search

arXiv · 2610.20450

What Does Disagreement Mean? A Semantic Identifiability Frontier for Pairwise Preference Learning

Abstract

Pairwise comparison data are a standard supervision signal in preference learning, but disagreement in such data can reflect stable latent heterogeneity, ephemeral stochasticity, or non-binary responses hidden by a forced-choice interface. We study which of these semantic distinctions are identifiable from the feedback channel itself. We introduce a nonparametric latent semantic model with three querywise quantities: aggregate directional preference $μ_q$, persistent disagreement $τ_q$, and non-binary mass $α_q$. Under the anonymous binary channel, we prove an exact semantic fiber theorem: $μ_q$ is point-identified, whereas $(τ_q, α_q)$ vary over an explicit feasible region compatible with the same binary law. Same-annotator repeats identify $τ_q$ through a covariance identity, abstention-enabled feedback identifies $α_q$ directly, and together they point-identify the full semantic triple. We also derive finite-sample estimators, nonasymptotic concentration bounds, and semantics-aware action-recovery guarantees, and validate the theory on theorem-matched synthetic data.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Manoj Saravanan, Rohit Kumar Salla, Shrikar Reddy Kota. 2026-10-14. What Does Disagreement Mean? A Semantic Identifiability Frontier for Pairwise Preference Learning. https://arxiv.org/abs/2610.20450

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Incentivize Contribution and Learn Parameters Too: Federated Learning with Strategic Data Owners

In federated learning (FL), a center trains a shared model from updates that clients compute on their private data. Collecting and training on data is costly, so a strategic client may contribute little data and free-ride on the model trained by the others. We study mechanisms that incentivize data contribution and learn the model at the same time. Our first mechanism, UPBReD, updates the clients ' contributions and the model jointly, and converges at a geometric rate to a Nash equilibrium of the contribution game together with the welfare-maximizing model for those contributions. This equilibrium can involve under-contribution, so our second mechanism, 2P-UPBReD, adds budget-balanced transfers that make full contribution a dominant strategy, after which training converges to the optimal model; we also give conditions under which every client prefers to participate. Both mechanisms trust what clients report about the data they use and the gradients they compute. We show that no payment rule can reward unverifiable contributions unless something the center observes depends on the data actually used. Building on this, T-2P-UPBReD checks each client's reported contribution against the other clients ' realized valuations of the trained model, and prices gradient reports with a budget-balanced charge. It elicits truthful contribution reports, makes gradient reports approximately truthful, still reaches full contribution and the optimal model, and never runs a deficit. Experiments on CIFAR-10, FEMNIST, and Twitter show that 2P-UPBReD matches the welfare of FedAvg trained on all data, while strategic clients without incentives lower the welfare of the learned model.

cs.GT↗

Likes, Budgets, and Equilibria: Designing Contests for Socially Optimal Advertising

We study competitive advertising on a social network. Each of $m$ firms allocates a budget across consumers, and a platform decides, through a contest success function (CSF), what share of each consumer's attention every firm captures; awareness then spreads through the network. We model awareness and budgets on two timescales and bound how many fast steps awareness needs to settle between budget updates. On the slow timescale, best-response dynamics converge at a geometric rate to a Nash equilibrium whenever the firms' utilities are strongly concave and smooth, and a subclass of the standard ratio-form CSFs satisfies these conditions. Their equilibrium, however, need not maximize welfare: a firm's spending lowers its rivals' shares of attention, so individual and social optima differ, and a constant per-unit charge cannot close this gap in general. We give a sufficient condition for the equilibrium to coincide with the welfare optimum. To meet it, we multiply each firm's ratio share by a function of the total spending at the consumer, a class we call scaled ratio CSFs (SRCSFs), and show that within this class the condition holds exactly when this function is a power of the total spending, which gives the Power RCSF. The Power RCSF alone falls short in two ways. Its equilibrium is optimal only when firms exhaust their budgets, which we remove with a budget-balanced per-unit charge. Its curvature also becomes unbounded as spending at a consumer approaches zero, breaking convergence, which we restore by requiring every firm to spend a small minimum on each consumer. With both additions, best-response dynamics converge to a unique, symmetric equilibrium that maximizes $p$-mean social welfare for every $p \le 1$ simultaneously, so the Price of Anarchy is one.

cs.GT↗

Fair Allocation with Dichotomous Preferences over Item Complements

We study the problem of fair allocation when agents have dichotomous submodular preferences over groups of, rather than individual, items. These preferences naturally extend existing models, and have a natural interpretation in settings such as course allocation. We show that this seemingly minor extension results in computational intractability barriers: computing a utilitarian or Nash-optimal allocation with item complements is NP-hard. However, when agents' complementary bundles have size at most $k$, there exist poly-time algorithms that compute $\frac1k$-$\texttt{maxUSW}$ allocations and approximate Nash-welfare-maximizing allocations. While PO+EF-1 allocations may not exist in the complementary preference setting, it is possible to compute $\frac1{k+1}$-approximately $\texttt{maxUSW}$ EF-X allocations in polynomial time; furthermore, these allocations offer each agent $i$ a utility of at least $\frac{\texttt{MMS}_i - k}{k+1 + \frac1n}$, where $\texttt{MMS}_i$ is agent $i$'s maximin share guarantee. While the standard dichotomous binary submodular setting admits simple sequential techniques for computing fair and efficient allocations, our results for the complements setting require more complex tools from combinatorial optimization.

cs.GT↗