arXiv ScienceSearch

arXiv subjects

Tom Fischer

Publications and source records attributed to Tom Fischer.

17 recordsLinked to original sources

Emergence of a Shared Canonical Object Frame from In-the-Wild Videos

Comparing object orientations and positions across different instances requires their poses to be expressed in a shared canonical frame. Establishing such frames has traditionally required manual annotation, creating a scaling bottleneck that limits category and instance diversity. We show that a shared canonical frame can instead emerge from self-supervised training on object-centric videos captured in the wild, using only noisy camera poses from Structure-from-Motion. Our key idea is to route all training sequences through a shared geometric bottleneck: a coarse canonical mesh that carries no category-specific detail. By learning dense correspondences from image pixels to this mesh, and estimating per-sequence alignments from noisy SfM geometry, a common canonical frame emerges from multi-view consistency and the semantic priors of the feature extractor, without any canonical pose labels or category conditioning. Trained in a self-supervised manner on 160,000 in-the-wild object videos, our method achieves competitive accuracy on category-level pose estimation benchmarks compared to methods that rely on canonical pose supervision. The code and checkpoint is available on https://github.com/Fischer-Tom/Emergent-Canonical-Frame/.

cs.CV

Hoi3DGen: Generating High-Quality Human-Object-Interactions in 3D

Modeling and generating 3D human-object interactions from text is crucial for applications in AR, XR, and gaming. Existing approaches often rely on score distillation from text-to-image models, but their results suffer from the Janus problem and do not follow text prompts faithfully due to the scarcity of high-quality interaction data. We introduce Hoi3DGen, a framework that generates high-quality textured meshes of human-object interaction that follow the input interaction descriptions precisely. We first curate realistic and high-quality interaction data leveraging multimodal large language models, and then create a full text-to-3D pipeline, which achieves orders-of-magnitude improvements in interaction fidelity. Our method surpasses baselines by 4-15x in text consistency and 3-7x in 3D model quality, exhibiting strong generalization to diverse categories and interaction types, while maintaining high-quality 3D generation.

cs.CV

Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes

Recognizing objects in images is a fundamental problem in computer vision. Although detecting objects in 2D images is common, many applications require determining their pose in 3D space. Traditional category-level methods rely on RGB-D inputs, which may not always be available, or employ two-stage approaches that use separate models and representations for detection and pose estimation. For the first time, we introduce a unified model that integrates detection and pose estimation into a single framework for RGB images by leveraging neural mesh models with learned features and multi-model RANSAC. Our approach achieves state-of-the-art results for RGB category-level pose estimation on REAL275, improving on the current state-of-the-art by 22.9% averaged across all scale-agnostic metrics. Finally, we demonstrate that our unified method exhibits greater robustness compared to single-stage baselines. Our code and models are available at https://github.com/Fischer-Tom/unified-detection-and-pose-estimation.

cs.CV

iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning

Different from human nature, it is still common practice today for vision tasks to train deep learning models only initially and on fixed datasets. A variety of approaches have recently addressed handling continual data streams. However, extending these methods to manage out-of-distribution (OOD) scenarios has not effectively been investigated. On the other hand, it has recently been shown that non-continual neural mesh models exhibit strong performance in generalizing to such OOD scenarios. To leverage this decisive property in a continual learning setting, we propose incremental neural mesh models that can be extended with new meshes over time. In addition, we present a latent space initialization strategy that enables us to allocate feature space for future unseen classes in advance and a positional regularization term that forces the features of the different classes to consistently stay in respective latent space regions. We demonstrate the effectiveness of our method through extensive experiments on the Pascal3D and ObjectNet3D datasets and show that our approach outperforms the baselines for classification by $2-6\%$ in the in-domain and by $6-50\%$ in the OOD setting. Our work also presents the first incremental learning approach for pose estimation. Our code and model can be found at https://github.com/Fischer-Tom/iNeMo.

cs.CV

Neuroexplicit Diffusion Models for Inpainting of Optical Flow Fields

Deep learning has revolutionized the field of computer vision by introducing large scale neural networks with millions of parameters. Training these networks requires massive datasets and leads to intransparent models that can fail to generalize. At the other extreme, models designed from partial differential equations (PDEs) embed specialized domain knowledge into mathematical equations and usually rely on few manually chosen hyperparameters. This makes them transparent by construction and if designed and calibrated carefully, they can generalize well to unseen scenarios. In this paper, we show how to bring model- and data-driven approaches together by combining the explicit PDE-based approaches with convolutional neural networks to obtain the best of both worlds. We illustrate a joint architecture for the task of inpainting optical flow fields and show that the combination of model- and data-driven modeling leads to an effective architecture. Our model outperforms both fully explicit and fully data-driven baselines in terms of reconstruction quality, robustness and amount of required training data. Averaging the endpoint error across different mask densities, our method outperforms the explicit baselines by 11-27%, the GAN baseline by 47% and the Probabilisitic Diffusion baseline by 42%. With that, our method sets a new state of the art for inpainting of optical flow fields from random masks.

cs.CV

Consistency between transitive relations and between cones

A relation extends another relation consistently if its symmetric, respectively its asymmetric, part contains the corresponding part of the smaller relation. It is shown that there exists no finite circular chain made from two transitive relations $\mathbf{A}$ and $\mathbf{B}$ with at least one link from their asymmetric parts if and only if there exists a total preorder which consistently extends both. Additionally, this extension is uniquely determined if and only if the reflexive transitive closure of the union of $\mathbf{A}$ and $\mathbf{B}$ is total. Applications: (1) If the steps of a walk come from two positive cones, with at least one step from one of the cones' non-linear parts, then returning to the origin is impossible if and only if there exists a third cone of which the linear part contains each of the linear parts of the two original cones, and of which the non-linear part contains each of the two non-linear parts. (2) Reminiscent of the Fundamental Theorem of Asset Pricing, absence of arbitrage is equivalent to the existence of a complete preference order which consistently extends a market's fair exchange relation and its objective strict preference order. (3) Another impossibility in microeconomics: For two agents, or an agent and a market, with additive positively homogeneous preferences, an allocation can never be Pareto optimal if they are not `cut from the same cloth'.

math.GM

Share at least half the numbers in a nontrivial LCM-closed set a nontrivial divisor?

For a finite set of non-zero natural numbers that contains at least one element different from 1 and the least common multiple of any of its subsets, there exists a subset of at least half of its members which has a common divisor larger than 1. Utilizing a representation of the natural numbers as an order-theoretical ring of prime power sets, this conjecture is shown to be equivalent to Frankl's union-closed sets conjecture. Some results for cases where the conjecture, which also has meaningful interpretations in graph and lattice theory, is known to hold are provided. An equivalent dual version of the conjecture is, that for a finite set of non-zero natural numbers that contains at least two elements and the greatest common divisor of any of its subsets, one of its members has a prime power that is not a prime power of more than half of the members.

math.NT

Object Detection and Classification in Occupancy Grid Maps using Deep Convolutional Networks

A detailed environment perception is a crucial component of automated vehicles. However, to deal with the amount of perceived information, we also require segmentation strategies. Based on a grid map environment representation, well-suited for sensor fusion, free-space estimation and machine learning, we detect and classify objects using deep convolutional neural networks. As input for our networks we use a multi-layer grid map efficiently encoding 3D range sensor information. The inference output consists of a list of rotated bounding boxes with associated semantic classes. We conduct extensive ablation studies, highlight important design considerations when using grid maps and evaluate our models on the KITTI Bird's Eye View benchmark. Qualitative and quantitative benchmark results show that we achieve robust detection and state of the art accuracy solely using top-view grid maps from range sensor data.

cs.CV

No-Arbitrage Prices of Cash Flows and Forward Contracts as Choquet Representations

In a market of deterministic cash flows, given as an additive, symmetric relation of exchangeability on the finite signed Borel measures on the non-negative real time axis, it is shown that the only arbitrage-free price functional that fulfills some additional mild requirements is the integral of the unit zero-coupon bond prices with respect to the payment measures. For probability measures, this is a Choquet representation, where the Dirac measures, as unit zero-coupon bonds, are the extreme points. Dropping one of the requirements, the Lebesgue decomposition is used to construct counterexamples, where the Choquet price formula does not hold despite of an arbitrage-free market model. The concept is then extended to deterministic streams of assets and currencies in general, yielding a valuation principle for forward markets. Under mild assumptions, it is shown that a foreign cash flow's worth in local currency is identical to the value of the cash flow in local currency for which the Radon-Nikodym derivative with respect to the foreign cash flow is the forward FX rate.

q-fin.MF

Valuation Algorithms for Structural Models of Financial Interconnectedness

Much research in systemic risk is focused on default contagion. While this demands an understanding of valuation, fewer articles specifically deal with the existence, the uniqueness, and the computation of equilibrium prices in structural models of interconnected financial systems. However, beyond contagion research, these topics are also essential for risk-neutral pricing. In this article, we therefore study and compare valuation algorithms in the standard model of debt and equity cross-ownership which has crystallized in the work of several authors over the past one and a half decades. Since known algorithms have potentially infinite runtime, we develop a class of new algorithms, which find exact solutions in finitely many calculation steps. A simulation study for a range of financial system designs allows us to derive conclusions about the efficiency of different numerical methods under different system parameters.

q-fin.CP

A primer on reflexivity and price dynamics under systemic risk

A simple quantitative example of a reflexive feedback process and the resulting price dynamics after an exogenous price shock to a financial network is presented. Furthermore, an outline of a theory that connects financial reflexivity, which stems from cross-ownership and delayed or incomplete information, and no-arbitrage pricing theory under systemic risk is provided.

q-fin.GN

Cross-Ownership as a Structural Explanation for Over- and Underestimation of Default Probability

Based on the work of Suzuki (2002), we consider a generalization of Merton's asset valuation approach (Merton, 1974) in which two firms are linked by cross-ownership of equity and liabilities. Suzuki's results then provide no arbitrage prices of firm values, which are derivatives of exogenous asset values. In contrast to the Merton model, the assumption of lognormally distributed assets does not result in lognormally distributed firm values, which also affects the corresponding probabilities of default. In a simulation study we see that, depending on the type of cross-ownership, the lognormal model can lead to both, over- and underestimation of the actual probability of default of a firm under cross-ownership. In the limit, i.e. if the levels of cross-ownership tend to their maximum possible value, these findings can be shown theoretically as well. Furthermore, we consider the default probability of a firm in general, i.e. without a distributional assumption, and show that the lognormal model is often able to yield only a limited range of probabilities of default, while the actual probabilities may take any value between 0 and 1.

q-fin.RM

A shorter proof of Lemma A.6 (arXiv:1005.0768)

For the convenience of readers of the article {\em No-arbitrage pricing under systemic risk: accounting for cross-ownership} (Fischer, 2012, arXiv:1005.0768), a full proof of Lemma A.5 and a shorter proof of Lemma A.6 of that paper are provided.

q-fin.PR

Stopping times are hitting times: a natural representation

There exists a simple, didactically useful one-to-one relationship between stopping times and adapted c\`agl\`ad (LCRL) processes that are non-increasing and take the values 0 and 1 only. As a consequence, stopping times are always hitting times.

math.PR

No-arbitrage pricing under cross-ownership

We generalize Merton's asset valuation approach to systems of multiple financial firms where cross-ownership of equities and liabilities is present. The liabilities, which may include debts and derivatives, can be of differing seniority. We derive equations for the prices of equities and recovery claims under no-arbitrage. An existence result and a uniqueness result are proven. Examples and an algorithm for the simultaneous calculation of all no-arbitrage prices are provided. A result on capital structure irrelevance for groups of firms regarding externally held claims is discussed, as well as financial leverage and systemic risk caused by cross-ownership.

q-fin.PR

Consumption processes and positively homogeneous projection properties

We constructively prove the existence of time-discrete consumption processes for stochastic money accounts that fulfill a pre-specified positively homogeneous projection property (PHPP) and let the account always be positive and exactly zero at the end. One possible example is consumption rates forming a martingale under the above restrictions. For finite spaces, it is shown that any strictly positive consumption strategy with restrictions as above possesses at least one corresponding PHPP and could be constructed from it. We also consider numeric examples under time-discrete and -continuous account processes, cases with infinite time horizons and applications to income drawdown and bonus theory.

q-fin.GN