arXiv subjects

Eric Heitz

Publications and source records attributed to Eric Heitz.

8 recordsLinked to original sources

arXiv2024

Transforming a Non-Differentiable Rasterizer into a Differentiable One with Stochastic Gradient Estimation

We show how to transform a non-differentiable rasterizer into a differentiable one with minimal engineering efforts and no external dependencies (no Pytorch/Tensorflow). We rely on Stochastic Gradient Estimation, a technique that consists of rasterizing after randomly perturbing the scene's parameters such that their gradient can be stochastically estimated and descended. This method is simple and robust but does not scale in dimensionality (number of scene parameters). Our insight is that the number of parameters contributing to a given rasterized pixel is bounded. Estimating and averaging gradients on a per-pixel basis hence bounds the dimensionality of the underlying optimization problem and makes the method scalable. Furthermore, it is simple to track per-pixel contributing parameters by rasterizing ID- and UV-buffers, which are trivial additions to a rasterization engine if not already available. With these minor modifications, we obtain an in-engine optimizer for 3D assets with millions of geometry and texture parameters.

cs.GR↗

arXiv2023

Iterative $\alpha$-(de)Blending: a Minimalist Deterministic Diffusion Model

We derive a minimalist but powerful deterministic denoising-diffusion model. While denoising diffusion has shown great success in many domains, its underlying theory remains largely inaccessible to non-expert users. Indeed, an understanding of graduate-level concepts such as Langevin dynamics or score matching appears to be required to grasp how it works. We propose an alternative approach that requires no more than undergrad calculus and probability. We consider two densities and observe what happens when random samples from these densities are blended (linearly interpolated). We show that iteratively blending and deblending samples produces random paths between the two densities that converge toward a deterministic mapping. This mapping can be evaluated with a neural network trained to deblend samples. We obtain a model that behaves like deterministic denoising diffusion: it iteratively maps samples from one density (e.g., Gaussian noise) to another (e.g., cat images). However, compared to the state-of-the-art alternative, our model is simpler to derive, simpler to implement, more numerically stable, achieves higher quality results in our experiments, and has interesting connections to computer graphics.

cs.GR↗

arXiv2022

Bringing Linearly Transformed Cosines to Anisotropic GGX

Linearly Transformed Cosines (LTCs) are a family of distributions that are used for real-time area-light shading thanks to their analytic integration properties. Modern game engines use an LTC approximation of the ubiquitous GGX model, but currently this approximation only exists for isotropic GGX and thus anisotropic GGX is not supported. While the higher dimensionality presents a challenge in itself, we show that several additional problems arise when fitting, post-processing, storing, and interpolating LTCs in the anisotropic case. Each of these operations must be done carefully to avoid rendering artifacts. We find robust solutions for each operation by introducing and exploiting invariance properties of LTCs. As a result, we obtain a small $8^4$ look-up table that provides a plausible and artifact-free LTC approximation to anisotropic GGX and brings it to real-time area-light shading.

cs.GR↗

arXiv2021

Passing Multi-Channel Material Textures to a 3-Channel Loss

Our objective is to compute a textural loss that can be used to train texture generators with multiple material channels typically used for physically based rendering such as albedo, normal, roughness, metalness, ambient occlusion, etc. Neural textural losses often build on top of the feature spaces of pretrained convolutional neural networks. Unfortunately, these pretrained models are only available for 3-channel RGB data and hence limit neural textural losses to this format. To overcome this limitation, we show that passing random triplets to a 3-channel loss provides a multi-channel loss that can be used to generate high-quality material textures.

cs.GR↗

arXiv2021

Lessons Learned and Improvements when Building Screen-Space Samplers with Blue-Noise Error Distribution

Recent work has shown that the error of Monte-Carlo rendering is visually more acceptable when distributed as blue-noise in screen-space. Despite recent efforts, building a screen-space sampler is still an open problem. In this talk, we present the lessons we learned while improving our previous screen-space sampler. Specifically: we advocate for a new criterion to assess the quality of such samplers; we introduce a new screen-space sampler based on rank-1 lattices; we provide a parallel optimization method that is compatible with a GPU implementation and that achieves better quality; we detail the pitfalls of using such samplers in renderers and how to cope with many dimensions; and we provide empirical proofs of the versatility of the optimization process.

cs.GR↗

arXiv2020

A Sliced Wasserstein Loss for Neural Texture Synthesis

We address the problem of computing a textural loss based on the statistics extracted from the feature activations of a convolutional neural network optimized for object recognition (e.g. VGG-19). The underlying mathematical problem is the measure of the distance between two distributions in feature space. The Gram-matrix loss is the ubiquitous approximation for this problem but it is subject to several shortcomings. Our goal is to promote the Sliced Wasserstein Distance as a replacement for it. It is theoretically proven,practical, simple to implement, and achieves results that are visually superior for texture synthesis by optimization or training generative neural networks.

cs.CV↗

arXiv2019

Integration and Simulation of Bivariate Projective-Cauchy Distributions within Arbitrary Polygonal Domains

Consider a uniform variate on the unit upper-half sphere of dimension $d$. It is known that the straight-line projection through the center of the unit sphere onto the plane above it distributes this variate according to a $d$-dimensional projective-Cauchy distribution. In this work, we leverage the geometry of this construction in dimension $d=2$ to derive new properties for the bivariate projective-Cauchy distribution. Specifically, we reveal via geometric intuitions that integrating and simulating a bivariate projective-Cauchy distribution within an arbitrary domain translates into respectively measuring and sampling the solid angle subtended by the geometry of this domain as seen from the origin of the unit sphere. To make this result practical for, e.g., generating truncated variants of the bivariate projective-Cauchy distribution, we extend it in two respects. First, we provide a generalization to Cauchy distributions parameterized by location-scale-correlation coefficients. Second, we provide a specialization to polygonal-domains, which leads to closed-form expressions. We provide a complete MATLAB implementation for the case of triangular domains, and briefly discuss the case of elliptical domains and how to further extend our results to bivariate Student distributions.

math.PR↗

arXiv2017

Notes on optimal approximations for importance sampling

In this manuscript, we derive optimal conditions for building function approximations that minimize variance when used as importance sampling estimators for Monte Carlo integration problems. Particularly, we study the problem of finding the optimal projection $g$ of an integrand $f$ onto certain classes of piecewise constant functions, in order to minimize the variance of the unbiased importance sampling estimator $E_g[f/g]$, as well as the related problem of finding optimal mixture weights to approximate and importance sample a target mixture distribution $f = \sum_i \alpha_i f_i$ with components $f_i$ in a family $\mathcal{F}$, through a corresponding mixture of importance sampling densities $g_i$ that are only approximately proportional to $f_i$. We further show that in both cases the optimal projection is different from the commonly used $\ell_1$ projection, and provide an intuitive explanation for the difference.

cs.GR↗