arXiv Science⌕ Search

arXiv subjects

David Li

Publications and source records attributed to David Li.

41 records · Page 3Linked to original sources

OmniSyn: Synthesizing 360 Videos with Wide-baseline Panoramas

Immersive maps such as Google Street View and Bing Streetside provide true-to-life views with a massive collection of panoramas. However, these panoramas are only available at sparse intervals along the path they are taken, resulting in visual discontinuities during navigation. Prior art in view synthesis is usually built upon a set of perspective images, a pair of stereoscopic images, or a monocular image, but barely examines wide-baseline panoramas, which are widely adopted in commercial platforms to optimize bandwidth and storage usage. In this paper, we leverage the unique characteristics of wide-baseline panoramas and present OmniSyn, a novel pipeline for 360° view synthesis between wide-baseline panoramas. OmniSyn predicts omnidirectional depth maps using a spherical cost volume and a monocular skip connection, renders meshes in 360° images, and synthesizes intermediate views with a fusion network. We demonstrate the effectiveness of OmniSyn via comprehensive experimental results including comparison with the state-of-the-art methods on CARLA and Matterport datasets, ablation studies, and generalization studies on street views. We envision our work may inspire future research for this unheeded real-world task and eventually produce a smoother experience for navigating immersive maps.

cs.CV↗

MLGO: a Machine Learning Guided Compiler Optimizations Framework

Leveraging machine-learning (ML) techniques for compiler optimizations has been widely studied and explored in academia. However, the adoption of ML in general-purpose, industry strength compilers has yet to happen. We propose MLGO, a framework for integrating ML techniques systematically in an industrial compiler -- LLVM. As a case study, we present the details and results of replacing the heuristics-based inlining-for-size optimization in LLVM with machine learned models. To the best of our knowledge, this work is the first full integration of ML in a complex compiler pass in a real-world setting. It is available in the main LLVM repository. We use two different ML algorithms: Policy Gradient and Evolution Strategies, to train the inlining-for-size model, and achieve up to 7\% size reduction, when compared to state of the art LLVM -Oz. The same model, trained on one corpus, generalizes well to a diversity of real-world targets, as well as to the same set of targets after months of active development. This property of the trained models is beneficial to deploy ML techniques in real-world settings.

cs.PL↗

Learning Key-Value Store Design

We introduce the concept of design continuums for the data layout of key-value stores. A design continuum unifies major distinct data structure designs under the same model. The critical insight and potential long-term impact is that such unifying models 1) render what we consider up to now as fundamentally different data structures to be seen as views of the very same overall design space, and 2) allow seeing new data structure designs with performance properties that are not feasible by existing designs. The core intuition behind the construction of design continuums is that all data structures arise from the very same set of fundamental design principles, i.e., a small set of data layout design concepts out of which we can synthesize any design that exists in the literature as well as new ones. We show how to construct, evaluate, and expand, design continuums and we also present the first continuum that unifies major data structure designs, i.e., B+tree, B-epsilon-tree, LSM-tree, and LSH-table. The practical benefit of a design continuum is that it creates a fast inference engine for the design of data structures. For example, we can predict near instantly how a specific design change in the underlying storage of a data system would affect performance, or reversely what would be the optimal data structure (from a given set of designs) given workload characteristics and a memory budget. In turn, these properties allow us to envision a new class of self-designing key-value stores with a substantially improved ability to adapt to workload and hardware changes by transitioning between drastically different data structure designs to assume a diverse set of performance properties at will.

cs.DB↗

On the Amplification of Magnetic Field by a Supernova Blast Shock Wave in a Turbulent Medium

We have performed extensive two-dimensional magnetohydrodynamic simulations to study the amplification of magnetic fields when a supernova blast wave propagates into a turbulent interstellar plasma. The blast wave is driven by injecting high pressure in the simulation domain. The interstellar magnetic field can be amplified by two different processes, occurring in different regions. One is facilitated by the fluid vorticity generated by the ``rippled" shock front interacting with the background turbulence. The resulting turbulent flow keeps amplifying the magnetic field, consistent with earlier work \citep{Giacalone2007}. The other process is facilitated by the growth of the Rayleigh-Taylor instability at the contact discontinuity between the ejecta and the shocked medium. This can efficiently amplify the magnetic field and tends to produce the highest magnetic field. We investigate the dependence of the amplification on numerical parameters such as grid-cell size and on various physical parameters. We show the magnetic field has a characteristic radial profile that the downstream magnetic field gets progressively stronger away from the shock. This is because the downstream magnetic field needs a finite time to reach the efficient amplification, and will get further amplified in the Rayleigh-Taylor region. In our simulation we do not observe a systematic strong magnetic field within a small distance to the shock. This indicates that if the magnetic-field amplification in supernova remnants indeed occurs near the shock front, other processes such as three-dimensional instabilities, plasma kinetics and/or cosmic ray effect may need to be considered to explain the strong magnetic field in supernova remnants.

astro-ph.HE↗