arXiv subjects

Xing Liu

Publications and source records attributed to Xing Liu.

At least 109 records · Page 6Linked to original sources

arXiv2023

High-throughput screening of heterogeneous transition metal dual-atom catalysts by synergistic effect for nitrate reduction to ammonia

Nitrate reduction to ammonia has attracted much attention for nitrate (NO3-) removal and ammonia (NH3) production. Identifying promising catalyst for active nitrate electroreduction reaction (NO3RR) is critical to realize efficient upscaling synthesis of NH3 under low-temperature condition. For this purpose, by means of spin-polarized first-principles calculations, the NO3RR performance on a series of graphitic carbon nitride (g-CN) supported double-atom catalysts (denoted as M1M2@g-CN) are systematically investigated. The synergistic effect of heterogeneous dual-metal sites can bring out tunable activity and selectivity for NO3RR. Amongst 21 candidates examined, FeMo@g-CN and CrMo@g-CN possess a high performance with low limiting potentials of -0.34 and -0.39 V, respectively. The activities can be attributed to a synergistic effect of the M1M2 dimer d orbitals coupling with the anti-bonding orbital of NO3-. The dissociation of deposited FeMo and CrMo dimers into two separated monomers is proved to be difficult, ensuring the kinetic stability of M1M2@g-CN. Furthermore, the dual-metal decorated on g-CN significantly reduces the bandgap of g-CN and broadens the adsorption window of visible light, implying its great promise for photocatalysis. This work opens a new avenue for future theoretical and experimental design related to NO3RR photo-/electrocatalysts.

cond-mat.mtrl-sci↗

arXiv2023

HD-Fusion: Detailed Text-to-3D Generation Leveraging Multiple Noise Estimation

In this paper, we study Text-to-3D content generation leveraging 2D diffusion priors to enhance the quality and detail of the generated 3D models. Recent progress (Magic3D) in text-to-3D has shown that employing high-resolution (e.g., 512 x 512) renderings can lead to the production of high-quality 3D models using latent diffusion priors. To enable rendering at even higher resolutions, which has the potential to further augment the quality and detail of the models, we propose a novel approach that combines multiple noise estimation processes with a pretrained 2D diffusion prior. Distinct from the Bar-Tal et al.s' study which binds multiple denoised results to generate images from texts, our approach integrates the computation of scoring distillation losses such as SDS loss and VSD loss which are essential techniques for the 3D content generation with 2D diffusion priors. We experimentally evaluated the proposed approach. The results show that the proposed approach can generate high-quality details compared to the baselines.

cs.CV↗

arXiv2023

A High-dimensional Convergence Theorem for U-statistics with Applications to Kernel-based Testing

We prove a convergence theorem for U-statistics of degree two, where the data dimension $d$ is allowed to scale with sample size $n$. We find that the limiting distribution of a U-statistic undergoes a phase transition from the non-degenerate Gaussian limit to the degenerate limit, regardless of its degeneracy and depending only on a moment ratio. A surprising consequence is that a non-degenerate U-statistic in high dimensions can have a non-Gaussian limit with a larger variance and asymmetric distribution. Our bounds are valid for any finite $n$ and $d$, independent of individual eigenvalues of the underlying function, and dimension-independent under a mild assumption. As an application, we apply our theory to two popular kernel-based distribution tests, MMD and KSD, whose high-dimensional performance has been challenging to study. In a simple empirical setting, our results correctly predict how the test power at a fixed threshold scales with $d$ and the bandwidth.

math.ST↗

arXiv2023

Revisiting Neural Retrieval on Accelerators

Retrieval finds a small number of relevant candidates from a large corpus for information retrieval and recommendation applications. A key component of retrieval is to model (user, item) similarity, which is commonly represented as the dot product of two learned embeddings. This formulation permits efficient inference, commonly known as Maximum Inner Product Search (MIPS). Despite its popularity, dot products cannot capture complex user-item interactions, which are multifaceted and likely high rank. We hence examine non-dot-product retrieval settings on accelerators, and propose \textit{mixture of logits} (MoL), which models (user, item) similarity as an adaptive composition of elementary similarity functions. This new formulation is expressive, capable of modeling high rank (user, item) interactions, and further generalizes to the long tail. When combined with a hierarchical retrieval strategy, \textit{h-indexer}, we are able to scale up MoL to 100M corpus on a single GPU with latency comparable to MIPS baselines. On public datasets, our approach leads to uplifts of up to 77.3\% in hit rate (HR). Experiments on a large recommendation surface at Meta showed strong metric gains and reduced popularity bias, validating the proposed approach's performance and improved generalization.

cs.LG↗

arXiv2023

Using Perturbation to Improve Goodness-of-Fit Tests based on Kernelized Stein Discrepancy

Kernelized Stein discrepancy (KSD) is a score-based discrepancy widely used in goodness-of-fit tests. It can be applied even when the target distribution has an unknown normalising factor, such as in Bayesian analysis. We show theoretically and empirically that the KSD test can suffer from low power when the target and the alternative distributions have the same well-separated modes but differ in mixing proportions. We propose to perturb the observed sample via Markov transition kernels, with respect to which the target distribution is invariant. This allows us to then employ the KSD test on the perturbed sample. We provide numerical evidence that with suitably chosen transition kernels the proposed approach can lead to substantially higher power than the KSD test.

stat.ML↗

arXiv2023

MTrainS: Improving DLRM training efficiency using heterogeneous memories

Recommendation models are very large, requiring terabytes (TB) of memory during training. In pursuit of better quality, the model size and complexity grow over time, which requires additional training data to avoid overfitting. This model growth demands a large number of resources in data centers. Hence, training efficiency is becoming considerably more important to keep the data center power demand manageable. In Deep Learning Recommendation Models (DLRM), sparse features capturing categorical inputs through embedding tables are the major contributors to model size and require high memory bandwidth. In this paper, we study the bandwidth requirement and locality of embedding tables in real-world deployed models. We observe that the bandwidth requirement is not uniform across different tables and that embedding tables show high temporal locality. We then design MTrainS, which leverages heterogeneous memory, including byte and block addressable Storage Class Memory for DLRM hierarchically. MTrainS allows for higher memory capacity per node and increases training efficiency by lowering the need to scale out to multiple hosts in memory capacity bound use cases. By optimizing the platform memory hierarchy, we reduce the number of nodes for training by 4-8X, saving power and cost of training while meeting our target training performance.

cs.IR↗

arXiv2023

5G-Aided RTK Positioning in GNSS-Deprived Environments

This paper considers the localization problem in a 5G-aided global navigation satellite system (GNSS) based on real-time kinematic (RTK) technique. Specifically, the user's position is estimated based on the hybrid measurements, including GNSS pseudo-ranges, GNSS carrier phases, 5G angle-of-departures, and 5G channel delays. The underlying estimation problem is solved by steps that comprise obtaining the float solution, ambiguity resolution, and resolving the fixed solution. The analysis results show that the involvement of 5G observations can enable localization under satellite-deprived environments, inclusive of extreme cases with only 2 or 3 visible satellites. Moreover, extensive simulation results reveal that with the help of 5G observations, the proposed algorithm can significantly reduce the estimation error of the user's position and increase the success rate of carrier-phase ambiguity resolution.

eess.SP↗

arXiv2023

Optical and Near-infrared Observations of the Distant but Bright 'New Year's Burst' GRB 220101A

High-redshift gamma-ray bursts (GRBs) provide a powerful tool to probe the early universe, but still for relatively few do we have good observations of the afterglow. We here report the optical and near-infrared observations of the afterglow of a relatively high-redshift event, GRB\,220101A, triggered on New Year's Day of 2022. With the optical spectra obtained at XL2.16/BFOSC and NOT/ALFOSC, we determine the redshift of the burst at $z= 4.615$. Based on our optical and near-infrared data, combined with the X-ray data, we perform multiband fit with the python package \emph{afterglowpy}. A jet-break at $\sim$ 0.7 day post-burst is found to constrain the opening angle of the jet as $\sim$ 3.4 degree. We also determine circumburst density of $n_0 = 0.15\ {\rm cm}^{-3}$ as well as kinetic energy $E_{\rm K, iso} = 3.52\times 10^{54}$ erg. The optical afterglow is among the most luminous ever detected. We also find a ``mirror'' feature in the lightcurve during the prompt phase of the burst from 80 s to 120 s. The physical origin of such mirror feature is unclear.

astro-ph.HE↗

arXiv2023

Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Models

Deep learning recommendation models (DLRMs) are used across many business-critical services at Facebook and are the single largest AI application in terms of infrastructure demand in its data-centers. In this paper we discuss the SW/HW co-designed solution for high-performance distributed training of large-scale DLRMs. We introduce a high-performance scalable software stack based on PyTorch and pair it with the new evolution of Zion platform, namely ZionEX. We demonstrate the capability to train very large DLRMs with up to 12 Trillion parameters and show that we can attain 40X speedup in terms of time to solution over previous systems. We achieve this by (i) designing the ZionEX platform with dedicated scale-out network, provisioned with high bandwidth, optimal topology and efficient transport (ii) implementing an optimized PyTorch-based training stack supporting both model and data parallelism (iii) developing sharding algorithms capable of hierarchical partitioning of the embedding tables along row, column dimensions and load balancing them across multiple workers; (iv) adding high-performance core operators while retaining flexibility to support optimizers with fully deterministic updates (v) leveraging reduced precision communications, multi-level memory hierarchy (HBM+DDR+SSD) and pipelining. Furthermore, we develop and briefly comment on distributed data ingestion and other supporting services that are required for the robust and efficient end-to-end training in production environments.

cs.DC↗

arXiv2023

Photometric and Spectroscopic Observations of GRB 190106A: Emission from Reverse and Forward Shocks with Late-time Energy Injection

Early optical observations of gamma-ray bursts can significantly contribute to the study of the central engine and physical processes therein. However, of the thousands observed so far, still only a few have data at optical wavelengths in the first minutes after the onset of the prompt emission. Here we report on GRB\,190106A, whose afterglow was observed in optical bands just 36 s after the {\em Swift}/BAT trigger, i.e., during the prompt emission phase. The early optical afterglow exhibits a bimodal structure followed by a normal decay, with a faster decay after $\sim \rm T_{0}+$1 day. We present optical photometric and spectroscopic observations of GRB\,190106A. We derive the redshift via metal absorption lines from Xinglong 2.16-m/BFOSC spectroscopic observations. From the BFOSC spectrum, we measure $z= 1.861\pm0.002$. The double-peak optical light curve is a significant feature predicted by the reverse-forward external shock model. The shallow decay followed by a normal decay in both the X-ray and optical light curves is well explained with the standard forward-shock model with late-time energy injection. Therefore, GRB\,190106A offers a case study for GRBs emission from both reverse and forward shocks.

astro-ph.HE↗

arXiv2022

Learning the Network of Graphs for Graph Neural Networks

Graph neural networks (GNNs) have achieved great success in many scenarios with graph-structured data. However, in many real applications, there are three issues when applying GNNs: graphs are unknown, nodes have noisy features, and graphs contain noisy connections. Aiming at solving these problems, we propose a new graph neural network named as GL-GNN. Our model includes multiple sub-modules, each sub-module selects important data features and learn the corresponding key relation graph of data samples when graphs are unknown. GL-GNN further obtains the network of graphs by learning the network of sub-modules. The learned graphs are further fused using an aggregation method over the network of graphs. Our model solves the first issue by simultaneously learning multiple relation graphs of data samples as well as a relation network of graphs, and solves the second and the third issue by selecting important data features as well as important data sample relations. We compare our method with 14 baseline methods on seven datasets when the graph is unknown and 11 baseline methods on two datasets when the graph is known. The results show that our method achieves better accuracies than the baseline methods and is capable of selecting important features and graph edges from the dataset. Our code will be publicly available at \url{https://github.com/Looomo/GL-GNN}.

cs.LG↗

arXiv2022

Cross-Region Domain Adaptation for Class-level Alignment

Semantic segmentation requires a lot of training data, which necessitates costly annotation. There have been many studies on unsupervised domain adaptation (UDA) from one domain to another, e.g., from computer graphics to real images. However, there is still a gap in accuracy between UDA and supervised training on native domain data. It is arguably attributable to class-level misalignment between the source and target domain data. To cope with this, we propose a method that applies adversarial training to align two feature distributions in the target domain. It uses a self-training framework to split the image into two regions (i.e., trusted and untrusted), which form two distributions to align in the feature space. We term this approach cross-region adaptation (CRA) to distinguish from the previous methods of aligning different domain distributions, which we call cross-domain adaptation (CDA). CRA can be applied after any CDA method. Experimental results show that this always improves the accuracy of the combined CDA method, having updated the state-of-the-art.

cs.CV↗

arXiv2022

SoccerNet 2022 Challenges Results

The SoccerNet 2022 challenges were the second annual video understanding challenges organized by the SoccerNet team. In 2022, the challenges were composed of 6 vision-based tasks: (1) action spotting, focusing on retrieving action timestamps in long untrimmed videos, (2) replay grounding, focusing on retrieving the live moment of an action shown in a replay, (3) pitch localization, focusing on detecting line and goal part elements, (4) camera calibration, dedicated to retrieving the intrinsic and extrinsic camera parameters, (5) player re-identification, focusing on retrieving the same players across multiple views, and (6) multiple object tracking, focusing on tracking players and the ball through unedited video streams. Compared to last year's challenges, tasks (1-2) had their evaluation metrics redefined to consider tighter temporal accuracies, and tasks (3-6) were novel, including their underlying data and annotations. More information on the tasks, challenges and leaderboards are available on https://www.soccer-net.org. Baselines and development kits are available on https://github.com/SoccerNet.

cs.CV↗

arXiv2022

Polaritonic coherent perfect absorption based on strong critical coupling between quasi-bound state in the continuum and exciton

Enhancement of light-matter interactions is of great importance for many nanophotonic devices, and one way to achieve it is to feed energy perfectly to the strongly coupled system. Here, we propose gap-perturbed dimerized gratings based on bulk WS2 for flexible control of the strong coupling between quasi-bound state in the continuum (quasi-BIC) and exciton. The simulation results show that when a gap perturbation is introduced into the system resulting in the Brillouin zone folding, BIC transforms into quasi-BIC whose quality factor (Q-factor) is related to the value of gap perturbation. The strong coupling results in the anti-crossover behavior of the absorption spectra, and thus a Rabi splitting energy of 0.235 eV is obtained. Temporal coupled-mode theory is employed to analyze the strong coupling system, and the absorption of the system could be enhanced, by modulating the damping rate of quasi-BIC to make the system satisfy the strong critical coupling condition. Furthermore, polaritonic coherent perfect absorption is achieved by using the two-port source excitation. This work could provide ideas for enhancing light-matter interactions and a promising prospect for polariton-based light-emitting or lasing devices.

physics.optics↗

arXiv2022

Instantaneous GNSS Ambiguity Resolution and Attitude Determination via Riemannian Manifold Optimization

We present an ambiguity resolution method for Global Navigation Satellite System (GNSS)-based attitude determination. A GNSS attitude model with nonlinear constraints is used to rigorously incorporate a priori information. Given the characteristics of the employed nonlinear constraints, we formulate GNSS attitude determination as an optimization problem on a manifold. Then, Riemannian manifold optimization algorithms are utilized to aid ambiguity resolution based on a proposed decomposition of the objective function. The application of manifold geometry enables high-quality float solutions that are critical to reinforcing search-based integer ambiguity resolution in terms of efficiency, availability, and reliability. The proposed approach is characterized by a low computational complexity and a high probability of resolving the ambiguities correctly. The performance of the proposed ambiguity resolution method is tested through a series of simulations and real experiments. Comparisons with the principal benchmarks indicate the superiority of the proposed method as reflected by the high ambiguity resolution success rates.

eess.SP↗

arXiv2022

Strong approximation for fractional wave equation forced by fractional Brownian motion with Hurst parameter $H\in(0,\frac{1}{2})$

We consider the time discretization of fractional stochastic wave equation with Gaussian noise, which is negatively correlated. Major obstacles to design and analyze time discretization of stochastic wave equation come from the approximation of stochastic convolution with respect to fractional Brownian motion. Firstly, we discuss the smoothing properties of stochastic convolution by using integration by parts and covariance function of fractional Brownian motion. Then the regularity estimates of the mild solution of fractional stochastic wave equation are obtained. Next, we design the time discretization of stochastic convolution by integration by parts. Combining stochastic trigonometric method and approximation of stochastic convolution, the time discretization of stochastic wave equation is achieved. We derive the error estimates of the time discretization. Under certain assumptions, the strong convergence rate of the numerical scheme proposed in this paper can reach $\frac{1}{2}+H$. Finally, the convergence rate and computational efficiency of the numerical scheme are illustrated by numerical experiments.

math.NA↗

arXiv2022

Constrained Wrapped Least Squares: A Tool for High Accuracy GNSS Attitude Determination

Attitude determination is a popular application of Global Navigation Satellite Systems (GNSS). Many methods have been developed to solve the attitude determination problem with different performance offerings. We develop a constrained wrapped least-squares (C-WLS) method for high-accuracy attitude determination. This approach is built on an optimization model that leverages prior information related to the antenna array and the integer nature of the carrier-phase ambiguities in an innovative way. The proposed approach adopts an efficient search strategy to estimate the vehicle's attitude parameters using ambiguous carrier-phase observations directly, without requiring prior carrier-phase ambiguity fixing. The performance of the proposed method is evaluated via simulations and experimentally utilizing data collected using multiple GNSS receivers. The simulation and experimental results demonstrate excellent performance, with the proposed method outperforming the ambiguity function method, the constrained LAMBDA and multivariate constrained LAMBDA methods, three prominent attitude determination algorithms.

eess.SP↗

arXiv2022

Grassmann Stein Variational Gradient Descent

Stein variational gradient descent (SVGD) is a deterministic particle inference algorithm that provides an efficient alternative to Markov chain Monte Carlo. However, SVGD has been found to suffer from variance underestimation when the dimensionality of the target distribution is high. Recent developments have advocated projecting both the score function and the data onto real lines to sidestep this issue, although this can severely overestimate the epistemic (model) uncertainty. In this work, we propose Grassmann Stein variational gradient descent (GSVGD) as an alternative approach, which permits projections onto arbitrary dimensional subspaces. Compared with other variants of SVGD that rely on dimensionality reduction, GSVGD updates the projectors simultaneously for the score function and the data, and the optimal projectors are determined through a coupled Grassmann-valued diffusion process which explores favourable subspaces. Both our theoretical and experimental results suggest that GSVGD enjoys efficient state-space exploration in high-dimensional problems that have an intrinsic low-dimensional structure.

stat.ML↗