arXiv subjects

Ying Li

Publications and source records attributed to Ying Li.

At least 325 records · Page 18Linked to original sources

arXiv2023

Any-Size-Diffusion: Toward Efficient Text-Driven Synthesis for Any-Size HD Images

Stable diffusion, a generative model used in text-to-image synthesis, frequently encounters resolution-induced composition problems when generating images of varying sizes. This issue primarily stems from the model being trained on pairs of single-scale images and their corresponding text descriptions. Moreover, direct training on images of unlimited sizes is unfeasible, as it would require an immense number of text-image pairs and entail substantial computational expenses. To overcome these challenges, we propose a two-stage pipeline named Any-Size-Diffusion (ASD), designed to efficiently generate well-composed images of any size, while minimizing the need for high-memory GPU resources. Specifically, the initial stage, dubbed Any Ratio Adaptability Diffusion (ARAD), leverages a selected set of images with a restricted range of ratios to optimize the text-conditional diffusion model, thereby improving its ability to adjust composition to accommodate diverse image sizes. To support the creation of images at any desired size, we further introduce a technique called Fast Seamless Tiled Diffusion (FSTD) at the subsequent stage. This method allows for the rapid enlargement of the ASD output to any high-resolution size, avoiding seaming artifacts or memory overloads. Experimental results on the LAION-COCO and MM-CelebA-HQ benchmarks demonstrate that ASD can produce well-structured images of arbitrary sizes, cutting down the inference time by 2x compared to the traditional tiled algorithm.

cs.CV↗

arXiv2023

Quantum algorithms for optimal effective theory of many-body systems

A common situation in quantum many-body physics is that the underlying theories are known but too complicated to solve efficiently. In such cases one usually builds simpler effective theories as low-energy or large-scale alternatives to the original theories. Here the central tasks are finding the optimal effective theories and proving their equivalence to the original theories. Recently quantum computing has shown the potential of solving quantum many-body systems by exploiting its inherent parallelism. It is thus an interesting topic to discuss the emergence of effective theories and design efficient tools for finding them based on the results from quantum computing. As the first step towards this direction, in this paper, we propose two approaches that apply quantum computing to find the optimal effective theory of a quantum many-body system given its full Hamiltonian. The first algorithm searches the space of effective Hamiltonians by quantum phase estimation and amplitude amplification. The second algorithm is based on a variational approach that is promising for near-future applications.

quant-ph↗

arXiv2023

Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension, leading to escalating computational complexity and parameter proliferation, thus posing challenges for modeling dynamical systems with high-dimensional latent states. To surmount this obstacle, we propose to integrate the efficient transformed Gaussian process (ETGP) into the GPSSM, which involves pushing a shared GP through multiple normalizing flows to efficiently model the transition function in high-dimensional latent state space. Additionally, we develop a corresponding variational inference algorithm that surpasses existing methods in terms of parameter count and computational complexity. Experimental results on diverse synthetic and real-world datasets corroborate the efficiency of the proposed method, while also demonstrating its ability to achieve similar inference performance compared to existing methods. Code is available at \url{https://github.com/zhidilin/gpssmProj}.

cs.LG↗

arXiv2023

Global Existence of Large Solutions for the 3D incompressible Navier--Stokes--Poisson--Nernst--Planck Equations

This work is concerned with the global existence of large solutions to the three-dimensional dissipative fluid-dynamical model, which is a strongly coupled nonlinear nonlocal system characterized by the incompressible Navier--Stokes--Poisson--Nernst--Planck equations. Making full use of the algebraic structure of the system, we obtain the global existence of solutions without smallness assumptions imposed on the third component of the initial velocity field and the summation of initial densities of charged species. More precisely, we prove that there exist two positive constants $c_{0}, C_{0}$ such that if the initial data satisfies \begin{align*} \big(\|u_{0}^{h}\|_{\dot{B}^{-1+\frac{3}{p}}_{p,1}}+\|N_{0}-P_{0}\|_{\dot{B}^{-2+\frac{3}{q}}_{q,1}} \big) \exp\Big\{C_{0}\big(\|u_{0}^{3}\|_{\dot{B}^{-1+\frac{3}{p}}_{p,1}}^{2}+(\|N_{0}+P_{0}\|_{\dot{B}^{-2+\frac{3}{r}}_{r,1}}+1)\exp\big\{C_{0}\|u_{0}^{3}\|_{\dot{B}^{-1+\frac{3}{p}}_{p,1}}\big\}+1\big)\Big\} \leq c_{0}, \end{align*} then the incompressible Navier--Stokes--Poisson--Nernst--Planck equations admits a unique global solution.

math.AP↗

arXiv2023

Spectral Features of the Solar Transition Region and Chromospheric Lines at Flare Ribbons Observed with IRIS

We report on the spectral features of the Si IV 1402.77 Å, C II 1334.53 Å, and Mg II h or k lines, formed in the layers from the transition region to the chromosphere, in three two-ribbon flares (with X-, M-, and C-class) observed with IRIS. All the three lines show significant redshifts within the main flare ribbons, which mainly originate from the chromospheric condensation during the flares. The average redshift velocities of the Si IV line within the main ribbons are 56.6, 25.6, and 10.5 km s$^{-1}$ for the X-, M-, and C-class flares, respectively, which show a decreasing tendency with the flare class. The C II and Mg II lines show a similar tendency but with smaller velocities compared to the Si IV line. Additionally, the Mg II h or k line shows a blue-wing enhancement in the three flares in particular at the flare ribbon fronts, which is supposed to be caused by an upflow in the upper chromosphere due to the heating of the atmosphere. Moreover, the Mg II h or k line exhibits a central reversal at the flare ribbons, but turns to pure emission shortly after 1--4 minutes. Correspondingly, the C II line also shows a central reversal but in a smaller region. However, for the Si IV line, the central reversal is only found in the X-class flare, but not in the other two flares. As usual, the central reversal of these lines can be caused by the opacity effect. This implies that in addition to the optically thick lines (C II and Mg II lines), the Si IV line can become optically thick in a strong flare, which is likely related to the nonthermal electron beam heating.

astro-ph.SR↗

arXiv2023

Observation of Non-Hermitian Skin Effect in Thermal Diffusion

The paradigm shift of the Hermitian systems into the non-Hermitian regime profoundly modifies the inherent topological property, leading to various unprecedented effects such as the non-Hermitian skin effect (NHSE). In the past decade, the NHSE effect has been demonstrated in quantum, optical and acoustic systems. Besides in those non-Hermitian wave systems, the NHSE in diffusive systems has not yet been explicitly demonstrated, despite recent abundant advances in the study of topological thermal diffusion. Here we first design a thermal diffusion lattice based on a modified Su-Schrieffer-Heeger model which enables the observation of diffusive NHSE. In the proposed model, the periodic heat exchange rate among adjacent unit cells and the asymmetric temperature field coupling inside unit cells can be judiciously realized by appropriate configurations of structural parameters of unit cells. The transient concentration feature of temperature field on the boundary regardless of initial excitation conditions can be clearly observed, indicating the occurrence of transient thermal skin effect. Nonetheless, we experimentally demonstrated the NHSE and verified the remarkable robustness against various defects. Our work provides a platform for exploration of non-Hermitian physics in the diffusive systems, which has important applications in efficient heat collection, highly sensitive thermal sensing and others.

physics.class-ph↗

arXiv2023

Boosting Feedback Efficiency of Interactive Reinforcement Learning by Adaptive Learning from Scores

Interactive reinforcement learning has shown promise in learning complex robotic tasks. However, the process can be human-intensive due to the requirement of a large amount of interactive feedback. This paper presents a new method that uses scores provided by humans instead of pairwise preferences to improve the feedback efficiency of interactive reinforcement learning. Our key insight is that scores can yield significantly more data than pairwise preferences. Specifically, we require a teacher to interactively score the full trajectories of an agent to train a behavioral policy in a sparse reward environment. To avoid unstable scores given by humans negatively impacting the training process, we propose an adaptive learning scheme. This enables the learning paradigm to be insensitive to imperfect or unreliable scores. We extensively evaluate our method for robotic locomotion and manipulation tasks. The results show that the proposed method can efficiently learn near-optimal policies by adaptive learning from scores while requiring less feedback compared to pairwise preference learning methods. The source codes are publicly available at https://github.com/SSKKai/Interactive-Scoring-IRL.

cs.RO↗

arXiv2023

Quantum-assisted Monte Carlo algorithms for fermions

Quantum computing is a promising way to systematically solve the longstanding computational problem, the ground state of a many-body fermion system. Many efforts have been made to realise certain forms of quantum advantage in this problem, for instance, the development of variational quantum algorithms. A recent work by Huggins et al. reports a novel candidate, i.e. a quantum-classical hybrid Monte Carlo algorithm with a reduced bias in comparison to its fully-classical counterpart. In this paper, we propose a family of scalable quantum-assisted Monte Carlo algorithms where the quantum computer is used at its minimal cost and still can reduce the bias. By incorporating a Bayesian inference approach, we can achieve this quantum-facilitated bias reduction with a much smaller quantum-computing cost than taking empirical mean in amplitude estimation. Besides, we show that the hybrid Monte Carlo framework is a general way to suppress errors in the ground state obtained from classical algorithms. Our work provides a Monte Carlo toolkit for achieving quantum-enhanced calculation of fermion systems on near-term quantum devices.

quant-ph↗

arXiv2023

Tunable magnetism and electron correlation in Titanium-based Kagome metals RETi3Bi4 (RE = Yb, Pr, and Nd) by rare-earth engineering

Rare-earth engineering is an effective way to introduce and tune the magnetism in topological Kagome magnets, which has been acting as a fertile platform to investigate the quantum interactions between geometry, topology, spin, and correlation. Here we report the structure and properties of three newly discovered Titanium-based Kagome metals RETi3Bi4 (RE = Yb, Pr, and Nd) with various magnetic states. They crystalize in the orthogonal space group Fmmm (No.69), where slightly distorted Ti Kagome lattice, RE triangular lattice, Bi honeycomb and triangular lattices stack along the a axis. By changing the rare earth atoms on RE zag-zig chains, the magnetism can be tuned from nonmagnetic YbTi3Bi4 to short-range ordered PrTi3Bi4 (Tanomaly ~ 8.2 K), and finally to ferromagnetic NdTi3Bi4 (Tc ~ 8.5 K). The measurements of resistivity and specific heat capacity demonstrate an evolution of electron correlation and density of states near the Fermi level with different rare earth atoms. In-situ resistance measurements of NdTi3Bi4 under high pressure further reveal a potential relationship between the electron correlation and ferromagnetic ordering temperature. These results highlight RETi3Bi4 as another family of topological Kagome magnets to explore nontrivial band topology and exotic phases in Kagome materials.

cond-mat.str-el↗

arXiv2023

HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models

Despite the proven significance of hyperspectral images (HSIs) in performing various computer vision tasks, its potential is adversely affected by the low-resolution (LR) property in the spatial domain, resulting from multiple physical factors. Inspired by recent advancements in deep generative models, we propose an HSI Super-resolution (SR) approach with Conditional Diffusion Models (HSR-Diff) that merges a high-resolution (HR) multispectral image (MSI) with the corresponding LR-HSI. HSR-Diff generates an HR-HSI via repeated refinement, in which the HR-HSI is initialized with pure Gaussian noise and iteratively refined. At each iteration, the noise is removed with a Conditional Denoising Transformer (CDF ormer) that is trained on denoising at different noise levels, conditioned on the hierarchical feature maps of HR-MSI and LR-HSI. In addition, a progressive learning strategy is employed to exploit the global information of full-resolution images. Systematic experiments have been conducted on four public datasets, demonstrating that HSR-Diff outperforms state-of-the-art methods.

cs.CV↗

arXiv2023

PrivSketch: A Private Sketch-based Frequency Estimation Protocol for Data Streams

Local differential privacy (LDP) has recently become a popular privacy-preserving data collection technique protecting users' privacy. The main problem of data stream collection under LDP is the poor utility due to multi-item collection from a very large domain. This paper proposes PrivSketch, a high-utility frequency estimation protocol taking advantage of sketches, suitable for private data stream collection. Combining the proposed background information and a decode-first collection-side workflow, PrivSketch improves the utility by reducing the errors introduced by the sketching algorithm and the privacy budget utilization when collecting multiple items. We analytically prove the superior accuracy and privacy characteristics of PrivSketch, and also evaluate them experimentally. Our evaluation, with several diverse synthetic and real datasets, demonstrates that PrivSketch is 1-3 orders of magnitude better than the competitors in terms of utility in both frequency estimation and frequent item estimation, while being up to ~100x faster.

cs.CR↗

arXiv2023

EmotionNAS: Two-stream Neural Architecture Search for Speech Emotion Recognition

Speech emotion recognition (SER) is an important research topic in human-computer interaction. Existing works mainly rely on human expertise to design models. Despite their success, different datasets often require distinct structures and hyperparameters. Searching for an optimal model for each dataset is time-consuming and labor-intensive. To address this problem, we propose a two-stream neural architecture search (NAS) based framework, called \enquote{EmotionNAS}. Specifically, we take two-stream features (i.e., handcrafted and deep features) as the inputs, followed by NAS to search for the optimal structure for each stream. Furthermore, we incorporate complementary information in different streams through an efficient information supplement module. Experimental results demonstrate that our method outperforms existing manually-designed and NAS-based models, setting the new state-of-the-art record.

eess.AS↗

arXiv2023

Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detection

In this paper, we propose a long-sequence modeling framework, named StreamPETR, for multi-view 3D object detection. Built upon the sparse query design in the PETR series, we systematically develop an object-centric temporal mechanism. The model is performed in an online manner and the long-term historical information is propagated through object queries frame by frame. Besides, we introduce a motion-aware layer normalization to model the movement of the objects. StreamPETR achieves significant performance improvements only with negligible computation cost, compared to the single-frame baseline. On the standard nuScenes benchmark, it is the first online multi-view method that achieves comparable performance (67.6% NDS & 65.3% AMOTA) with lidar-based methods. The lightweight version realizes 45.0% mAP and 31.7 FPS, outperforming the state-of-the-art method (SOLOFusion) by 2.3% mAP and 1.8x faster FPS. Code has been available at https://github.com/exiawsh/StreamPETR.git.

cs.CV↗

arXiv2023

What's the Situation with Intelligent Mesh Generation: A Survey and Perspectives

Intelligent Mesh Generation (IMG) represents a novel and promising field of research, utilizing machine learning techniques to generate meshes. Despite its relative infancy, IMG has significantly broadened the adaptability and practicality of mesh generation techniques, delivering numerous breakthroughs and unveiling potential future pathways. However, a noticeable void exists in the contemporary literature concerning comprehensive surveys of IMG methods. This paper endeavors to fill this gap by providing a systematic and thorough survey of the current IMG landscape. With a focus on 113 preliminary IMG methods, we undertake a meticulous analysis from various angles, encompassing core algorithm techniques and their application scope, agent learning objectives, data types, targeted challenges, as well as advantages and limitations. We have curated and categorized the literature, proposing three unique taxonomies based on key techniques, output mesh unit elements, and relevant input data types. This paper also underscores several promising future research directions and challenges in IMG. To augment reader accessibility, a dedicated IMG project page is available at \url{https://github.com/xzb030/IMG_Survey}.

cs.AI↗

arXiv2023

A resource-efficient quantum-classical hybrid algorithm for energy gap evaluation

Estimating the eigenvalue or energy gap of a Hamiltonian H is vital for studying quantum many-body systems. Particularly, many of the problems in quantum chemistry, condensed matter physics, and nuclear physics investigate the energy gap between two eigenstates. Hence, how to efficiently solve the energy gap becomes an important motive for researching new quantum algorithms. In this work, we propose a hybrid non-variational quantum algorithm that uses the Monte Carlo method and real-time Hamiltonian simulation to evaluate the energy gap of a general quantum many-body system. Compared to conventional approaches, our algorithm does not require controlled real-time evolution, thus making its implementation much more experimental-friendly. Since our algorithm is non-variational, it is also free from the "barren plateaus" problem. To verify the efficiency of our algorithm, we conduct numerical simulations for the Heisenberg model and molecule systems on a classical emulator.

quant-ph↗

arXiv2023

Asynchronous Grant-Free Random Access: Receiver Design with Partially Uni-Directional Message Passing and Interference Suppression Analysis

Massive Machine-Type Communications (mMTC) features a massive number of low-cost user equipments (UEs) with sparse activity. Tailor-made for these features, grant-free random access (GF-RA) serves as an efficient access solution for mMTC. However, most existing GF-RA schemes rely on strict synchronization, which incurs excessive coordination burden for the low-cost UEs. In this work, we propose a receiver design for asynchronous GF-RA, and address the joint user activity detection (UAD) and channel estimation (CE) problem in the presence of asynchronization-induced inter-symbol interference. Specifically, the delay profile is exploited at the receiver to distinguish different UEs. However, a sample correlation problem in this receiver design impedes the factorization of the joint likelihood function, which complicates the UAD and CE problem. To address this correlation problem, we design a partially uni-directional (PUD) factor graph representation for the joint likelihood function. Building on this PUD factor graph, we further propose a PUD message passing based sparse Bayesian learning (SBL) algorithm for asynchronous UAD and CE (PUDMP-SBL-aUADCE). Our theoretical analysis shows that the PUDMP-SBL-aUADCE algorithm exhibits higher signal-to-interference-and-noise ratio (SINR) in the asynchronous case than in the synchronous case, i.e., the proposed receiver design can exploit asynchronization to suppress multi-user interference. In addition, considering potential timing error from the low-cost UEs, we investigate the impacts of imperfect delay profile, and reveal the advantages of adopting the SBL method in this case. Finally, extensive simulation results are provided to demonstrate the performance of the PUDMP-SBL-aUADCE algorithm.

cs.IT↗

arXiv2023

Generalized Linear Systems with OAMP/VAMP Receiver: Achievable Rate and Coding Principle

The generalized linear system (GLS) has been widely used in wireless communications to evaluate the effect of nonlinear preprocessing on receiver performance. Generalized approximation message passing (AMP) is a state-of-the-art algorithm for the signal recovery of GLS, but it was limited to measurement matrices with independent and identically distributed (IID) elements. To relax this restriction, generalized orthogonal/vector AMP (GOAMP/GVAMP) for unitarily-invariant measurement matrices was established, which has been proven to be replica Bayes optimal in uncoded GLS. However, the information-theoretic limit of GOAMP/GVAMP is still an open challenge for arbitrary input distributions due to its complex state evolution (SE). To address this issue, in this paper, we provide the achievable rate analysis of GOAMP/GVAMP in GLS, establishing its information-theoretic limit (i.e., maximum achievable rate). Specifically, we transform the fully-unfolded state evolution (SE) of GOAMP/GVAMP into an equivalent single-input single-output variational SE (VSE). Using the VSE and the mutual information and minimum mean-square error (I-MMSE) lemma, the achievable rate of GOAMP/GVAMP is derived. Moreover, the optimal coding principle for maximizing the achievable rate is proposed, based on which a kind of low-density parity-check (LDPC) code is designed. Numerical results verify the achievable rate advantages of GOAMP/GVAMP over the conventional maximum ratio combining (MRC) receiver based on the linearized model and the BER performance gains of the optimized LDPC codes (0.8~2.8 dB) compared to the existing methods.

cs.IT↗

arXiv2023

Observation of Multiple Topological Corner States in Thermal Diffusion

Higher-dimensional topological meta-materials have more flexible than one-dimensional topological materials, which are more convenient to apply and solve practical problems. However, in diffusion systems, higher-dimensional topological states have not been well studied. In this work, we experimentally realized the 2D topological structure based on a kagome lattice of thermal metamaterial. Due to the anti-Hermitian properties of the diffusion Hamiltonian, it has purely imaginary eigenvalues corresponding to the decay rate. By theoretical analysis and directly observing the decay rate of temperature through experiments, we present the various corner states in 2D topological diffusive system. Our work constitutes the first realization of multiple corner states with high decay rates in a pure diffusion system, which provides a new idea for the design of topological protected thermal metamaterial in the future.

cond-mat.mes-hall↗