arXiv Science⌕ Search

arXiv subjects

Yan Li

Publications and source records attributed to Yan Li.

At least 361 records · Page 20Linked to original sources
arXiv2023

Robust Multi-Agent Reinforcement Learning via Adversarial Regularization: Theoretical Foundation and Stable Algorithms

Multi-Agent Reinforcement Learning (MARL) has shown promising results across several domains. Despite this promise, MARL policies often lack robustness and are therefore sensitive to small changes in their environment. This presents a serious concern for the real world deployment of MARL algorithms, where the testing environment may slightly differ from the training environment. In this work we show that we can gain robustness by controlling a policy's Lipschitz constant, and under mild conditions, establish the existence of a Lipschitz and close-to-optimal policy. Based on these insights, we propose a new robust MARL framework, ERNIE, that promotes the Lipschitz continuity of the policies with respect to the state observations and actions by adversarial regularization. The ERNIE framework provides robustness against noisy observations, changing transition dynamics, and malicious actions of agents. However, ERNIE's adversarial regularization may introduce some training instability. To reduce this instability, we reformulate adversarial regularization as a Stackelberg game. We demonstrate the effectiveness of the proposed framework with extensive experiments in traffic light control and particle environments. In addition, we extend ERNIE to mean-field MARL with a formulation based on distributionally robust optimization that outperforms its non-robust counterpart and is of independent interest. Our code is available at https://github.com/abukharin3/ERNIE.

cs.LG↗
arXiv2023

Atomically-precise engineering of spin-orbit polarons in a kagome magnetic Weyl semimetal

Atomically-precise engineering of defects in topological quantum materials, which is essential for constructing new artificial quantum materials with exotic properties and appealing for practical quantum applications, remains challenging due to the hindrances in modifying complex lattice with atomic precision. Here, we report the atomically-precise engineering of the vacancy-localized spin-orbital polarons (SOP) in a kagome magnetic Weyl semimetal Co3Sn2S2, using scanning tunneling microscope. We achieve the step-by-step repairing of the selected vacancies, which results in the formation of artificial sulfur vacancy with elaborate geometry. We find that that the bound states localized around the vacancies experience a symmetry-dependent energy shift towards Fermi level with increasing vacancy size. Strikingly, as vacancy size increases, the localized magnetic moments of SOPs are tunable and ultimately extended to the negative magnetic moments resulting from spin-orbit coupling in the kagome flat band. These findings establish a new platform for engineering atomic quantum states in topological quantum materials, offering potential for kagome-lattice-based spintronics and quantum technologies.

cond-mat.mes-hall↗
arXiv2023

CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstruction

Cardiac magnetic resonance imaging (CMR) has emerged as a valuable diagnostic tool for cardiac diseases. However, a limitation of CMR is its slow imaging speed, which causes patient discomfort and introduces artifacts in the images. There has been growing interest in deep learning-based CMR imaging algorithms that can reconstruct high-quality images from highly under-sampled k-space data. However, the development of deep learning methods requires large training datasets, which have not been publicly available for CMR. To address this gap, we released a dataset that includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects. Imaging studies include cardiac cine and mapping sequences. Manual segmentations of the myocardium and chambers of all the subjects are also provided within the dataset. Scripts of state-of-the-art reconstruction algorithms were also provided as a point of reference. Our aim is to facilitate the advancement of state-of-the-art CMR image reconstruction by introducing standardized evaluation criteria and making the dataset freely accessible to the research community. Researchers can access the dataset at https://www.synapse.org/#!Synapse:syn51471091/wiki/.

cs.CV↗
arXiv2023

DSRRTracker: Dynamic Search Region Refinement for Attention-based Siamese Multi-Object Tracking

Many multi-object tracking (MOT) methods follow the framework of "tracking by detection", which associates the target objects-of-interest based on the detection results. However, due to the separate models for detection and association, the tracking results are not optimal.Moreover, the speed is limited by some cumbersome association methods to achieve high tracking performance. In this work, we propose an end-to-end MOT method, with a Gaussian filter-inspired dynamic search region refinement module to dynamically filter and refine the search region by considering both the template information from the past frames and the detection results from the current frame with little computational burden, and a lightweight attention-based tracking head to achieve the effective fine-grained instance association. Extensive experiments and ablation study on MOT17 and MOT20 datasets demonstrate that our method can achieve the state-of-the-art performance with reasonable speed.

cs.CV↗
arXiv2023

Implicit Regularization of Bregman Proximal Point Algorithm and Mirror Descent on Separable Data

Bregman proximal point algorithm (BPPA) has witnessed emerging machine learning applications, yet its theoretical understanding has been largely unexplored. We study the computational properties of BPPA through learning linear classifiers with separable data, and demonstrate provable algorithmic regularization of BPPA. For any BPPA instantiated with a fixed Bregman divergence, we provide a lower bound of the margin obtained by BPPA with respect to an arbitrarily chosen norm. The obtained margin lower bound differs from the maximal margin by a multiplicative factor, which inversely depends on the condition number of the distance-generating function measured in the dual norm. We show that the dependence on the condition number is tight, thus demonstrating the importance of divergence in affecting the quality of the learned classifiers. We then extend our findings to mirror descent, for which we establish similar connections between the margin and Bregman divergence, together with a non-asymptotic analysis. Numerical experiments on both synthetic and real-world datasets are provided to support our theoretical findings. To the best of our knowledge, the aforementioned findings appear to be new in the literature of algorithmic regularization.

cs.LG↗
arXiv2023

Cross-view Semantic Alignment for Livestreaming Product Recognition

Live commerce is the act of selling products online through live streaming. The customer's diverse demands for online products introduce more challenges to Livestreaming Product Recognition. Previous works have primarily focused on fashion clothing data or utilize single-modal input, which does not reflect the real-world scenario where multimodal data from various categories are present. In this paper, we present LPR4M, a large-scale multimodal dataset that covers 34 categories, comprises 3 modalities (image, video, and text), and is 50x larger than the largest publicly available dataset. LPR4M contains diverse videos and noise modality pairs while exhibiting a long-tailed distribution, resembling real-world problems. Moreover, a cRoss-vIew semantiC alignmEnt (RICE) model is proposed to learn discriminative instance features from the image and video views of the products. This is achieved through instance-level contrastive learning and cross-view patch-level feature propagation. A novel Patch Feature Reconstruction loss is proposed to penalize the semantic misalignment between cross-view patches. Extensive experiments demonstrate the effectiveness of RICE and provide insights into the importance of dataset diversity and expressivity. The dataset and code are available at https://github.com/adxcreative/RICE

cs.CV↗
arXiv2023

Three-dimensional simulation of thermodynamics on confined turbulence in a large-scale CME-flare current sheet

Turbulence plays a key role for forming the complex geometry of the large-scale current sheet (CS) and fast energy release in a solar eruption. In this paper, we present full 3D high-resolution simulations for the process of a moderate Coronal Mass Ejection (CME) and the thermodynamical evolution of the highly confined CS. Copious elongated blobs are generated due to tearing and plasmoid instabilities giving rise to a higher reconnection rate and undergo the splitting, merging and kinking processes in a more complex way in 3D. A detailed thermodynamical analysis shows that the CS is mainly heated by adiabatic and numerical viscous terms, and thermal conduction is the dominant factor that balances the energy inside the CS. Accordingly, the temperature of the CS reaches to a maximum of about 20 MK and the range of temperatures is relatively narrow. From the face-on view in the synthetic Atmospheric Imaging Assembly 131 $\mathring{A}$, the downflowing structures with similar morphology to supra-arcade downflows are mainly located between the post-flare loops and loop-top, while moving blobs can extend spikes higher above the loop-top. The downward-moving plasmoids can keep the twisted magnetic field configuration until the annihilation at the flare loop-top, indicating that plasmoid reconnection dominates in the lower CS. Meanwhile, the upward-moving ones turn into turbulent structures before arriving at the bottom of the CME, implying that turbulent reconnection dominates in the upper CS. The spatial distributions of the turbulent energy and anisotropy are addressed, which show a significant variation in the spectra with height.

astro-ph.SR↗
arXiv2023

Chaos to Order: A Label Propagation Perspective on Source-Free Domain Adaptation

Source-free domain adaptation (SFDA), where only a pre-trained source model is used to adapt to the target distribution, is a more general approach to achieving domain adaptation in the real world. However, it can be challenging to capture the inherent structure of the target features accurately due to the lack of supervised information on the target domain. By analyzing the clustering performance of the target features, we show that they still contain core features related to discriminative attributes but lack the collation of semantic information. Inspired by this insight, we present Chaos to Order (CtO), a novel approach for SFDA that strives to constrain semantic credibility and propagate label information among target subpopulations. CtO divides the target data into inner and outlier samples based on the adaptive threshold of the learning state, customizing the learning strategy to fit the data properties best. Specifically, inner samples are utilized for learning intra-class structure thanks to their relatively well-clustered properties. The low-density outlier samples are regularized by input consistency to achieve high accuracy with respect to the ground truth labels. In CtO, by employing different learning strategies to propagate the labels from the inner local to outlier instances, it clusters the global samples from chaos to order. We further adaptively regulate the neighborhood affinity of the inner samples to constrain the local semantic credibility. In theoretical and empirical analyses, we demonstrate that our algorithm not only propagates from inner to outlier but also prevents local clustering from forming spurious clusters. Empirical evidence demonstrates that CtO outperforms the state of the arts on three public benchmarks: Office-31, Office-Home, and VisDA.

cs.CV↗
arXiv2023

Quasi-periodic oscillation in short gamma-ray bursts from black hole-neutron star mergers

Short-duration gamma-ray bursts (sGRBs) are commonly attributed to the mergers of double neutron stars (NSs) or the mergers of a neutron star with a black hole (BH). While the former scenario was confirmed by the event GW170817, the latter remains elusive. Here, we consider the latter scenario in which, a NS is tidally disrupted by a fast spinning low-mass BH and the accretion onto the BH launches a relativistic jet and hence produces a sGRB. The merging binary's orbit is likely misaligned with the BH's spin. Hence, the Lense-Thirring precession around the BH may cause a hyper-accreting thick disk to precess in a solid-body manner. We propose that a jet, initially aligned with the BH spin, is deflected and collimated by the wind from the disk, therefore being forced to precess along with the disk. This would result in a quasi-periodic oscillation or modulation in the gamma-ray light curve of the sGRB, with a quasi-period of $\sim 0.01-0.1$ s. The appearance of the modulation may be delayed respective to the triggering of the light curve. This feature, unique to the BH-NS merger, may have already revealed itself in a few observed sGRBs (such as GRB 130310A), and it carries the spin-obit orientation information of the merging system. Identification of this feature would be a new approach to reveal spin-orbit-misaligned merging BH-NS systems, which are likely missed by the current gravitational-wave searching strategy principally targeting aligned systems.

astro-ph.HE↗
arXiv2023

Cross-Domain Product Representation Learning for Rich-Content E-Commerce

The proliferation of short video and live-streaming platforms has revolutionized how consumers engage in online shopping. Instead of browsing product pages, consumers are now turning to rich-content e-commerce, where they can purchase products through dynamic and interactive media like short videos and live streams. This emerging form of online shopping has introduced technical challenges, as products may be presented differently across various media domains. Therefore, a unified product representation is essential for achieving cross-domain product recognition to ensure an optimal user search experience and effective product recommendations. Despite the urgent industrial need for a unified cross-domain product representation, previous studies have predominantly focused only on product pages without taking into account short videos and live streams. To fill the gap in the rich-content e-commerce area, in this paper, we introduce a large-scale cRoss-dOmain Product Ecognition dataset, called ROPE. ROPE covers a wide range of product categories and contains over 180,000 products, corresponding to millions of short videos and live streams. It is the first dataset to cover product pages, short videos, and live streams simultaneously, providing the basis for establishing a unified product representation across different media domains. Furthermore, we propose a Cross-dOmain Product rEpresentation framework, namely COPE, which unifies product representations in different domains through multimodal learning including text and vision. Extensive experiments on downstream tasks demonstrate the effectiveness of COPE in learning a joint feature space for all product domains.

cs.CV↗
arXiv2023

RIP-based Performance Guarantee for Low Rank Matrix Recovery via $L_{*-F}$ Minimization

In the undetermined linear system $\bm{b}=\mathcal{A}(\bm{X})+\bm{s}$, vector $\bm{b}$ and operator $\mathcal{A}$ are the known measurements and $\bm{s}$ is the unknown noise. In this paper, we investigate sufficient conditions for exactly reconstructing desired matrix $\bm{X}$ being low-rank or approximately low-rank. We use the difference of nuclear norm and Frobenius norm ($L_{*-F}$) as a surrogate for rank function and establish a new nonconvex relaxation of such low rank matrix recovery, called the $L_{*-F}$ minimization, in order to approximate the rank function closer. For such nonconvex and nonsmooth constrained $L_{*-F}$ minimization problems, based on whether the noise level is $0$, we give the upper bound estimation of the recovery error respectively. Particularly, in the noise-free case, one sufficient condition for exact recovery is presented. If linear operator $\mathcal{A}$ satisfies the restricted isometry property with $δ_{4r}<\frac{\sqrt{2r}-1}{\sqrt{2r}-1+\sqrt{2}(\sqrt{2r}+1)}$, then $r$-\textbf{rank} matrix $\bm{X}$ can be exactly recovered without other assumptions. In addition, we also take insights into the regularized $L_{*-F}$ minimization model since such regularized model is more widely used in algorithm design. We provide the recovery error estimation of this regularized $L_{*-F}$ minimization model via RIP tool. To our knowledge, this is the first result on exact reconstruction of low rank matrix via regularized $L_{*-F}$ minimization.

math.OC↗
arXiv2023

First-order Policy Optimization for Robust Policy Evaluation

We adopt a policy optimization viewpoint towards policy evaluation for robust Markov decision process with $\mathrm{s}$-rectangular ambiguity sets. The developed method, named first-order policy evaluation (FRPE), provides the first unified framework for robust policy evaluation in both deterministic (offline) and stochastic (online) settings, with either tabular representation or generic function approximation. In particular, we establish linear convergence in the deterministic setting, and $\tilde{\mathcal{O}}(1/ε^2)$ sample complexity in the stochastic setting. FRPE also extends naturally to evaluating the robust state-action value function with $(\mathrm{s}, \mathrm{a})$-rectangular ambiguity sets. We discuss the application of the developed results for stochastic policy optimization of large-scale robust MDPs.

math.OC↗
arXiv2023

Nonprobability follow-up sample analysis: an application to SARS-CoV-2 infection prevalence estimation

Public health policy makers are faced with making crucial decisions rapidly during infectious disease outbreaks such as that caused by SARS-CoV-2. Ideally, rapidly deployed representative health surveys could provide needed data for such decisions. Under the constraints of a limited timeframe and resources, it may be infeasible to implement random based (probability) sampling that yields a population representative survey sample with high response rates. As an alternative, a volunteer (nonprobability) sample is often collected using outreach methods such as social media and web surveys. Compared to a probability sample, a nonprobability sample is subject to selection bias. In addition, when participants are followed longitudinally nonresponse often occurs at later follow up timepoints. As a result, estimates of cross-sectional parameters at later timepoints will be subject to selection bias and nonresponse bias. In this paper, we create kernel-weighted pseudoweights (KW) for the baseline survey participants and construct nonresponse-adjusted kw (kwNR) for respondents at each follow-visit to estimate the population mean at the follow-up visits. We develop Taylor Linearization variance estimation that accounts for variability due to estimating both pseudoweights and the nonresponse adjustments. Simulations are conducted to evaluate the proposed kwNR-weighted estimates. We investigate covariate effects on each of the following: baseline sample participation propensity, follow-up response propensity and the mean of the outcome. We apply the proposed kwNR-weighted methods to the SARS-Cov-2 antibody seropositivity longitudinal study, which begins with a baseline survey early in the pandemic, and collects data at six- and twelve-month post baseline follow-ups.

stat.AP↗
arXiv2023

First-order Policy Optimization for Robust Markov Decision Process

We consider the problem of solving robust Markov decision process (MDP), which involves a set of discounted, finite state, finite action space MDPs with uncertain transition kernels. The goal of planning is to find a robust policy that optimizes the worst-case values against the transition uncertainties, and thus encompasses the standard MDP planning as a special case. For $(\mathbf{s},\mathbf{a})$-rectangular uncertainty sets, we establish several structural observations on the robust objective, which facilitates the development of a policy-based first-order method, namely the robust policy mirror descent (RPMD). An $\mathcal{O}(\log(1/ε))$ iteration complexity for finding an $ε$-optimal policy is established with linearly increasing stepsizes. We further develop a stochastic variant of the robust policy mirror descent method, named SRPMD, when the first-order information is only available through online interactions with the nominal environment. We show that the optimality gap converges linearly up to the noise level, and consequently establish an $\tilde{\mathcal{O}}(1/ε^2)$ sample complexity by developing a temporal difference learning method for policy evaluation. Both iteration and sample complexities are also discussed for RPMD with a constant stepsize. To the best of our knowledge, all the aforementioned results appear to be new for policy-based first-order methods applied to the robust MDP problem.

cs.LG↗
arXiv2023

TALENT: Targeted Mining of Non-overlapping Sequential Patterns

With the widespread application of efficient pattern mining algorithms, sequential patterns that allow gap constraints have become a valuable tool to discover knowledge from biological data such as DNA and protein sequences. Among all kinds of gap-constrained mining, non-overlapping sequence mining can mine interesting patterns and satisfy the anti-monotonic property (the Apriori property). However, existing algorithms do not search for targeted sequential patterns, resulting in unnecessary and redundant pattern generation. Targeted pattern mining can not only mine patterns that are more interesting to users but also reduce the unnecessary redundant sequence generated, which can greatly avoid irrelevant computation. In this paper, we define and formalize the problem of targeted non-overlapping sequential pattern mining and propose an algorithm named TALENT (TArgeted mining of sequentiaL pattErN with consTraints). Two search methods including breadth-first and depth-first searching are designed to troubleshoot the generation of patterns. Furthermore, several pruning strategies to reduce the reading of sequences and items in the data and terminate redundant pattern extensions are presented. Finally, we select a series of datasets with different characteristics and conduct extensive experiments to compare the TALENT algorithm with the existing algorithms for mining non-overlapping sequential patterns. The experimental results demonstrate that the proposed targeted mining algorithm, TALENT, has excellent mining efficiency and can deal efficiently with many different query settings.

cs.DB↗
arXiv2023

Spin photonics on chip based on a twinning crystal metamaterial

Two-dimensional photonic circuits with high capacity are essential for a wide range of applications in next-generation photonic information technology and optoelectronics. Here we demonstrate a multi-channel spin-dependent photonic device based on a twinning crystal metamaterial. The structural symmetry and material symmetry of the twinning crystal metamaterial enable a total of 4 channels carrying different transverse spins because of the spin-momentum locking. The orientation of the anisotropy controls the propagation direction of each signal, and the rotation of the E-field with respect to energy flow determines the spin characteristics during input/output coupling. Leveraging this mechanism, the spin of an incident beam can be maintained during propagation on-chip and then delivered back into the free space, offering a new scheme for metamaterial-based spin-controlled nano-photonic applications.

physics.optics↗
arXiv2023

Mid-Infrared Upconversion Imaging Under Different Illumination Conditions

Converting the medium infrared field to the visible band is an effective image detection method. We propose a comprehensive theory of image up-conversion under continuous optical pumping, and discuss the relationship between the experimental parameters and imaging field of view, resolution, quantum efficiency, and conversion bandwidth. Theoretical predictions of upconversion imaging results are given based on numerical simulations, which show good agreement with experimental results. In particular, coherent and incoherent light illumination are studied separately and the advantages and disadvantages of their imaging performance are compared and analysed. This work provides a study of the upconversion image detection performance of the system, which is of great value in guiding the design of the detection system and bringing it to practical applications.

physics.optics↗
arXiv2023

Discovery and construction of surface kagome electronic states induced by p-d electronic hybridization

Kagome-lattice materials possess attractive properties for quantum computing applications, but their synthesis remains challenging. Herein, we show surface kagome electronic states (SKESs) on a Sn-terminated triangular Co3Sn2S2 surface, which are imprinted by vertical p-d electronic hybridization between the surface Sn (subsurface S) atoms and the buried Co kagome lattice network in the Co3Sn layer under the surface. Owing to the subsequent lateral hybridization of the Sn and S atoms in a corner-sharing manner, the kagome symmetry and topological electronic properties of the Co3Sn layer is proximate to the Sn surface. The SKESs and both hybridizations were verified via qPlus non-contact atomic force microscopy (nc-AFM) and density functional theory calculations. The construction of SKESs with tunable properties can be achieved by the atomic substitution of surface Sn (subsurface S) with other group III-V elements (Se or Te), which was demonstrated theoretically. This work exhibits the powerful capacity of nc-AFM in characterizing localized topological states and reveals the strategy for synthesis of large-area transition-metal-based kagome lattice materials using conventional surface deposition techniques.

cond-mat.mtrl-sci↗