arXiv subjects

Li Yang

Publications and source records attributed to Li Yang.

At least 181 records · Page 10Linked to original sources

arXiv2022

Conformational change-modulated spin transport at the single-molecule level in carbon systems --Invited for the Third Carbon Special Topic

Controlling the spin transport at the single-molecule level, especially without the use of ferromagnetic contacts, becomes a focus of research in spintronics. Inspired by the progress on atomic-level molecular synthesis, through first-principles calculations, we investigate the spin-dependent electronic transport of graphene nanoflakes with side-bonded functional groups, contacted by atomic carbon chain electrodes. It is found that, by rotating the functional group, the spin polarization of the transmission at the Fermi level could be switched between completely polarized and unpolarized states. Moreover, the transition between spin-up and spin-down polarized states can also be achieved, operating as a dual-spin filter. Further analysis shows that, it is the spin-dependent shift of density of states, caused by the rotation, that triggers the shift of transmission peaks, and then results in the variation of spin polarization. Such a feature is found to be robust to the of the nanoflake and the electrode material, showing great application potential. Those findings may throw light on the development of spintronic devices.

physics.atm-clus↗

arXiv2022

Fast Iterative Algorithms for Blind Phase Retrieval: A survey

In nanoscale imaging technique and ultrafast laser, the reconstruction procedure is normally formulated as a blind phase retrieval (BPR) problem, where one has to recover both the sample and the probe (pupil) jointly from phaseless data. This survey first presents the mathematical formula of BPR, related nonlinear optimization problems and then gives a brief review of the recent iterative algorithms. It mainly consists of three types of algorithms, including the operator-splitting based first-order optimization methods, second order algorithm with Hessian,and subspace methods. The future research directions for experimental issues and theoretical analysis are further discussed.

math.OC↗

arXiv2022

Room-Temperature Spin-Valve Effect in Fe$_3$GaTe$_2$/MoS$_2$/Fe$_3$GaTe$_2$ 2D van der Waals Heterojunction Devices

Spin-valve effect has been the focus of spintronics over the last decades due to its potential in many spintronic devices. Two-dimensional (2D) van der Waals (vdW) materials are highly expected to build the spin-valve heterojunction. However, the Curie temperatures (TC) of the vdW ferromagnetic 2D crystals are mostly below room temperature (~30-220 K). It is very challenging to develop room temperature, ferromagnetic (FM) 2D crystals based spin-valve devices which are still not available to date. We report the first room temperature, FM 2D crystal based all-2D vdW Fe3GaTe2/MoS2/Fe3GaTe2 spin valve devices. The Magnetoresistance (MR) of the all- devices is up to 15.89% at 2.3 K and 11.97% at 10 K, 4-30 times of MR from the spin valves of Fe$_3$GaTe$_2$/MoS$_2$/Fe$_3$GaTe$_2$ and conventional NiFe/MoS$_2$/NiFe. Typical spin valve effect shows strong dependence on MoS2 spacer thickness in the vdW heterojunction. Importantly, the spin valve effect (0.31%) still robustly exists at 300 K with low working currents down to 10 nA (0.13 A/cm$^2$). The results provide a general vdW platform to room temperature, 2D FM crystals based 2D spin valve devices.

cond-mat.mes-hall↗

arXiv2022

Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer

By learning a sequence of tasks continually, an agent in continual learning (CL) can improve the learning performance of both a new task and `old' tasks by leveraging the forward knowledge transfer and the backward knowledge transfer, respectively. However, most existing CL methods focus on addressing catastrophic forgetting in neural networks by minimizing the modification of the learnt model for old tasks. This inevitably limits the backward knowledge transfer from the new task to the old tasks, because judicious model updates could possibly improve the learning performance of the old tasks as well. To tackle this problem, we first theoretically analyze the conditions under which updating the learnt model of old tasks could be beneficial for CL and also lead to backward knowledge transfer, based on the gradient projection onto the input subspaces of old tasks. Building on the theoretical analysis, we next develop a ContinUal learning method with Backward knowlEdge tRansfer (CUBER), for a fixed capacity neural network without data replay. In particular, CUBER first characterizes the task correlation to identify the positively correlated old tasks in a layer-wise manner, and then selectively modifies the learnt model of the old tasks when learning the new task. Experimental studies show that CUBER can even achieve positive backward knowledge transfer on several existing CL benchmarks for the first time without data replay, where the related baselines still suffer from catastrophic forgetting (negative backward knowledge transfer). The superior performance of CUBER on the backward knowledge transfer also leads to higher accuracy accordingly.

cs.LG↗

arXiv2022

On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice

Machine learning algorithms have been used widely in various applications and areas. To fit a machine learning model into different problems, its hyper-parameters must be tuned. Selecting the best hyper-parameter configuration for machine learning models has a direct impact on the model's performance. It often requires deep knowledge of machine learning algorithms and appropriate hyper-parameter optimization techniques. Although several automatic optimization techniques exist, they have different strengths and drawbacks when applied to different types of problems. In this paper, optimizing the hyper-parameters of common machine learning models is studied. We introduce several state-of-the-art optimization techniques and discuss how to apply them to machine learning algorithms. Many available libraries and frameworks developed for hyper-parameter optimization problems are provided, and some open challenges of hyper-parameter optimization research are also discussed in this paper. Moreover, experiments are conducted on benchmark datasets to compare the performance of different optimization methods and provide practical examples of hyper-parameter optimization. This survey paper will help industrial users, data analysts, and researchers to better develop machine learning models by identifying the proper hyper-parameter configurations effectively.

cs.LG↗

arXiv2022

Tree-based Intelligent Intrusion Detection System in Internet of Vehicles

The use of autonomous vehicles (AVs) is a promising technology in Intelligent Transportation Systems (ITSs) to improve safety and driving efficiency. Vehicle-to-everything (V2X) technology enables communication among vehicles and other infrastructures. However, AVs and Internet of Vehicles (IoV) are vulnerable to different types of cyber-attacks such as denial of service, spoofing, and sniffing attacks. In this paper, an intelligent intrusion detection system (IDS) is proposed based on tree-structure machine learning models. The results from the implementation of the proposed intrusion detection system on standard data sets indicate that the system has the ability to identify various cyber-attacks in the AV networks. Furthermore, the proposed ensemble learning and feature selection approaches enable the proposed system to achieve high detection rate and low computational cost simultaneously.

cs.LG↗

arXiv2022

IoT Data Analytics in Dynamic Environments: From An Automated Machine Learning Perspective

With the wide spread of sensors and smart devices in recent years, the data generation speed of the Internet of Things (IoT) systems has increased dramatically. In IoT systems, massive volumes of data must be processed, transformed, and analyzed on a frequent basis to enable various IoT services and functionalities. Machine Learning (ML) approaches have shown their capacity for IoT data analytics. However, applying ML models to IoT data analytics tasks still faces many difficulties and challenges, specifically, effective model selection, design/tuning, and updating, which have brought massive demand for experienced data scientists. Additionally, the dynamic nature of IoT data may introduce concept drift issues, causing model performance degradation. To reduce human efforts, Automated Machine Learning (AutoML) has become a popular field that aims to automatically select, construct, tune, and update machine learning models to achieve the best performance on specified tasks. In this paper, we conduct a review of existing methods in the model selection, tuning, and updating procedures in the area of AutoML in order to identify and summarize the optimal solutions for every step of applying ML algorithms to IoT data analytics. To justify our findings and help industrial users and researchers better implement AutoML approaches, a case study of applying AutoML to IoT anomaly detection problems is conducted in this work. Lastly, we discuss and classify the challenges and research directions for this domain.

cs.LG↗

arXiv2022

Event-based EV Charging Scheduling in A Microgrid of Buildings

With the popularization of the electric vehicles (EVs), EV charging demand is becoming an important load in the building. Considering the mobility of EVs from building to building and their uncertain charging demand, it is of great practical interest to control the EV charging process in a microgrid of buildings to optimize the total operation cost while ensuring the transmission safety between the microgrid and the main grid. We consider this important problem in this paper and make the following contributions. First, we formulate this problem as a Markov decision process to capture the uncertain supply and EV charging demand in the microgrid of buildings. Besides reducing the total operation cost of buildings, the model also considers the power exchange limitation to ensure transmission safety. Second, this model is reformulated under event-based optimization framework to alleviate the impact of large state and action space. By appropriately defining the event and event-based action, the EV charging process can be optimized by searching a randomized parametric event-based control policy in the microgrid controller and implementing a selecting-to-charging rule in each building controller. Third, a constrained gradient-based policy optimzation method with adjusting mechanism is proposed to iteratively find the optimal event-based control policy for EV charging demand in each building. Numerical experiments considering a microgrid of three buildings are conducted to analyze the structure and the performance of the event-based control policy for EV charging.

eess.SY↗

arXiv2022

LCCDE: A Decision-Based Ensemble Framework for Intrusion Detection in The Internet of Vehicles

Modern vehicles, including autonomous vehicles and connected vehicles, have adopted an increasing variety of functionalities through connections and communications with other vehicles, smart devices, and infrastructures. However, the growing connectivity of the Internet of Vehicles (IoV) also increases the vulnerabilities to network attacks. To protect IoV systems against cyber threats, Intrusion Detection Systems (IDSs) that can identify malicious cyber-attacks have been developed using Machine Learning (ML) approaches. To accurately detect various types of attacks in IoV networks, we propose a novel ensemble IDS framework named Leader Class and Confidence Decision Ensemble (LCCDE). It is constructed by determining the best-performing ML model among three advanced ML algorithms (XGBoost, LightGBM, and CatBoost) for every class or type of attack. The class leader models with their prediction confidence values are then utilized to make accurate decisions regarding the detection of various types of cyber-attacks. Experiments on two public IoV security datasets (Car-Hacking and CICIDS2017 datasets) demonstrate the effectiveness of the proposed LCCDE for intrusion detection on both intra-vehicle and external networks.

cs.CR↗

arXiv2022

AUGER: Automatically Generating Review Comments with Pre-training Models

Code review is one of the best practices as a powerful safeguard for software quality. In practice, senior or highly skilled reviewers inspect source code and provide constructive comments, considering what authors may ignore, for example, some special cases. The collaborative validation between contributors results in code being highly qualified and less chance of bugs. However, since personal knowledge is limited and varies, the efficiency and effectiveness of code review practice are worthy of further improvement. In fact, it still takes a colossal and time-consuming effort to deliver useful review comments. This paper explores a synergy of multiple practical review comments to enhance code review and proposes AUGER (AUtomatically GEnerating Review comments): a review comments generator with pre-training models. We first collect empirical review data from 11 notable Java projects and construct a dataset of 10,882 code changes. By leveraging Text-to-Text Transfer Transformer (T5) models, the framework synthesizes valuable knowledge in the training stage and effectively outperforms baselines by 37.38% in ROUGE-L. 29% of our automatic review comments are considered useful according to prior studies. The inference generates just in 20 seconds and is also open to training further. Moreover, the performance also gets improved when thoroughly analyzed in case study.

cs.SE↗

arXiv2022

Generalized Bose-Fermi mapping and strong coupling ansatz wavefunction for one dimensional strongly interacting spinor quantum gases

Quantum many-body systems in one dimension (1D) exhibit some peculiar properties. In this article, we review some of our work on strongly interacting 1D spinor quantum gas. First, we discuss a generalized Bose-Fermi mapping that maps the charge degrees of freedom to a spinless Fermi gas and the spin degrees of freedom to a spin chain model. This also maps the strongly interacting system into a weakly interacting one, which is amenable for perturbative calculations. Next, based on this mapping, we construct an ansatz wavefunction for the strongly interacting system, using which many physical quantities can be conveniently calculated. We showcase the usage of this ansatz wavefunction by considering the collective excitations and quench dynamics of a harmonically trapped system.

cond-mat.quant-gas↗

arXiv2022

Metal Lines Associated with the Lyman-alpha Forest from eBOSS Data

We investigate the metal species associated with the Ly$α$ forest in the eBOSS quasar spectra. Metal absorption lines are revealed in the stacked spectra from cross-correlating the selected Ly$α$ absorbers in the forest and the flux fluctuation field. Up to 13 metal species are identified associated with relatively strong Ly$α$ absorbers (those with flux fluctuation $-1.0<δ_{\rm Lyα}<-0.6$ and with neutral hydrogen column density of ~ $10^{15-16}$ $\rm cm^{-2}$) over absorber redshift range of $2<z_{\rm abs}<4$. The column densities of these species decrease toward higher redshift and for weaker Ly$α$ absorbers. From modelling the column densities of various species, we find that the column density pattern suggests contributions from multiple gas components both in the circumgalactic medium (CGM) and in the intergalactic medium (IGM). While the low-ionization species (e.g., C II, Si II, and Mg II) can be explained by high-density, cool gas ($T \sim 10^4$ K) from the CGM, the high-ionization species may reside in low-density or high-temperature gas in the IGM. The measurements provide inputs to model metal contamination in the Ly$α$ forest baryon acoustic oscillations measurement. Comparison with metal absorptions in high-resolution quasar spectra and with hydrodynamic galaxy formation simulations can further elucidate the physical conditions of these Ly$α$ absorbers.

astro-ph.CO↗

arXiv2022

Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning

Visual grounding is a task to locate the target indicated by a natural language expression. Existing methods extend the generic object detection framework to this problem. They base the visual grounding on the features from pre-generated proposals or anchors, and fuse these features with the text embeddings to locate the target mentioned by the text. However, modeling the visual features from these predefined locations may fail to fully exploit the visual context and attribute information in the text query, which limits their performance. In this paper, we propose a transformer-based framework for accurate visual grounding by establishing text-conditioned discriminative features and performing multi-stage cross-modal reasoning. Specifically, we develop a visual-linguistic verification module to focus the visual features on regions relevant to the textual descriptions while suppressing the unrelated areas. A language-guided feature encoder is also devised to aggregate the visual contexts of the target object to improve the object's distinctiveness. To retrieve the target from the encoded visual features, we further propose a multi-stage cross-modal decoder to iteratively speculate on the correlations between the image and text for accurate target localization. Extensive experiments on five widely used datasets validate the efficacy of our proposed components and demonstrate state-of-the-art performance. Our code is public at https://github.com/yangli18/VLTVG.

cs.CV↗

arXiv2022

Brain Cortical Functional Gradients Predict Cortical Folding Patterns via Attention Mesh Convolution

Since gyri and sulci, two basic anatomical building blocks of cortical folding patterns, were suggested to bear different functional roles, a precise mapping from brain function to gyro-sulcal patterns can provide profound insights into both biological and artificial neural networks. However, there lacks a generic theory and effective computational model so far, due to the highly nonlinear relation between them, huge inter-individual variabilities and a sophisticated description of brain function regions/networks distribution as mosaics, such that spatial patterning of them has not been considered. we adopted brain functional gradients derived from resting-state fMRI to embed the "gradual" change of functional connectivity patterns, and developed a novel attention mesh convolution model to predict cortical gyro-sulcal segmentation maps on individual brains. The convolution on mesh considers the spatial organization of functional gradients and folding patterns on a cortical sheet and the newly designed channel attention block enhances the interpretability of the contribution of different functional gradients to cortical folding prediction. Experiments show that the prediction performance via our model outperforms other state-of-the-art models. In addition, we found that the dominant functional gradients contribute less to folding prediction. On the activation maps of the last layer, some well-studied cortical landmarks are found on the borders of, rather than within, the highly activated regions. These results and findings suggest that a specifically designed artificial neural network can improve the precision of the mapping between brain functions and cortical folding patterns, and can provide valuable insight of brain anatomy-function relation for neuroscience.

q-bio.NC↗

arXiv2022

Manipulating Interlayer Excitons for Ultra-pure Near-infrared Quantum Light Generation

Interlayer excitons (IXs) formed at the interface of atomically-thin semiconductors possess various novel properties. In a parallel development, nanoscale strain engineering has emerged as an effective means for creating 2D quantum light sources. Exploring the intersection of these two exciting areas, where strain and defects are exploited for the manipulation of IX toward the emergence of new functionalities, is currently at a nascent stage. Here, using MoS2/WSe2 heterostructure as a model system, we demonstrate how strain, defects, and layering can be utilized to create defect-bound IXs capable of bright, robust, and tunable quantum light emission in the technologically important near-infrared spectral range. We were able to achieve ultra-high single-photon purity with g(2)(0) = 0.01. Our strategy of creating site-controlled QEs from the defect-bound IXs represents a paradigm shift in 2D quantum photonics research, from engineering intralayer exciton in monolayer structures towards IXs at the interface of 2D heterostructures.

cond-mat.mes-hall↗

arXiv2022

Cointegration of SARS-CoV-2 Transmission with Weather Conditions and Mobility during the First Year of the COVID-19 Pandemic in the United States

Correlation between weather and the transmission of SARS-CoV-2 may suggest its seasonality. Cointegration analysis can avoid spurious correlation among time series data. We examined the cointegration of virus transmission with daily temperature, dewpoint, and confounding factors of mobility measurements during the first year of the pandemic in the United States. We examined the cointegration of the effective reproductive rate, Rt, of the virus with the dewpoint at two meters, the temperature at two meters, Apple driving mobility, and Google workplace mobility measurements. We found that dewpoint and Apple driving mobility are the best factors to cointegrate with Rt, although temperature and Google workplace mobility also cointegrate with Rt at substantial levels. We found that the optimal lag is two days for cointegration between Rt and weather variables, and three days for Rt and mobility. We observed clusters of states that share similar cointegration results of Rt, weather, and mobility, suggesting regional patterns. Our results support the correlation of weather with the spread of SARS-CoV-2 and its potential seasonality.

q-bio.PE↗

arXiv2022

LIGS: Learnable Intrinsic-Reward Generation Selection for Multi-Agent Learning

Efficient exploration is important for reinforcement learners to achieve high rewards. In multi-agent systems, coordinated exploration and behaviour is critical for agents to jointly achieve optimal outcomes. In this paper, we introduce a new general framework for improving coordination and performance of multi-agent reinforcement learners (MARL). Our framework, named Learnable Intrinsic-Reward Generation Selection algorithm (LIGS) introduces an adaptive learner, Generator that observes the agents and learns to construct intrinsic rewards online that coordinate the agents' joint exploration and joint behaviour. Using a novel combination of MARL and switching controls, LIGS determines the best states to learn to add intrinsic rewards which leads to a highly efficient learning process. LIGS can subdivide complex tasks making them easier to solve and enables systems of MARL agents to quickly solve environments with sparse rewards. LIGS can seamlessly adopt existing MARL algorithms and, our theory shows that it ensures convergence to policies that deliver higher system performance. We demonstrate its superior performance in challenging tasks in Foraging and StarCraft II.

cs.MA↗

arXiv2022

Shifting Trends of COVID-19 Tweet Sentiment with Respect to Voting Preferences in the 2020 Election Year of the United States

COVID-19 related policies were extensively politicized during the 2020 election year of the United States, resulting in polarizing viewpoints. Twitter users were particularly engaged during the 2020 election year. Here we investigated whether COVID-19 related tweets were associated with the overall election results at the state level during the period leading up to the election day. We observed weak correlations between the average sentiment of COVID-19 related tweets and popular votes in two-week intervals, and the trends gradually become opposite. We then compared the average sentiments of COVID-19 related tweets between states called in favor of Republican (red states) or Democratic parties (blue states). We found that at the beginning of lockdowns sentiments in the blue states were much more positive than those in the red states. However, sentiments in the red states gradually become more positive during the summer of 2020 and persisted until the election day.

cs.CL↗