arXiv Science⌕ Search

arXiv subjects

Lei Guo

Publications and source records attributed to Lei Guo.

At least 73 records · Page 4Linked to original sources
arXiv2023

Wireless Powered Metaverse: Joint Task Scheduling and Trajectory Design for Multi-Devices and Multi-UAVs

To support the running of human-centric metaverse applications on mobile devices, Unmanned Aerial Vehicle (UAV)-assisted Wireless Powered Mobile Edge Computing (WPMEC) is promising to compensate for limited computational capabilities and energy supplies of mobile devices. The high-speed computational processing demands and significant energy consumption of metaverse applications require joint resource scheduling of multiple devices and UAVs, but existing WPMEC solutions address either device or UAV scheduling due to the complexity of combinatorial optimization. To solve the above challenge, we propose a two-stage alternating optimization algorithm based on multi-task Deep Reinforcement Learning (DRL) to jointly allocate charging time, schedule computation tasks, and optimize trajectory of UAVs and mobile devices in a wireless powered metaverse scenario. First, considering energy constraints of both UAVs and mobile devices, we formulate an optimization problem to maximize the computation efficiency of the system. Second, we propose a heuristic algorithm to efficiently perform time allocation and charging scheduling for mobile devices. Following this, we design a multi-task DRL scheme to make charging scheduling and trajectory design decisions for UAVs. Finally, theoretical analysis and performance results demonstrate that our algorithm exhibits significant advantages over representative methods in terms of convergence speed and average computation efficiency.

cs.DC↗
arXiv2023

Motif-Based Prompt Learning for Universal Cross-Domain Recommendation

Cross-Domain Recommendation (CDR) stands as a pivotal technology addressing issues of data sparsity and cold start by transferring general knowledge from the source to the target domain. However, existing CDR models suffer limitations in adaptability across various scenarios due to their inherent complexity. To tackle this challenge, recent advancements introduce universal CDR models that leverage shared embeddings to capture general knowledge across domains and transfer it through "Multi-task Learning" or "Pre-train, Fine-tune" paradigms. However, these models often overlook the broader structural topology that spans domains and fail to align training objectives, potentially leading to negative transfer. To address these issues, we propose a motif-based prompt learning framework, MOP, which introduces motif-based shared embeddings to encapsulate generalized domain knowledge, catering to both intra-domain and inter-domain CDR tasks. Specifically, we devise three typical motifs: butterfly, triangle, and random walk, and encode them through a Motif-based Encoder to obtain motif-based shared embeddings. Moreover, we train MOP under the "Pre-training \& Prompt Tuning" paradigm. By unifying pre-training and recommendation tasks as a common motif-based similarity learning task and integrating adaptable prompt parameters to guide the model in downstream recommendation tasks, MOP excels in transferring domain knowledge effectively. Experimental results on four distinct CDR tasks demonstrate the effectiveness of MOP than the state-of-the-art models.

cs.IR↗
arXiv2023

ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data

Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels. However, complex and diverse radiology reports with cross-source heterogeneity pose a huge generalizability challenge to the current methods under massive data volume, mainly because the style and normativity of radiology reports are obviously distinctive among institutions, body regions inspected and radiologists. Recently, the advent of large language models (LLM) offers great potential for recognizing signs of health conditions. To resolve the above problem, we collaborate with the Second Xiangya Hospital in China and propose ChatRadio-Valuer based on the LLM, a tailored model for automatic radiology report generation that learns generalizable representations and provides a basis pattern for model adaptation in sophisticated analysts' cases. Specifically, ChatRadio-Valuer is trained based on the radiology reports from a single institution by means of supervised fine-tuning, and then adapted to disease diagnosis tasks for human multi-system evaluation (i.e., chest, abdomen, muscle-skeleton, head, and maxillofacial $\&$ neck) from six different institutions in clinical-level events. The clinical dataset utilized in this study encompasses a remarkable total of \textbf{332,673} observations. From the comprehensive results on engineering indicators, clinical efficacy and deployment cost metrics, it can be shown that ChatRadio-Valuer consistently outperforms state-of-the-art models, especially ChatGPT (GPT-3.5-Turbo) and GPT-4 et al., in terms of the diseases diagnosis from radiology reports. ChatRadio-Valuer provides an effective avenue to boost model generalization performance and alleviate the annotation workload of experts to enable the promotion of clinical AI applications in radiology reports.

cs.CL↗
arXiv2023

Adaptive Identification with Guaranteed Performance Under Saturated-Observation and Non-Persistent Excitation

This paper investigates the adaptive identification and prediction problems for stochastic dynamical systems with saturated observations, which arise from various fields in engineering and social systems, but up to now still lack comprehensive theoretical studies including performance guarantees needed in practical applications. With this impetus, the paper has made the following main contributions: (i) To introduce a two-step Quasi-Newton (TSQN) algorithm to improve the performance of the identification, which is applicable to a typical class of nonlinear stochastic systems with outputs observed under possibly varying saturation. (ii) To establish the global convergence of both the parameter estimators and adaptive predictors and to prove the asymptotic normality, under the weakest possible non-persistent excitation (PE) condition, which can be applied to stochastic feedback systems with general non-stationary and correlated system signals or data. (iii) To establish useful probabilistic estimation error bounds for any given finite length of data, using either martingale inequalities or Monte Carlo experiments. A numerical example is also provided to illustrate the performance of the proposed identification algorithm.

eess.SY↗
arXiv2023

Composite Disturbance Filtering: A Novel State Estimation Scheme for Systems With Multi-Source, Heterogeneous, and Isomeric Disturbances

State estimation has long been a fundamental problem in signal processing and control areas. The main challenge is to design filters with ability to reject or attenuate various disturbances. With the arrival of big data era, the disturbances of complicated systems are physically multi-source, mathematically heterogenous, affecting the system dynamics via isomeric (additive, multiplicative and recessive) channels, and deeply coupled with each other. In traditional filtering schemes, the multi-source heterogenous disturbances are usually simplified as a lumped one so that the "single" disturbance can be either rejected or attenuated. Since the pioneering work in 2012, a novel state estimation methodology called {\it composite disturbance filtering} (CDF) has been proposed, which deals with the multi-source, heterogenous, and isomeric disturbances based on their specific characteristics. With the CDF, enhanced anti-disturbance capability can be achieved via refined quantification, effective separation, and simultaneous rejection and attenuation of the disturbances. In this paper, an overview of the CDF scheme is provided, which includes the basic principle, general design procedure, application scenarios (e.g. alignment, localization and navigation), and future research directions. In summary, it is expected that the CDF offers an effective tool for state estimation, especially in the presence of multi-source heterogeneous disturbances.

eess.SY↗
arXiv2023

Fault Separation Based on An Excitation Operator with Application to a Quadrotor UAV

This paper presents an excitation operator based fault separation architecture for a quadrotor unmanned aerial vehicle (UAV) subject to loss of effectiveness (LoE) faults, actuator aging, and load uncertainty. The actuator fault dynamics is deeply excavated, containing the deep coupling information among the actuator faults, the system states, and control inputs. By explicitly considering the physical constraints and tracking performance, an excitation operator and corresponding integrated state observer are designed to estimate separately actuator fault and load uncertainty. Moreover, a fault separation maneuver and a safety controller are proposed to ensure the tracking performance when the excitation operator is injected. Both comparative simulation and flight experiments have demonstrated the effectiveness of the proposed scheme while maintaining high levels of tracking performance.

eess.SY↗
arXiv2023

The Emerging Weak Antilocalization Effect in Semimetal Ta$_{0.7}$Nb$_{0.3}$Sb$_2$ Single Crystal

Weak antilocalization (WAL) effect is commonly observed in 2D systems, or 3D topological insulators, topological semimetal systems. Here we report the clear sign of WAL effect in high quality Ta$_{0.7}$Nb$_{0.3}$Sb$_2$ single crystals, in below 50$^\circ$ K region. The chemical vapor transport method was employed to grow the single crystal samples, the high crystallization quality and uniform element distribution are verified by X-ray diffractions and electron microscopy techniques. Employing the Hall effect and two-band model fitting, the high carrier mobility (> 1000 cm$^2$V$^{-1}$s$^{-1}$ in 2 to 300$^\circ$ K region) and off-compensation electron/hole ratio are obtained. Due to the different angular dependence of WAL effect and the fermiology of Ta$_{0.7}$Nb$_{0.3}$Sb$_2$ single crystal, interesting magnetic-field-induced symmetry change is observed in angular magnetoresistance. These interesting transport properties will lead to more theoretical and applicational exploration in Ta$_{0.7}$Nb$_{0.3}$Sb$_2$ and related semimetal materials.

cond-mat.mtrl-sci↗
arXiv2023

Topological Insulator VxBi1.08-xSn0.02Sb0.9Te2S as a Promising n-type Thermoelectric Material

As one of the most important n-type thermoelectric (TE) materials, Bi2Te3 has been studied for decades, with efforts to enhance the thermoelectric performance based on element doping, band engineering, etc. In this study, we report a novel bulk-insulating topological material system as a replacement for n-type Bi2Te3 materials: V doped Bi1.08Sn0.02Sb0.9Te2S (V:BSSTS) . The V:BSSTS is a bulk insulator with robust metallic topological surface states. Furthermore, the bulk band gap can be tuned by the doping level of V, which is verified by magnetotransport measurements. Large linear magnetoresistance is observed in all samples. Excellent thermoelectric performance is obtained in the V:BSSTS samples, e.g., the highest figure of merit ZT of ~ 0.8 is achieved in the 2% V doped sample (denoted as V0.02) at 550 K. The high thermoelectric performance of V:BSSTS can be attributed to two synergistic effects: (1) the low conductive secondary phases Sb2S3, and V2S3 are believed to be important scattering centers for phonons, leading to lower lattice thermal conductivity; and (2) the electrical conductivity is increased due to the high-mobility topological surface states at the boundaries. In addition, by replacing one third of costly tellurium with abundant, low-cost, and less-toxic sulfur element, the newly produced BSSTS material is inexpensive but still has comparable TE performance to the traditional Bi2Te3-based materials, which offers a cheaper plan for the electronics and thermoelectric industries. Our results demonstrate that topological materials with unique band structures can provide a new platform in the search for new high performance TE materials.

cond-mat.mtrl-sci↗
arXiv2023

Reversible and nonvolatile manipulation of the spin-orbit interaction in ferroelectric field-effect transistors based on a two-dimensional bismuth oxychalcogenide

Spin-orbit interaction (SOI) offers a nonferromagnetic scheme to realize spin polarization through utilizing an electric field. Electrically tunable SOI through electrostatic gates have been investigated, however, the relatively weak and volatile tunability limit its practical applications in spintronics. Here, we demonstrate the nonvolatile electric-field control of SOI via constructing ferroelectric Rashba architectures, i.e., 2D Bi2O2Se/PMN-PT ferroelectric field effect transistors. The experimentally observed weak antilocalization (WAL) cusp in Bi2O2Se films implies the Rashba-type SOI that arises from asymmetric confinement potential. Significantly, taking advantage of the switchable ferroelectric polarization, the WAL-to-weak localization (WL) transition trend reveals the competition between spin relaxation and dephasing process, and the variation of carrier density leads to a reversible and nonvolatile modulation of spin relaxation time and spin splitting energy of Bi2O2Se films by this ferroelectric gating. Our work provides a scheme to achieve nonvolatile control of Rashba SOI with the utilization of ferroelectric remanent polarization.

cond-mat.mtrl-sci↗
arXiv2023

Antiferromagnetic topological insulating state in Tb$_{0.02}$Bi$_{1.08}$Sb$_{0.9}$Te$_2$S single crystals

Topological insulators are emerging materials with insulating bulk and symmetry protected nontrivial surface states. One of the most fascinating transport behaviors in a topological insulator is the quantized anomalous Hall insulator, which has been observed inmagnetic-topological-insulator-based devices. In this work, we report a successful doping of rare earth element Tb into Bi$_{1.08}$Sb$_{0.9}$Te$_2$S topological insulator single crystals, in which the Tb moments are antiferromagnetically ordered below ~10 K. Benefiting from the in-bulk-gap Fermi level, transport behavior dominant by the topological surface states is observed below ~ 150 K. At low temperatures, strong Shubnikov-de Haas oscillations are observed, which exhibit 2D-like behavior. The topological insulator with long range magnetic ordering in rare earth doped Bi$_{1.08}$Sb$_{0.9}$Te$_2$S single crystal provides an ideal platform for quantum transport studies and potential applications.

cond-mat.mtrl-sci↗
arXiv2023

Performance of the 1-ton Prototype Neutrino Detector at CJPL-I

China Jinping Underground Laboratory provides an ideal site for solar, geo-, and supernova neutrino studies. With a prototype neutrino detector running since 2017, containing 1-ton liquid scintillator, we tested its experimental hardware, performed the detector calibration and simulation, and measured its radioactive backgrounds, as an early stage of the Jinping Neutrino Experiment (JNE). We investigated the radon background and implemented the nitrogen sealing technology to control it. This paper presents the details of these studies and will serve as a key reference for the construction and optimization of the future large detector of JNE.

hep-ex↗
arXiv2023

Lightweight Self-Knowledge Distillation with Multi-source Information Fusion

Knowledge Distillation (KD) is a powerful technique for transferring knowledge between neural network models, where a pre-trained teacher model is used to facilitate the training of the target student model. However, the availability of a suitable teacher model is not always guaranteed. To address this challenge, Self-Knowledge Distillation (SKD) attempts to construct a teacher model from itself. Existing SKD methods add Auxiliary Classifiers (AC) to intermediate layers of the model or use the history models and models with different input data within the same class. However, these methods are computationally expensive and only capture time-wise and class-wise features of data. In this paper, we propose a lightweight SKD framework that utilizes multi-source information to construct a more informative teacher. Specifically, we introduce a Distillation with Reverse Guidance (DRG) method that considers different levels of information extracted by the model, including edge, shape, and detail of the input data, to construct a more informative teacher. Additionally, we design a Distillation with Shape-wise Regularization (DSR) method that ensures a consistent shape of ranked model output for all data. We validate the performance of the proposed DRG, DSR, and their combination through comprehensive experiments on various datasets and models. Our results demonstrate the superiority of the proposed methods over baselines (up to 2.87%) and state-of-the-art SKD methods (up to 1.15%), while being computationally efficient and robust. The code is available at https://github.com/xucong-parsifal/LightSKD.

cs.CV↗
arXiv2023

Automated Prompting for Non-overlapping Cross-domain Sequential Recommendation

Cross-domain Recommendation (CR) has been extensively studied in recent years to alleviate the data sparsity issue in recommender systems by utilizing different domain information. In this work, we focus on the more general Non-overlapping Cross-domain Sequential Recommendation (NCSR) scenario. NCSR is challenging because there are no overlapped entities (e.g., users and items) between domains, and there is only users' implicit feedback and no content information. Previous CR methods cannot solve NCSR well, since (1) they either need extra content to align domains or need explicit domain alignment constraints to reduce the domain discrepancy from domain-invariant features, (2) they pay more attention to users' explicit feedback (i.e., users' rating data) and cannot well capture their sequential interaction patterns, (3) they usually do a single-target cross-domain recommendation task and seldom investigate the dual-target ones. Considering the above challenges, we propose Prompt Learning-based Cross-domain Recommender (PLCR), an automated prompting-based recommendation framework for the NCSR task. Specifically, to address the challenge (1), PLCR resorts to learning domain-invariant and domain-specific representations via its prompt learning component, where the domain alignment constraint is discarded. For challenges (2) and (3), PLCR introduces a pre-trained sequence encoder to learn users' sequential interaction patterns, and conducts a dual-learning target with a separation constraint to enhance recommendations in both domains. Our empirical study on two sub-collections of Amazon demonstrates the advance of PLCR compared with some related SOTA methods.

cs.IR↗
arXiv2023

Sector Bounds for Vertical Cable Force Error in Cable-Suspended Load Transportation System

This article studies the collaborative transportation of a cable-suspended pipe by two quadrotors. A force-coordination control scheme is proposed, where a force-consensus term is introduced to average the load distribution between the quadrotors. Since thrust uncertainty and cable force are coupled together in the acceleration channel, disturbance observer can only obtain the lumped disturbance estimate. Under the quasi-static condition, a disturbance separation strategy is developed to remove the thrust uncertainty estimate for precise cable force estimation. The stability of the overall system is analyzed using Lyapunov theory. Both numerical simulations and indoor experiments using heterogeneous quadrotors validate the effectiveness of thrust uncertainty separation and force-consensus algorithm.

cs.RO↗
arXiv2023

Multidimensional Resource Fragmentation-Aware Virtual Network Embedding in MEC Systems Interconnected by Metro Optical Networks

The increasing demand for diverse emerging applications has resulted in the interconnection of multi-access edge computing (MEC) systems via metro optical networks. To cater to these diverse applications, network slicing has become a popular tool for creating specialized virtual networks. However, resource fragmentation caused by uneven utilization of multidimensional resources can lead to reduced utilization of limited edge resources. To tackle this issue, this paper focuses on addressing the multidimensional resource fragmentation problem in virtual network embedding (VNE) in MEC systems with the aim of maximizing the profit of an infrastructure provider (InP). The VNE problem in MEC systems is transformed into a bilevel optimization problem, taking into account the interdependence between virtual node embedding (VNoE) and virtual link embedding (VLiE). To solve this problem, we propose a nested bilevel optimization approach named BiVNE. The VNoE is solved using the ant colony system (ACS) in the upper level, while the VLiE is solved using a combination of a shortest path algorithm and an exact-fit spectrum slot allocation method in the lower level. Evaluation results show that the BiVNE algorithm can effectively enhance the profit of the InP by increasing the acceptance ratio and avoiding resource fragmentation simultaneously.

cs.NI↗
arXiv2023

Towards Lightweight Cross-domain Sequential Recommendation via External Attention-enhanced Graph Convolution Network

Cross-domain Sequential Recommendation (CSR) is an emerging yet challenging task that depicts the evolution of behavior patterns for overlapped users by modeling their interactions from multiple domains. Existing studies on CSR mainly focus on using composite or in-depth structures that achieve significant improvement in accuracy but bring a huge burden to the model training. Moreover, to learn the user-specific sequence representations, existing works usually adopt the global relevance weighting strategy (e.g., self-attention mechanism), which has quadratic computational complexity. In this work, we introduce a lightweight external attention-enhanced GCN-based framework to solve the above challenges, namely LEA-GCN. Specifically, by only keeping the neighborhood aggregation component and using the Single-Layer Aggregating Protocol (SLAP), our lightweight GCN encoder performs more efficiently to capture the collaborative filtering signals of the items from both domains. To further alleviate the framework structure and aggregate the user-specific sequential pattern, we devise a novel dual-channel External Attention (EA) component, which calculates the correlation among all items via a lightweight linear structure. Extensive experiments are conducted on two real-world datasets, demonstrating that LEA-GCN requires a smaller volume and less training time without affecting the accuracy compared with several state-of-the-art methods.

cs.IR↗
arXiv2022

Convergence of a Distributed Least Squares

In this paper, we consider a least-squares (LS)-based distributed algorithm build on a sensor network to estimate an unknown parameter vector of a dynamical system, where each sensor in the network has partial information only but is allowed to communicate with its neighbors. Our main task is to generalize the well-known theoretical results on the traditional LS to the current distributed case by establishing both the upper bound of the accumulated regrets of the adaptive predictor and the convergence of the distributed LS estimator, with the following key features compared with the existing literature on distributed estimation: Firstly, our theory does not need the previously imposed independence, stationarity or Gaussian property on the system signals, and hence is applicable to stochastic systems with feedback. Secondly, the cooperative excitation condition introduced and used in this paper for the convergence of the distributed LS estimate is the weakest possible one, which shows that even if any individual sensor cannot estimate the unknown parameter by the traditional LS, the whole network can still fulfill the estimation task by the distributed LS.

eess.SY↗
arXiv2022

OPR-Miner: Order-preserving rule mining for time series

Discovering frequent trends in time series is a critical task in data mining. Recently, order-preserving matching was proposed to find all occurrences of a pattern in a time series, where the pattern is a relative order (regarded as a trend) and an occurrence is a sub-time series whose relative order coincides with the pattern. Inspired by the order-preserving matching, the existing order-preserving pattern (OPP) mining algorithm employs order-preserving matching to calculate the support, which leads to low efficiency. To address this deficiency, this paper proposes an algorithm called efficient frequent OPP miner (EFO-Miner) to find all frequent OPPs. EFO-Miner is composed of four parts: a pattern fusion strategy to generate candidate patterns, a matching process for the results of sub-patterns to calculate the support of super-patterns, a screening strategy to dynamically reduce the size of prefix and suffix arrays, and a pruning strategy to further dynamically prune candidate patterns. Moreover, this paper explores the order-preserving rule (OPR) mining and proposes an algorithm called OPR-Miner to discover strong rules from all frequent OPPs using EFO-Miner. Experimental results verify that OPR-Miner gives better performance than other competitive algorithms. More importantly, clustering and classification experiments further validate that OPR-Miner achieves good performance.

cs.DB↗