arXiv subjects

Lin Zhang

Publications and source records attributed to Lin Zhang.

At least 235 records · Page 13Linked to original sources

arXiv2023

Progression Cognition Reinforcement Learning with Prioritized Experience for Multi-Vehicle Pursuit

Multi-vehicle pursuit (MVP) such as autonomous police vehicles pursuing suspects is important but very challenging due to its mission and safety critical nature. While multi-agent reinforcement learning (MARL) algorithms have been proposed for MVP problem in structured grid-pattern roads, the existing algorithms use randomly training samples in centralized learning, which leads to homogeneous agents showing low collaboration performance. For the more challenging problem of pursuing multiple evading vehicles, these algorithms typically select a fixed target evading vehicle for pursuing vehicles without considering dynamic traffic situation, which significantly reduces pursuing success rate. To address the above problems, this paper proposes a Progression Cognition Reinforcement Learning with Prioritized Experience for MVP (PEPCRL-MVP) in urban multi-intersection dynamic traffic scenes. PEPCRL-MVP uses a prioritization network to assess the transitions in the global experience replay buffer according to the parameters of each MARL agent. With the personalized and prioritized experience set selected via the prioritization network, diversity is introduced to the learning process of MARL, which can improve collaboration and task related performance. Furthermore, PEPCRL-MVP employs an attention module to extract critical features from complex urban traffic environments. These features are used to develop progression cognition method to adaptively group pursuing vehicles. Each group efficiently target one evading vehicle in dynamic driving environments. Extensive experiments conducted with a simulator over unstructured roads of an urban area show that PEPCRL-MVP is superior to other state-of-the-art methods. Specifically, PEPCRL-MVP improves pursuing efficiency by 3.95% over TD3-DMAP and its success rate is 34.78% higher than that of MADDPG. Codes are open sourced.

cs.AI↗

arXiv2023

Range-Based Equal Error Rate for Spoof Localization

Spoof localization, also called segment-level detection, is a crucial task that aims to locate spoofs in partially spoofed audio. The equal error rate (EER) is widely used to measure performance for such biometric scenarios. Although EER is the only threshold-free metric, it is usually calculated in a point-based way that uses scores and references with a pre-defined temporal resolution and counts the number of misclassified segments. Such point-based measurement overly relies on this resolution and may not accurately measure misclassified ranges. To properly measure misclassified ranges and better evaluate spoof localization performance, we upgrade point-based EER to range-based EER. Then, we adapt the binary search algorithm for calculating range-based EER and compare it with the classical point-based EER. Our analyses suggest utilizing either range-based EER, or point-based EER with a proper temporal resolution can fairly and properly evaluate the performance of spoof localization.

cs.SD↗

arXiv2023

Feature Expansion for Graph Neural Networks

Graph neural networks aim to learn representations for graph-structured data and show impressive performance, particularly in node classification. Recently, many methods have studied the representations of GNNs from the perspective of optimization goals and spectral graph theory. However, the feature space that dominates representation learning has not been systematically studied in graph neural networks. In this paper, we propose to fill this gap by analyzing the feature space of both spatial and spectral models. We decompose graph neural networks into determined feature spaces and trainable weights, providing the convenience of studying the feature space explicitly using matrix space analysis. In particular, we theoretically find that the feature space tends to be linearly correlated due to repeated aggregations. Motivated by these findings, we propose 1) feature subspaces flattening and 2) structural principal components to expand the feature space. Extensive experiments verify the effectiveness of our proposed more comprehensive feature space, with comparable inference time to the baseline, and demonstrate its efficient convergence capability.

cs.LG↗

arXiv2023

A Diffusion Model for Event Skeleton Generation

Event skeleton generation, aiming to induce an event schema skeleton graph with abstracted event nodes and their temporal relations from a set of event instance graphs, is a critical step in the temporal complex event schema induction task. Existing methods effectively address this task from a graph generation perspective but suffer from noise-sensitive and error accumulation, e.g., the inability to correct errors while generating schema. We, therefore, propose a novel Diffusion Event Graph Model~(DEGM) to address these issues. Our DEGM is the first workable diffusion model for event skeleton generation, where the embedding and rounding techniques with a custom edge-based loss are introduced to transform a discrete event graph into learnable latent representation. Furthermore, we propose a denoising training process to maintain the model's robustness. Consequently, DEGM derives the final schema, where error correction is guaranteed by iteratively refining the latent representation during the schema generation process. Experimental results on three IED bombing datasets demonstrate that our DEGM achieves better results than other state-of-the-art baselines. Our code and data are available at https://github.com/zhufq00/EventSkeletonGeneration.

cs.CL↗

arXiv2023

Margin-closed vector autoregressive time series models

Conditions are obtained for a Gaussian vector autoregressive time series of order $k$, VAR($k$), to have univariate margins that are autoregressive of order $k$ or lower-dimensional margins that are also VAR($k$). This can lead to $d$-dimensional VAR($k$) models that are closed with respect to a given partition $\{S_1,\ldots,S_n\}$ of $\{1,\ldots,d\}$ by specifying marginal serial dependence and some cross-sectional dependence parameters. The special closure property allows one to fit the sub-processes of multivariate time series before assembling them by fitting the dependence structure between the sub-processes. We revisit the use of the Gaussian copula of the stationary joint distribution of observations in the VAR($k$) process with non-Gaussian univariate margins but under the constraint of closure under margins. This construction allows more flexibility in handling higher-dimensional time series and a multi-stage estimation procedure can be used. The proposed class of models is applied to a macro-economic data set and compared with the relevant benchmark models.

stat.ME↗

arXiv2023

Improving Your Graph Neural Networks: A High-Frequency Booster

Graph neural networks (GNNs) hold the promise of learning efficient representations of graph-structured data, and one of its most important applications is semi-supervised node classification. However, in this application, GNN frameworks tend to fail due to the following issues: over-smoothing and heterophily. The most popular GNNs are known to be focused on the message-passing framework, and recent research shows that these GNNs are often bounded by low-pass filters from a signal processing perspective. We thus incorporate high-frequency information into GNNs to alleviate this genetic problem. In this paper, we argue that the complement of the original graph incorporates a high-pass filter and propose Complement Laplacian Regularization (CLAR) for an efficient enhancement of high-frequency components. The experimental results demonstrate that CLAR helps GNNs tackle over-smoothing, improving the expressiveness of heterophilic graphs, which adds up to 3.6% improvement over popular baselines and ensures topological robustness.

cs.LG↗

arXiv2023

HybridCVLNet: A Hybrid CSI Feedback System and its Domain Adaptation

Deep Learning (DL)-based channel state information (CSI) feedback is a promising technique for the transmitter to accurately acquire the CSI of massive multiple-input multiple-output (MIMO) systems. As critical concerns about DL-based physical layer applications, the intra-domain generalizability affected by dataset bias and inter-domain robustness in data drift remain challenging. Therefore, we build on a Hybrid Complex-Valued Lightweight framework, namely the HybridCVLNet, capable of overcoming the dataset bias with regularized hybrid structure and codeword. Meanwhile, a corresponding transductive-based hybrid domain adaptation scheme is proposed to tackle the inter-domain data drift. The experiment verifies that HybridCVLNet achieves stable generalizability and performance gain over the state-of-the-art (SOTA) feedback schemes in an intra-domain heterogeneous dataset. In addition, its transductive-based hybrid domain adaptation scheme is more efficient and superior to the inductive-based transfer learning methods under two inter-domain online re-optimization settings.

eess.SP↗

arXiv2023

Detection of Pavement Cracks by Deep Learning Models of Transformer and UNet

Fracture is one of the main failure modes of engineering structures such as buildings and roads. Effective detection of surface cracks is significant for damage evaluation and structure maintenance. In recent years, the emergence and development of deep learning techniques have shown great potential to facilitate surface crack detection. Currently, most reported tasks were performed by a convolutional neural network (CNN), while the limitation of CNN may be improved by the transformer architecture introduced recently. In this study, we investigated nine promising models to evaluate their performance in pavement surface crack detection by model accuracy, computational complexity, and model stability. We created 711 images of 224 by 224 pixels with crack labels, selected an optimal loss function, compared the evaluation metrics of the validation dataset and test dataset, analyzed the data details, and checked the segmentation outcomes of each model. We find that transformer-based models generally are easier to converge during the training process and have higher accuracy, but usually exhibit more memory consumption and low processing efficiency. Among nine models, SwinUNet outperforms the other two transformers and shows the highest accuracy among nine models. The results should shed light on surface crack detection by various deep-learning models and provide a guideline for future applications in this field.

cs.CV↗

arXiv2023

Unified characterization for higher-order topological phase transitions

Higher-order topological phase transitions (HOTPTs) are associated with closing either the bulk energy gap (type-I) or boundary energy gap (type-II) without changing symmetry, and conventionally the both transitions are captured in real space and characterized separately. Here we propose a momentum-space topological characterization of the HOTPTs, which unifies the both types of topological transitions and enables a precise detection by quench dynamics. Our unified characterization is based on a novel correspondence between the mass domain walls on real-space boundaries and the higher-order band-inversion surfaces (BIS) which are characteristic interfaces in the momentum subspace. The topological transitions occur when momentum-space topological nodes, dubbed higher-order topological charges, cross the higher-order BISs after proper projection. Particularly, the bulk (boundary) gap closes when all (part of) topological charges cross the BISs, characterizing the type-I (type-II) HOTPTs. These distinct dynamical behaviours of higher-order topological charges can be feasibly measured from quench dynamics driven with control in experiments. Our work opens an avenue to characterize and detect the two types of HOTPTs within a unified framework, and shall advance the research in both theory and experiment.

cond-mat.mes-hall↗

arXiv2023

Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligence

Nowadays, foundation models become one of fundamental infrastructures in artificial intelligence, paving ways to the general intelligence. However, the reality presents two urgent challenges: existing foundation models are dominated by the English-language community; users are often given limited resources and thus cannot always use foundation models. To support the development of the Chinese-language community, we introduce an open-source project, called Fengshenbang, which leads by the research center for Cognitive Computing and Natural Language (CCNL). Our project has comprehensive capabilities, including large pre-trained models, user-friendly APIs, benchmarks, datasets, and others. We wrap all these in three sub-projects: the Fengshenbang Model, the Fengshen Framework, and the Fengshen Benchmark. An open-source roadmap, Fengshenbang, aims to re-evaluate the open-source community of Chinese pre-trained large-scale models, prompting the development of the entire Chinese large-scale model community. We also want to build a user-centered open-source ecosystem to allow individuals to access the desired models to match their computing resources. Furthermore, we invite companies, colleges, and research institutions to collaborate with us to build the large-scale open-source model-based ecosystem. We hope that this project will be the foundation of Chinese cognitive intelligence.

cs.CL↗

arXiv2023

LMR: A Large-Scale Multi-Reference Dataset for Reference-based Super-Resolution

It is widely agreed that reference-based super-resolution (RefSR) achieves superior results by referring to similar high quality images, compared to single image super-resolution (SISR). Intuitively, the more references, the better performance. However, previous RefSR methods have all focused on single-reference image training, while multiple reference images are often available in testing or practical applications. The root cause of such training-testing mismatch is the absence of publicly available multi-reference SR training datasets, which greatly hinders research efforts on multi-reference super-resolution. To this end, we construct a large-scale, multi-reference super-resolution dataset, named LMR. It contains 112,142 groups of 300x300 training images, which is 10x of the existing largest RefSR dataset. The image size is also much larger. More importantly, each group is equipped with 5 reference images with different similarity levels. Furthermore, we propose a new baseline method for multi-reference super-resolution: MRefSR, including a Multi-Reference Attention Module (MAM) for feature fusion of an arbitrary number of reference images, and a Spatial Aware Filtering Module (SAFM) for the fused feature selection. The proposed MRefSR achieves significant improvements over state-of-the-art approaches on both quantitative and qualitative evaluations. Our code and data would be made available soon.

cs.CV↗

arXiv2023

Dynamical detection of mean-field topological phases in an interacting Chern insulator

Interactions generically have important effects on the topological quantum phases. For a quantum anomalous Hall (QAH) insulator, the presence of interactions can qualitatively change the topological phase diagram which, however, is typically hard to measure in the experiment. Here we propose a novel scheme based on quench dynamics to detect the mean-field topological phase diagram of an interacting Chern insulator described by QAH-Hubbard model, with nontrivial dynamical quantum physics being uncovered. We focus on the dynamical properties of the system at a weak to intermediate Hubbard interaction which mainly induces a ferromagnetic order under the mean-field level. Remarkably, three characteristic times $t_s$, $t_c$, and $t^*$ are found in the quench dynamics. The first two capture the emergence of dynamical self-consistent particle density and dynamical topological phase transition respectively, while the last one gives a linear scaling time on the topological phase boundaries. A more interesting result is that $t_s>t^*>t_c$ ($t^*<t_s<t_c$) occurs in repulsive (attractive) interaction and the Chern number is determined by any two characteristic time scales when the system is quenched from an initial nearly fully polarized state to the topologically nontrivial regimes, showing a dynamical way to determine equilibrium mean-field topological phase diagram via the time scales. Experimentally,the measurement of $t_s$ is challenging while $t_c$ and $t^*$ can be directly readout by measuring the spin polarizations of four Dirac points and the time-dependent particle density, respectively. Our work reveals the novel interacting effects on the topological phases and shall promote the experimental observation.

cond-mat.str-el↗

arXiv2023

Artificial Intelligence: 70 Years Down the Road

Artificial intelligence (AI) has a history of nearly a century from its inception to the present day. We have summarized the development trends and discovered universal rules, including both success and failure. We have analyzed the reasons from both technical and philosophical perspectives to help understand the reasons behind the past failures and current successes of AI, and to provide a basis for thinking and exploring future development. Specifically, we have found that the development of AI in different fields, including computer vision, natural language processing, and machine learning, follows a pattern from rules to statistics to data-driven methods. In the face of past failures and current successes, we need to think systematically about the reasons behind them. Given the unity of AI between natural and social sciences, it is necessary to incorporate philosophical thinking to understand and solve AI problems, and we believe that starting from the dialectical method of Marx is a feasible path. We have concluded that the sustainable development direction of AI should be human-machine collaboration and a technology path centered on computing power. Finally, we have summarized the impact of AI on society from this trend.

cs.AI↗

arXiv2023

Unpaired Translation from Semantic Label Maps to Images by Leveraging Domain-Specific Simulations

Photorealistic image generation from simulated label maps are necessitated in several contexts, such as for medical training in virtual reality. With conventional deep learning methods, this task requires images that are paired with semantic annotations, which typically are unavailable. We introduce a contrastive learning framework for generating photorealistic images from simulated label maps, by learning from unpaired sets of both. Due to potentially large scene differences between real images and label maps, existing unpaired image translation methods lead to artifacts of scene modification in synthesized images. We utilize simulated images as surrogate targets for a contrastive loss, while ensuring consistency by utilizing features from a reverse translation network. Our method enables bidirectional label-image translations, which is demonstrated in a variety of scenarios and datasets, including laparoscopy, ultrasound, and driving scenes. By comparing with state-of-the-art unpaired translation methods, our proposed method is shown to generate realistic and scene-accurate translations.

cs.CV↗

arXiv2023

Steady-state Peierls transition in nanotube quantum simulator

Quantum dots placed along a vibrating nanotube provide a quantum simulation platform that can directly address the electron-phonon interaction. This offers promising prospects for the search of new quantum materials and the study of strong correlation effects. As this platform is naturally operated by coupling the dots to an electronic reservoir, state preparation is straightforwardly achieved by driving into the steady state. Here we show that for intermediate electron-phonon coupling strength, the system with spin-polarized quantum dots undergoes a Peierls transition into an insulating regime which exhibits charge-density wave order in the steady state as a consequence of the competition between electronic Coulomb repulsive interactions and phonon-induced attractive interactions. The transport phenomena can be directly observed as fingerprints of electronic correlations. We also present powerful methods to numerically capture the physics of such an open electron-phonon system at large numbers of phonons. Our work paves the way to study and detect correlated electron-phonon physics in the nanotube quantum simulator with current experimentally accessible techniques.

cond-mat.str-el↗

arXiv2023

The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterance

Automatic speaker verification is susceptible to various manipulations and spoofing, such as text-to-speech synthesis, voice conversion, replay, tampering, adversarial attacks, and so on. We consider a new spoofing scenario called "Partial Spoof" (PS) in which synthesized or transformed speech segments are embedded into a bona fide utterance. While existing countermeasures (CMs) can detect fully spoofed utterances, there is a need for their adaptation or extension to the PS scenario. We propose various improvements to construct a significantly more accurate CM that can detect and locate short-generated spoofed speech segments at finer temporal resolutions. First, we introduce newly developed self-supervised pre-trained models as enhanced feature extractors. Second, we extend our PartialSpoof database by adding segment labels for various temporal resolutions. Since the short spoofed speech segments to be embedded by attackers are of variable length, six different temporal resolutions are considered, ranging from as short as 20 ms to as large as 640 ms. Third, we propose a new CM that enables the simultaneous use of the segment-level labels at different temporal resolutions as well as utterance-level labels to execute utterance- and segment-level detection at the same time. We also show that the proposed CM is capable of detecting spoofing at the utterance level with low error rates in the PS scenario as well as in a related logical access (LA) scenario. The equal error rates of utterance-level detection on the PartialSpoof database and ASVspoof 2019 LA database were 0.77 and 0.90%, respectively.

eess.AS↗

arXiv2022

Unsupervised Instance and Subnetwork Selection for Network Data

Unlike tabular data, features in network data are interconnected within a domain-specific graph. Examples of this setting include gene expression overlaid on a protein interaction network (PPI) and user opinions in a social network. Network data is typically high-dimensional (large number of nodes) and often contains outlier snapshot instances and noise. In addition, it is often non-trivial and time-consuming to annotate instances with global labels (e.g., disease or normal). How can we jointly select discriminative subnetworks and representative instances for network data without supervision? We address these challenges within an unsupervised framework for joint subnetwork and instance selection in network data, called UISS, via a convex self-representation objective. Given an unlabeled network dataset, UISS identifies representative instances while ignoring outliers. It outperforms state-of-the-art baselines on both discriminative subnetwork selection and representative instance selection, achieving up to 10% accuracy improvement on all real-world data sets we use for evaluation. When employed for exploratory analysis in RNA-seq network samples from multiple studies it produces interpretable and informative summaries.

cs.LG↗

arXiv2022

A Large-scale Friend Suggestion Architecture

Online social as an extension of traditional life plays an important role in our daily lives. Users often seek out new friends that have significant similarities such as interests and habits, motivating us to exploit such online information to suggest friends to users. In this work, we focus on friend suggestion in online game platforms because in-game social quality significantly correlates with player engagement, determining game experience. Unlike a typical recommendation system that depends on item-user interactions, in our setting, user-user interactions do not depend on each other. Meanwhile, user preferences change rapidly due to fast changing game environment. There has been little work on designing friend suggestion when facing these difficulties, and for the first time we aim to tackle this in large scale online games. Motivated by the fast changing online game environment, we formulate this problem as friend ranking by modeling the evolution of similarity among users, exploiting the long-term and short-term feature of users in games. Our experiments on large-scale game datasets with several million users demonstrate that our proposed model achieves superior performance over other competing baselines.

cs.SI↗