arXiv subjects

Yue Liu

Publications and source records attributed to Yue Liu.

At least 271 records · Page 15Linked to original sources

arXiv2023

Dink-Net: Neural Clustering on Large Graphs

Deep graph clustering, which aims to group the nodes of a graph into disjoint clusters with deep neural networks, has achieved promising progress in recent years. However, the existing methods fail to scale to the large graph with million nodes. To solve this problem, a scalable deep graph clustering method (Dink-Net) is proposed with the idea of dilation and shrink. Firstly, by discriminating nodes, whether being corrupted by augmentations, representations are learned in a self-supervised manner. Meanwhile, the cluster centres are initialized as learnable neural parameters. Subsequently, the clustering distribution is optimized by minimizing the proposed cluster dilation loss and cluster shrink loss in an adversarial manner. By these settings, we unify the two-step clustering, i.e., representation learning and clustering optimization, into an end-to-end framework, guiding the network to learn clustering-friendly features. Besides, Dink-Net scales well to large graphs since the designed loss functions adopt the mini-batch data to optimize the clustering distribution even without performance drops. Both experimental results and theoretical analyses demonstrate the superiority of our method. Compared to the runner-up, Dink-Net achieves 9.62% NMI improvement on the ogbn-papers100M dataset with 111 million nodes and 1.6 billion edges. The source code is released at https://github.com/yueliu1999/Dink-Net. Besides, a collection (papers, codes, and datasets) of deep graph clustering is shared at https://github.com/yueliu1999/Awesome-Deep-Graph-Clustering.

cs.LG↗

arXiv2023

Analytical reconstructions of full-scan multiple source-translation computed tomography under large field of views

This paper is to investigate the high-quality analytical reconstructions of multiple source-translation computed tomography (mSTCT) under an extended field of view (FOV). Under the larger FOVs, the previously proposed backprojection filtration (BPF) algorithms for mSTCT, including D-BPF and S-BPF (their differences are different derivate directions along the detector and source, respectively), make some errors and artifacts in the reconstructed images due to a backprojection weighting factor and the half-scan mode, which deviates from the intention of mSTCT imaging. In this paper, to achieve reconstruction with as little error as possible under the extremely extended FOV, we combine the full-scan mSTCT (F-mSTCT) geometry with the previous BPF algorithms to study the performance and derive a suitable redundancy-weighted function for F-mSTCT. The experimental results indicate FS-BPF can get high-quality, stable images under the extremely extended FOV of imaging a large object, though it requires more projections than FD-BPF. Finally, for different practical requirements in extending FOV imaging, we give suggestions on algorithm selection.

cs.CV↗

arXiv2023

QB4AIRA: A Question Bank for AI Risk Assessment

The rapid advancement of Artificial Intelligence (AI), represented by ChatGPT, has raised concerns about responsible AI development and utilization. Existing frameworks lack a comprehensive synthesis of AI risk assessment questions. To address this, we introduce QB4AIRA, a novel question bank developed by refining questions from five globally recognized AI risk frameworks, categorized according to Australia's AI ethics principles. QB4AIRA comprises 293 prioritized questions covering a wide range of AI risk areas, facilitating effective risk assessment. It serves as a valuable resource for stakeholders in assessing and managing AI risks, while paving the way for new risk frameworks and guidelines. By promoting responsible AI practices, QB4AIRA contributes to responsible AI deployment, mitigating potential risks and harms.

cs.SE↗

arXiv2023

Uncorrelated Amplitude and Frequency Variations of the Harmonics in SX Phoenicis Star XX Cygni

Harmonics are quite common in pulsating stars, and they are always considered to mimic the behaviors of their independent parent pulsation modes and not taken as the key information for asteroseismology. Here, we report an SX Phoenicis star XX Cygni, whose periodogram is dominated by the fundamental frequency $f_{0} = 7.41481 \pm 0.00004\ \mathrm{cd}^{-1}$ and its 19 harmonics. According to the analysis of the archival data from \TESS, we find that both the amplitudes and frequencies of the fundamental mode and the harmonics vary within TESS Sectors 14-17 and 54-57, which might be caused by the contamination by neighbouring stars. What is more interesting is that, the harmonics show significantly uncorrelated amplitude and frequency variations over time. Some possible origins and interesting issues are proposed to scheme the further research of this hidden corner in current asteroseismology.

astro-ph.SR↗

arXiv2023

Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoning

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering. However, most MKGs are still far from complete, which motivates the flourishing of MKG reasoning models. Recently, with the development of general artificial architectures, the pretrained transformer models have drawn increasing attention, especially for multimodal scenarios. However, the research of multimodal pretrained transformer (MPT) for knowledge graph reasoning (KGR) is still at an early stage. As the biggest difference between MKG and other multimodal data, the rich structural information underlying the MKG still cannot be fully leveraged in existing MPT models. Most of them only utilize the graph structure as a retrieval map for matching images and texts connected with the same entity. This manner hinders their reasoning performances. To this end, we propose the graph Structure Guided Multimodal Pretrained Transformer for knowledge graph reasoning, termed SGMPT. Specifically, the graph structure encoder is adopted for structural feature encoding. Then, a structure-guided fusion module with two different strategies, i.e., weighted summation and alignment constraint, is first designed to inject the structural information into both the textual and visual features. To the best of our knowledge, SGMPT is the first MPT model for multimodal KGR, which mines the structural information underlying the knowledge graph. Extensive experiments on FB15k-237-IMG and WN18-IMG, demonstrate that our SGMPT outperforms existing state-of-the-art models, and prove the effectiveness of the designed strategies.

cs.AI↗

arXiv2023

Homomorphism of independent random variable convolution and matrix multiplication

A map is given showing that convolutions of independent random variables over a finite group and matrix multiplications of doubly stochastic matrices are homomorphic. As an application, a short proof is given to the theorem that the limiting distributions of stochastic processes with stationary independent increments over a finite group are always uniform.

math.PR↗

arXiv2023

Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structure

Knowledge graph embedding (KGE) aims at learning powerful representations to benefit various artificial intelligence applications. Meanwhile, contrastive learning has been widely leveraged in graph learning as an effective mechanism to enhance the discriminative capacity of the learned representations. However, the complex structures of KG make it hard to construct appropriate contrastive pairs. Only a few attempts have integrated contrastive learning strategies with KGE. But, most of them rely on language models ( e.g., Bert) for contrastive pair construction instead of fully mining information underlying the graph structure, hindering expressive ability. Surprisingly, we find that the entities within a relational symmetrical structure are usually similar and correlated. To this end, we propose a knowledge graph contrastive learning framework based on relation-symmetrical structure, KGE-SymCL, which mines symmetrical structure information in KGs to enhance the discriminative ability of KGE models. Concretely, a plug-and-play approach is proposed by taking entities in the relation-symmetrical positions as positive pairs. Besides, a self-supervised alignment loss is designed to pull together positive pairs. Experimental results on link prediction and entity classification datasets demonstrate that our KGE-SymCL can be easily adopted to various KGE models for performance improvements. Moreover, extensive experiments show that our model could outperform other state-of-the-art baselines.

cs.AI↗

arXiv2023

arXiv4TGC: Large-Scale Datasets for Temporal Graph Clustering

Temporal graph clustering (TGC) is a crucial task in temporal graph learning. Its focus is on node clustering on temporal graphs, and it offers greater flexibility for large-scale graph structures due to the mechanism of temporal graph methods. However, the development of TGC is currently constrained by a significant problem: the lack of suitable and reliable large-scale temporal graph datasets to evaluate clustering performance. In other words, most existing temporal graph datasets are in small sizes, and even large-scale datasets contain only a limited number of available node labels. It makes evaluating models for large-scale temporal graph clustering challenging. To address this challenge, we build arXiv4TGC, a set of novel academic datasets (including arXivAI, arXivCS, arXivMath, arXivPhy, and arXivLarge) for large-scale temporal graph clustering. In particular, the largest dataset, arXivLarge, contains 1.3 million labeled available nodes and 10 million temporal edges. We further compare the clustering performance with typical temporal graph learning models on both previous classic temporal graph datasets and the new datasets proposed in this paper. The clustering performance on arXiv4TGC can be more apparent for evaluating different models, resulting in higher clustering confidence and more suitable for large-scale temporal graph clustering. The arXiv4TGC datasets are publicly available at: https://github.com/MGitHubL/arXiv4TGC.

cs.AI↗

arXiv2023

Existence of global solutions for the modified Camassa-Holm equation with a nonzero background

Consideration in the present paper is the existence of global solutions for the modified Camassa-Holm (mCH) equation with a nonzero background initial value. The mCH equation is completely integrable and can be considered as a model for the unidirectional propagation of shallow-water waves. By applying the inverse scattering transform with an application of the Cauchy projection operator, the existence of a unique global solution to the mCH equation in the line with a nonzero background initial value is established in the weighted Sobolev space $ H^{2, 1} (\mathbb{R})\cap H^{1, 2} (\mathbb{R})$ based on the representation of a Riemann-Hilbert (RH) problem associated with the Cauchy problem to the mCH equation. A crucial technique used is to derive the boundedness of the solution in the Sobolev space $ W^{1,\infty}(\mathbb{R}),$ then reconstruct a new RH problem for the Cauchy projection operator of reflection coefficients. The regularity of the global solution is achieved by the refined estimate arguments on those solutions of the corresponding RH problem.

math.AP↗

arXiv2023

Distributed Trust Through the Lens of Software Architecture

Distributed trust is a nebulous concept that has evolved from different perspectives in recent years. While one can attribute its current prominence to blockchain and cryptocurrency, the distributed trust concept has been cultivating progress in federated learning, trustworthy and responsible AI in an ecosystem setting, data sharing, privacy issues across organizational boundaries, and zero trust cybersecurity. This paper will survey the concept of distributed trust in multiple disciplines. It will take a system/software architecture point of view to look at trust redistribution/shift and the associated tradeoffs in systems and applications enabled by distributed trust technologies.

cs.CR↗

arXiv2023

Towards Concrete and Connected AI Risk Assessment (C$^2$AIRA): A Systematic Mapping Study

The rapid development of artificial intelligence (AI) has led to increasing concerns about the capability of AI systems to make decisions and behave responsibly. Responsible AI (RAI) refers to the development and use of AI systems that benefit humans, society, and the environment while minimising the risk of negative consequences. To ensure responsible AI, the risks associated with AI systems' development and use must be identified, assessed and mitigated. Various AI risk assessment frameworks have been released recently by governments, organisations, and companies. However, it can be challenging for AI stakeholders to have a clear picture of the available frameworks and determine the most suitable ones for a specific context. Additionally, there is a need to identify areas that require further research or development of new frameworks, as well as updating and maintaining existing ones. To fill the gap, we present a mapping study of 16 existing AI risk assessment frameworks from the industry, governments, and non-government organizations (NGOs). We identify key characteristics of each framework and analyse them in terms of RAI principles, stakeholders, system lifecycle stages, geographical locations, targeted domains, and assessment methods. Our study provides a comprehensive analysis of the current state of the frameworks and highlights areas of convergence and divergence among them. We also identify the deficiencies in existing frameworks and outlines the essential characteristics of a concrete and connected framework AI risk assessment (C$^2$AIRA) framework. Our findings and insights can help relevant stakeholders choose suitable AI risk assessment frameworks and guide the design of future frameworks towards concreteness and connectedness.

cs.SE↗

arXiv2023

Message Intercommunication for Inductive Relation Reasoning

Inductive relation reasoning for knowledge graphs, aiming to infer missing links between brand-new entities, has drawn increasing attention. The models developed based on Graph Inductive Learning, called GraIL-based models, have shown promising potential for this task. However, the uni-directional message-passing mechanism hinders such models from exploiting hidden mutual relations between entities in directed graphs. Besides, the enclosing subgraph extraction in most GraIL-based models restricts the model from extracting enough discriminative information for reasoning. Consequently, the expressive ability of these models is limited. To address the problems, we propose a novel GraIL-based inductive relation reasoning model, termed MINES, by introducing a Message Intercommunication mechanism on the Neighbor-Enhanced Subgraph. Concretely, the message intercommunication mechanism is designed to capture the omitted hidden mutual information. It introduces bi-directed information interactions between connected entities by inserting an undirected/bi-directed GCN layer between uni-directed RGCN layers. Moreover, inspired by the success of involving more neighbors in other graph-based tasks, we extend the neighborhood area beyond the enclosing subgraph to enhance the information collection for inductive relation reasoning. Extensive experiments on twelve inductive benchmark datasets demonstrate that our MINES outperforms existing state-of-the-art models, and show the effectiveness of our intercommunication mechanism and reasoning on the neighbor-enhanced subgraph.

cs.AI↗

arXiv2023

Assembling Kitaev honeycomb spin liquids from arrays of 1D symmetry protected topological phases

The Kitaev honeycomb model, which is exactly solvable by virtue of an extensive number of conserved quantities, supports a gapless quantum spin liquid phase as well as gapped descendants relevant for fault-tolerant quantum computation. We show that the anomalous edge modes of 1D cluster-state-like symmetry protected topological (SPT) phases provide natural building blocks for a variant of the Kitaev model that enjoys only a subextensive number of conserved quantities. The symmetry of our variant allows a single additional nearest-neighbor perturbation, corresponding to an anisotropic version of the $Γ$ term studied in the context of Kitaev materials. We determine the phase diagram of the model using exact diagonalization. Additionally, we use DMRG to show that the underlying 1D SPT building blocks can emerge from a ladder Hamiltonian exhibiting only two-spin interactions supplemented by a Zeeman field. Our approach may inform a new pathway toward realizing Kitaev honeycomb spin liquids in spin-orbit-coupled Mott insulators.

cond-mat.str-el↗

arXiv2023

On Low Rank Directed Acyclic Graphs and Causal Structure Learning

Despite several advances in recent years, learning causal structures represented by directed acyclic graphs (DAGs) remains a challenging task in high dimensional settings when the graphs to be learned are not sparse. In this paper, we propose to exploit a low rank assumption regarding the (weighted) adjacency matrix of a DAG causal model to help address this problem. We utilize existing low rank techniques to adapt causal structure learning methods to take advantage of this assumption and establish several useful results relating interpretable graphical conditions to the low rank assumption. Specifically, we show that the maximum rank is highly related to hubs, suggesting that scale-free networks, which are frequently encountered in practice, tend to be low rank. Our experiments demonstrate the utility of the low rank adaptations for a variety of data models, especially with relatively large and dense graphs. Moreover, with a validation procedure, the adaptations maintain a superior or comparable performance even when graphs are not restricted to be low rank.

cs.LG↗

arXiv2023

Detecting the skewness of data from the five-number summary and its application in meta-analysis

For clinical studies with continuous outcomes, when the data are potentially skewed, researchers may choose to report the whole or part of the five-number summary (the sample median, the first and third quartiles, and the minimum and maximum values) rather than the sample mean and standard deviation. In the recent literature, it is often suggested to transform the five-number summary back to the sample mean and standard deviation, which can be subsequently used in a meta-analysis. However, if a study contains skewed data, this transformation and hence the conclusions from the meta-analysis are unreliable. Therefore, we introduce a novel method for detecting the skewness of data using only the five-number summary and the sample size, and meanwhile propose a new flow chart to handle the skewed studies in a different manner. We further show by simulations that our skewness tests are able to control the type I error rates and provide good statistical power, followed by a simulated meta-analysis and a real data example that illustrate the usefulness of our new method in meta-analysis and evidence-based medicine.

stat.ME↗

arXiv2023

Defect emission and its dipole orientation in layered ternary Znln2S4 semiconductor

Defect engineering is promising to tailor the physical properties of two-dimensional (2D) semiconductors for function-oriented electronics and optoelectronics. Compared with the extensively studied 2D binary materials, the origin of defects and their influence on physical properties of 2D ternary semiconductors have not been clarified. In this work, we thoroughly studied the effect of defects on the electronic structure and optical properties of few-layer hexagonal Znln2S4 via versatile spectroscopic tools in combination with theoretical calculations. It has been demonstrated that the Zn-In anti-structural defects induce the formation of a series of donor and acceptor levels inside the bandgap, leading to rich recombination paths for defect emission and extrinsic absorption. Impressively, the emission of donor-acceptor pair (DAP) in Znln2S4 can be significantly tailored by electrostatic gating due to efficient tunability of Fermi level (Ef). Furthermore, the layer-dependent dipole orientation of defect emission in Znln2S4 was directly revealed by back focal plane (BFP) imagining, where it presents obviously in-plane dipole orientation within a dozen layers thickness of Znln2S4. These unique features of defects in Znln2S4 including extrinsic absorption, rich recombination paths, gate tunability and in-plane dipole orientation will definitely benefit to the advanced orientation-functional optoelectronic applications.

cond-mat.mtrl-sci↗

arXiv2023

SARF: Aliasing Relation Assisted Self-Supervised Learning for Few-shot Relation Reasoning

Few-shot relation reasoning on knowledge graphs (FS-KGR) aims to infer long-tail data-poor relations, which has drawn increasing attention these years due to its practicalities. The pre-training of previous methods needs to manually construct the meta-relation set, leading to numerous labor costs. Self-supervised learning (SSL) is treated as a solution to tackle the issue, but still at an early stage for FS-KGR task. Moreover, most of the existing methods ignore leveraging the beneficial information from aliasing relations (AR), i.e., data-rich relations with similar contextual semantics to the target data-poor relation. Therefore, we proposed a novel Self-Supervised Learning model by leveraging Aliasing Relations to assist FS-KGR, termed SARF. Concretely, four main components are designed in our model, i.e., SSL reasoning module, AR-assisted mechanism, fusion module, and scoring function. We first generate the representation of the co-occurrence patterns in a generative manner. Meanwhile, the representations of aliasing relations are learned to enhance reasoning in the AR-assist mechanism. Besides, multiple strategies, i.e., simple summation and learnable fusion, are offered for representation fusion. Finally, the generated representation is used for scoring. Extensive experiments on three few-shot benchmarks demonstrate that SARF achieves state-of-the-art performance compared with other methods in most cases.

cs.LG↗

arXiv2023

Charge order driven by multiple-Q spin fluctuations in heavily electron-doped iron selenide superconductors

Intertwined spin and charge orders have been widely studied in high-temperature superconductors, since their fluctuations may facilitate electron pairing; however, they are rarely identified in heavily electron-doped iron selenides. Here, using scanning tunneling microscopy, we show that when the superconductivity of (Li0.84Fe0.16OH)Fe1-xSe is suppressed by introducing Fe-site defects, a short-ranged checkerboard charge order emerges, propagating along the Fe-Fe directions with an approximately 2aFe period. It persists throughout the whole phase space tuned by Fe-site defect density, from a defect-pinned local pattern in optimally doped samples to an extended order in samples with lower Tc or non-superconducting. Intriguingly, our simulations indicate that the charge order is likely driven by multiple-Q spin density waves originating from the spin fluctuations observed by inelastic neutron scattering. Our study proves the presence of a competing order in heavily electron-doped iron selenides, and demonstrates the potential of charge order as a tool to detect spin fluctuations.

cond-mat.supr-con↗