arXiv subjects

Lu Liu

Publications and source records attributed to Lu Liu.

At least 163 records · Page 9Linked to original sources

arXiv2022

Distantly Supervised Relation Extraction via Recursive Hierarchy-Interactive Attention and Entity-Order Perception

Wrong-labeling problem and long-tail relations severely affect the performance of distantly supervised relation extraction task. Many studies mitigate the effect of wrong-labeling through selective attention mechanism and handle long-tail relations by introducing relation hierarchies to share knowledge. However, almost all existing studies ignore the fact that, in a sentence, the appearance order of two entities contributes to the understanding of its semantics. Furthermore, they only utilize each relation level of relation hierarchies separately, but do not exploit the heuristic effect between relation levels, i.e., higher-level relations can give useful information to the lower ones. Based on the above, in this paper, we design a novel Recursive Hierarchy-Interactive Attention network (RHIA) to further handle long-tail relations, which models the heuristic effect between relation levels. From the top down, it passes relation-related information layer by layer, which is the most significant difference from existing models, and generates relation-augmented sentence representations for each relation level in a recursive structure. Besides, we introduce a newfangled training objective, called Entity-Order Perception (EOP), to make the sentence encoder retain more entity appearance information. Substantial experiments on the popular (NYT) dataset are conducted. Compared to prior baselines, our RHIA-EOP achieves state-of-the-art performance in terms of precision-recall (P-R) curves, AUC, Top-N precision and other evaluation metrics. Insightful analysis also demonstrates the necessity and effectiveness of each component of RHIA-EOP.

cs.CL↗

arXiv2022

See further upon the giants: Quantifying intellectual lineage in science

Newton's centuries-old wisdom of standing on the shoulders of giants raises a crucial yet underexplored question: Out of all the prior works cited by a discovery, which one is its giant? Here, we develop a novel, discipline-independent method to identify the giant for any individual paper, allowing us to systematically examine the role and characteristics of giants in science. We find that across disciplines, about 95% of papers stand on the shoulders of giants, yet the weight of scientific progress rests on relatively few shoulders. Defining a new measure of giant index, we find that, while papers with high citations are more likely to be giants, for papers with the same citations, their giant index sharply predicts a paper's future impact and prize-winning probabilities. Giants tend to originate from both small and large teams, being either highly disruptive or highly developmental. And papers that did not have a giant but later became a giant tend to be home-run papers that are highly disruptive to science. Given the crucial importance of citation-based measures in science, the developed concept of giants may offer a useful new dimension in assessing scientific impact that goes beyond sheer citation counts.

cs.DL↗

arXiv2022

Irreducibility of enumerable betting strategies

We study the problem of whether a betting-strategy can be decomposed into an equivalent set of simpler betting-strategies, such as betting-strategies that bet on a restricted set of stages or bet on a restricted of favorable outcomes. We show that the class of effectively enumerable betting-strategies has irreducible members which cannot be decomposed into an equivalent set of simpler betting-strategies. We answer questions of Kastermans and Hitchcock by constructing a real on which no kastergale (which is a left-c.e. supermartingale whose favorable outcomes are effectively determined) succeeds, but some unrestricted left-c.e. supermartingale succeeds on it. We generalize a result of Muchnick by showing that there is a non-1-random real such that no muchgale (which is a left-c.e. supermartingale who does not bet on certain stages) succeeds on it. Our methodology is then used to obtain further irreducibility results, strongly supporting a conjecture that if a natural class of left-c.e. supermartingales defines 1-randomness, then a single member of that class can do so. In another word, the class of left-c.e. supermartingales cannot be reduced to a simpler, natural subclass of it. For example, we show that there is a non-1-random real such that no kastergale or muchgale succeeds on it.

math.PR↗

arXiv2022

FedProto: Federated Prototype Learning across Heterogeneous Clients

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in terms of data distribution, network latency, input/output space, and/or model architecture, which can easily lead to the misalignment of their local gradients. To improve the tolerance to heterogeneity, we propose a novel federated prototype learning (FedProto) framework in which the clients and server communicate the abstract class prototypes instead of the gradients. FedProto aggregates the local prototypes collected from different clients, and then sends the global prototypes back to all clients to regularize the training of local models. The training on each client aims to minimize the classification error on the local data while keeping the resulting local prototypes sufficiently close to the corresponding global ones. Moreover, we provide a theoretical analysis to the convergence rate of FedProto under non-convex objectives. In experiments, we propose a benchmark setting tailored for heterogeneous FL, with FedProto outperforming several recent FL approaches on multiple datasets.

cs.LG↗

arXiv2022

Experimental investigation of quantum uncertainty relations with classical shadows

The quantum component in uncertainty relation can be naturally characterized by the quantum coherence of a quantum state, which is of paramount importance in quantum information science. Here, we experimentally investigate quantum uncertainty relations construed with relative entropy of coherence, $l_1$ norm of coherence and coherence of formation. In stead of quantum state tomographic technology, we employ the classical shadow algorithm for the detection of lower bounds in quantum uncertainty relations. With an all optical setup, we prepare a family of quantum states whose purity can be fully controlled. We experimentally explore the tightness of various lower bounds in different reference bases on the prepared states. Our results indicate the tightness of quantum coherence lower bounds dependents on the reference bases as well as the purity of quantum state.

quant-ph↗

arXiv2022

Tailoring topological transition of anisotropic polaritons by interface engineering in biaxial crystals

Polaritons in polar biaxial crystals with extreme anisotropy offer a promising route to manipulate nanoscale light-matter interactions. The dynamical modulation of their dispersion is great significance for future integrated nano-optics but remains challenging. Here, we report a momentum-directed strategy, a coupling between the modes with extra momentum supported by the interface and in-plane hyperbolic polaritons, to tailor topological transitions of anisotropic polaritons in biaxial crystals. We experimentally demonstrate such tailored polaritons at the interface of heterostructures between graphene and α-phase molybdenum trioxide (α-MoO3). The interlayer coupling can be electrically modulated by changing the Fermi level in graphene, enabling a dynamic topological transition. More interestingly, we found that the topological transition occurs at a constant Fermi level when tuning the thickness of α-MoO3. The momentum-directed strategy implemented by interface engineering offers new insights for optical topological transitions, which may shed new light for programmable polaritonics, energy transfer and neuromorphic photonics.

physics.optics↗

arXiv2021

Recognizing Vector Graphics without Rasterization

In this paper, we consider a different data format for images: vector graphics. In contrast to raster graphics which are widely used in image recognition, vector graphics can be scaled up or down into any resolution without aliasing or information loss, due to the analytic representation of the primitives in the document. Furthermore, vector graphics are able to give extra structural information on how low-level elements group together to form high level shapes or structures. These merits of graphic vectors have not been fully leveraged in existing methods. To explore this data format, we target on the fundamental recognition tasks: object localization and classification. We propose an efficient CNN-free pipeline that does not render the graphic into pixels (i.e. rasterization), and takes textual document of the vector graphics as input, called YOLaT (You Only Look at Text). YOLaT builds multi-graphs to model the structural and spatial information in vector graphics, and a dual-stream graph neural network is proposed to detect objects from the graph. Our experiments show that by directly operating on vector graphics, YOLaT out-performs raster-graphic based object detection baselines in terms of both average precision and efficiency.

cs.CV↗

arXiv2021

CrSbSe3: a pseudo one-dimensional ferromagnetic semiconductor

Low-dimensional magnetic materials have attracted much attention due to their novel properties and high potential for spintronic applications. In this work, we study the electronic structure and magnetic properties of the pseudo one-dimensional compound CrSbSe$_3$, using density functional calculations, superexchange model analyses, and Monte Carlo simulations. We find that CrSbSe$_3$ is a ferromagnetic (FM) semiconductor with a band gap of about 0.65 eV. The FM couplings within each zig-zag spin chain are due to the Cr-Se-Cr superexchange with the near-90$^\circ$ bonds, and the inter-chain FM couplings are one order of magnitude weaker. By inclusion of the spin-orbit coupling (SOC) effects, our calculations reproduce the experimental observation of the easy magnetization $a$ axis and the hard $b$ axis (the spin-chain direction), with the calculated moderate magnetic anisotropy of 0.19 meV/Cr. Moreover, we identify the nearly equal contributions from the single ion anisotropy of Cr, and from the exchange anisotropy due to the strong SOC of the heavy elements Sb and Se and their couplings with Cr. Using the parameters of the magnetic coupling and anisotropy from the above calculations, our Monte Carlo simulations yield the Curie temperature $T_{\rm{C}}$ of 108 K.

cond-mat.mtrl-sci↗

arXiv2021

The reverse mathematics of the Thin set and Erdős-Moser theorems

The thin set theorem for $n$-tuples and $k$ colors ($\mathsf{TS}^n_k$) states that every $k$-coloring of $[\mathbb{N}]^n$ admits an infinite set of integers $H$ such that $[H]^n$ avoids at least one color. In this paper, we study the combinatorial weakness of the thin set theorem in reverse mathematics by proving neither $\mathsf{TS}^n_k$, nor the free set theorem ($\mathsf{FS}^n$) imply the Erdős-Moser theorem ($\mathsf{EM}$) whenever $k$ is sufficiently large (answering a question of Patey and giving a partial result towards a question of Cholak Giusto, Hirst and Jockusch). Given a problem $\mathsf{P}$, a computable instance of $\mathsf{P}$ is universal iff its solution computes a solution of any other computable $\mathsf{P}$-instance. It has been established that most of Ramsey-type problems do not have a universal instance, but the case of Erdős-Moser theorem remained open so far. We prove that Erdős-Moser theorem does not admit a universal instance (answering a question of Patey).

math.LO↗

arXiv2021

Distributed Optimal Output Consensus of Uncertain Nonlinear Multi-Agent Systems over Unbalanced Directed Networks via Output Feedback

In this note, a novel observer-based output feedback control approach is proposed to address the distributed optimal output consensus problem of uncertain nonlinear multi-agent systems in the normal form over unbalanced directed graphs. The main challenges of the concerned problem lie in unbalanced directed graphs and nonlinearities of multi-agent systems with their agent states not available for feedback control. Based on a two-layer controller structure, a distributed optimal coordinator is first designed to convert the considered problem into a reference-tracking problem. Then a decentralized output feedback controller is developed to stabilize the resulting augmented system. A high-gain observer is exploited in controller design to estimate the agent states in the presence of uncertainties and disturbances so that the proposed controller relies only on agent outputs. The semi-global convergence of the agent outputs toward the optimal solution that minimizes the sum of all local cost functions is proved under standard assumptions. A key feature of the obtained results is that the nonlinear agents under consideration are only required to be locally Lipschitz and possess globally asymptotically stable and locally exponentially stable zero dynamics.

eess.SY↗

arXiv2021

Optimal Output Consensus of Heterogeneous Linear Multi-Agent Systems Over Weight-Unbalanced Directed Networks

This paper investigates the distributed optimal output consensus problem of heterogeneous linear multi-agent systems over weight-unbalanced directed networks. A novel distributed continuous-time state feedback controller is proposed to steer the outputs of all the agents to converge to the optimal solution of the global cost function. Under the standard condition that the unbalanced digraph is strongly connected and the local cost functions are strongly convex with global Lipschitz gradients, the exponential convergence of the closed-loop multi-agent system is established. Then, the proposed state feedback control law is extended to an observer-based output feedback setting. Two examples are finally provided to illustrate the effectiveness of the proposed control schemes.

math.OC↗

arXiv2021

The masking condition for quantum state in two-dimensional Hilbert space

This paper focuses on quantum information masking for quantum state in two-dimensional Hilbert space. We present a system of equations as the condition of quantum information masking. It is shown that quantum information contained in a single qubit state can be masked, if and only if the coefficients of quantum state satisfy the given system of equations. By observing the characteristics of non-orthogonal maskable quantum states, we obtain a related conclusion, namely, if two non-orthogonal two-qubit quantum states can mask a single qubit state, they have the same number of terms and the same basis. Finally, for maskable orthogonal quantum states, we analyze two special examples and give their images for an intuitive description.

quant-ph↗

arXiv2021

Triaxial magnetic anisotropy in the two-dimensional ferromagnetic semiconductor CrSBr

Two-dimensional (2D) ferromagnets have recently drawn extensive attention, and here we study the electronic structure and magnetic properties of the bulk and monolayer of CrSBr, using first-principles calculations and Monte Carlo simulations. Our results show that bulk CrSBr is a magnetic semiconductor and has the easy magnetization b-axis, hard c-axis, and intermediate a-axis. Thus, the experimental triaxial magnetic anisotropy (MA) is well reproduced here, and it is identified to be the joint effects of spin-orbit coupling (SOC) and magnetic dipole-dipole interaction. We find that bulk CrSBr has a strong ferromagnetic (FM) intralayer coupling but a marginal interlayer one. We also study CrSBr monolayer in detail and find that the intralayer FM exchange persists and the shape anisotropy has a more pronounced contribution to the MA. Using the parameters of the FM exchange and the triaxial MA, our Monte Carlo simulations show that CrSBr monolayer has Curie temperature Tc = 175 K. Moreover, we find that a uniaxial tensile (compressive) strain along the a (b) axis would further increase the Tc.

cond-mat.mtrl-sci↗

arXiv2021

New Era of Deeplearning-Based Malware Intrusion Detection: The Malware Detection and Prediction Based On Deep Learning

With the development of artificial intelligence algorithms like deep learning models and the successful applications in many different fields, further similar trails of deep learning technology have been made in cyber security area. It shows the preferable performance not only in academic security research but also in industry practices when dealing with part of cyber security issues by deep learning methods compared to those conventional rules. Especially for the malware detection and classification tasks, it saves generous time cost and promotes the accuracy for a total pipeline of malware detection system. In this paper, we construct special deep neural network, ie, MalDeepNet (TB-Malnet and IB-Malnet) for malware dynamic behavior classification tasks. Then we build the family clustering algorithm based on deep learning and fulfil related testing. Except that, we also design a novel malware prediction model which could detect the malware coming in future through the Mal Generative Adversarial Network (Mal-GAN) implementation. All those algorithms present fairly considerable value in related datasets afterwards.

cs.CR↗

arXiv2021

Full-Cycle Energy Consumption Benchmark for Low-Carbon Computer Vision

The energy consumption of deep learning models is increasing at a breathtaking rate, which raises concerns due to potential negative effects on carbon neutrality in the context of global warming and climate change. With the progress of efficient deep learning techniques, e.g., model compression, researchers can obtain efficient models with fewer parameters and smaller latency. However, most of the existing efficient deep learning methods do not explicitly consider energy consumption as a key performance indicator. Furthermore, existing methods mostly focus on the inference costs of the resulting efficient models, but neglect the notable energy consumption throughout the entire life cycle of the algorithm. In this paper, we present the first large-scale energy consumption benchmark for efficient computer vision models, where a new metric is proposed to explicitly evaluate the full-cycle energy consumption under different model usage intensity. The benchmark can provide insights for low carbon emission when selecting efficient deep learning algorithms in different model usage scenarios.

cs.CV↗

arXiv2021

Cloning one's voice using very limited data in the wild

With the increasing popularity of speech synthesis products, the industry has put forward more requirements for personalized speech synthesis: (1) How to use low-resource, easily accessible data to clone a person's voice. (2) How to clone a person's voice while controlling the style and prosody. To solve the above two problems, we proposed the Hieratron model framework in which the prosody and timbre are modeled separately using two modules, therefore, the independent control of timbre and the other characteristics of audio can be achieved while generating speech. The practice shows that, for very limited target speaker data in the wild, Hieratron has obvious advantages over the traditional method, in addition to controlling the style and language of the generated speech, the mean opinion score on speech quality of the generated speech has also been improved by more than 0.2 points.

eess.AS↗

arXiv2021

Characterizing Transaction-Reverting Statements in Ethereum Smart Contracts

Smart contracts are programs running on blockchain to execute transactions. When input constraints or security properties are violated at runtime, the transaction being executed by a smart contract needs to be reverted to avoid undesirable consequences. On Ethereum, the most popular blockchain that supports smart contracts, developers can choose among three transaction-reverting statements (i.e., require, if...revert, and if...throw) to handle anomalous transactions. While these transaction-reverting statements are vital for preventing smart contracts from exhibiting abnormal behaviors or suffering malicious attacks, there is limited understanding of how they are used in practice. In this work, we perform the first empirical study to characterize transaction-reverting statements in Ethereum smart contracts. We measured the prevalence of these statements in 3,866 verified smart contracts from popular dapps and built a taxonomy of their purposes via manually analyzing 557 transaction-reverting statements. We also compared template contracts and their corresponding custom contracts to understand how developers customize the use of transaction-reverting statements. Finally, we analyzed the security impact of transaction-reverting statements by removing them from smart contracts and comparing the mutated contracts against the original ones. Our study led to important findings, which can shed light on further research in the broad area of smart contract quality assurance and provide practical guidance to smart contract developers on the appropriate use of transaction-reverting statements.

cs.CR↗

arXiv2021

Free Lunch for Few-shot Learning: Distribution Calibration

Learning from a limited number of samples is challenging since the learned model can easily become overfitted based on the biased distribution formed by only a few training examples. In this paper, we calibrate the distribution of these few-sample classes by transferring statistics from the classes with sufficient examples, then an adequate number of examples can be sampled from the calibrated distribution to expand the inputs to the classifier. We assume every dimension in the feature representation follows a Gaussian distribution so that the mean and the variance of the distribution can borrow from that of similar classes whose statistics are better estimated with an adequate number of samples. Our method can be built on top of off-the-shelf pretrained feature extractors and classification models without extra parameters. We show that a simple logistic regression classifier trained using the features sampled from our calibrated distribution can outperform the state-of-the-art accuracy on two datasets (~5% improvement on miniImageNet compared to the next best). The visualization of these generated features demonstrates that our calibrated distribution is an accurate estimation.

cs.LG↗