arXiv Science⌕ Search

arXiv subjects

Hui Chen

Publications and source records attributed to Hui Chen.

At least 271 records · Page 15Linked to original sources

Ruleformer: Context-aware Differentiable Rule Mining over Knowledge Graph

Rule mining is an effective approach for reasoning over knowledge graph (KG). Existing works mainly concentrate on mining rules. However, there might be several rules that could be applied for reasoning for one relation, and how to select appropriate rules for completion of different triples has not been discussed. In this paper, we propose to take the context information into consideration, which helps select suitable rules for the inference tasks. Based on this idea, we propose a transformer-based rule mining approach, Ruleformer. It consists of two blocks: 1) an encoder extracting the context information from subgraph of head entities with modified attention mechanism, and 2) a decoder which aggregates the subgraph information from the encoder output and generates the probability of relations for each step of reasoning. The basic idea behind Ruleformer is regarding rule mining process as a sequence to sequence task. To make the subgraph a sequence input to the encoder and retain the graph structure, we devise a relational attention mechanism in Transformer. The experiment results show the necessity of considering these information in rule mining task and the effectiveness of our model.

cs.LO↗

DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification

This paper proposes a simple yet effective interpolation-based data augmentation approach termed DoubleMix, to improve the robustness of models in text classification. DoubleMix first leverages a couple of simple augmentation operations to generate several perturbed samples for each training data, and then uses the perturbed data and original data to carry out a two-step interpolation in the hidden space of neural models. Concretely, it first mixes up the perturbed data to a synthetic sample and then mixes up the original data and the synthetic perturbed data. DoubleMix enhances models' robustness by learning the "shifted" features in hidden space. On six text classification benchmark datasets, our approach outperforms several popular text augmentation methods including token-level, sentence-level, and hidden-level data augmentation techniques. Also, experiments in low-resource settings show our approach consistently improves models' performance when the training data is scarce. Extensive ablation studies and case studies confirm that each component of our approach contributes to the final performance and show that our approach exhibits superior performance on challenging counterexamples. Additionally, visual analysis shows that text features generated by our approach are highly interpretable. Our code for this paper can be found at https://github.com/declare-lab/DoubleMix.git.

cs.CL↗

Titanium-based kagome superconductor CsTi_3Bi_5 and topological states

Since the discovery of a new family of vanadium-based kagome superconductor AV3Sb5 (A=K, Rb, and Cs) with topological band structures, extensive effort has been devoted to exploring the origin of superconducting states and the intertwined orders. Meanwhile, searching for new types of superconductors with novel physical properties and higher superconducting transition temperatures has always been a major thread in the history of superconductor research. Here we report a successful fabrication and the topological states of a Titanium-based kagome metal CsTi3Bi5 (CT3B5) crystal. The as-grown CT3B5 crystal is of high quality and possesses a perfect two-dimensional kagome net of Titanium. The superconductivity of the CT3B5 crystal shows that the critical temperature Tc is of ~4.8 K. First-principle calculations predict that the CT3B5 has robust topological surface states, implying that CT3B5 is a Z2 topological kagome superconductor. This finding provides a new type of superconductors and the base for exploring the origin of superconductivity and topological states in kagome superconductors.

cond-mat.supr-con↗

You Only Search Once: On Lightweight Differentiable Architecture Search for Resource-Constrained Embedded Platforms

Benefiting from the search efficiency, differentiable neural architecture search (NAS) has evolved as the most dominant alternative to automatically design competitive deep neural networks (DNNs). We note that DNNs must be executed under strictly hard performance constraints in real-world scenarios, for example, the runtime latency on autonomous vehicles. However, to obtain the architecture that meets the given performance constraint, previous hardware-aware differentiable NAS methods have to repeat a plethora of search runs to manually tune the hyper-parameters by trial and error, and thus the total design cost increases proportionally. To resolve this, we introduce a lightweight hardware-aware differentiable NAS framework dubbed LightNAS, striving to find the required architecture that satisfies various performance constraints through a one-time search (i.e., \underline{\textit{you only search once}}). Extensive experiments are conducted to show the superiority of LightNAS over previous state-of-the-art methods.

cs.LG↗

Doppler Exploitation in Bistatic mmWave Radio SLAM

Networks in 5G and beyond utilize millimeter wave (mmWave) radio signals, large bandwidths, and large antenna arrays, which bring opportunities in jointly localizing the user equipment and mapping the propagation environment, termed as simultaneous localization and mapping (SLAM). Existing approaches mainly rely on delays and angles, and ignore the Doppler, although it contains geometric information. In this paper, we study the benefits of exploiting Doppler in SLAM through deriving the posterior Cramér-Rao bounds (PCRBs) and formulating the extended Kalman-Poisson multi-Bernoulli sequential filtering solution with Doppler as one of the involved measurements. Both theoretical PCRB analysis and simulation results demonstrate the efficacy of utilizing Doppler.

eess.SP↗

FAT: An In-Memory Accelerator with Fast Addition for Ternary Weight Neural Networks

Convolutional Neural Networks (CNNs) demonstrate excellent performance in various applications but have high computational complexity. Quantization is applied to reduce the latency and storage cost of CNNs. Among the quantization methods, Binary and Ternary Weight Networks (BWNs and TWNs) have a unique advantage over 8-bit and 4-bit quantization. They replace the multiplication operations in CNNs with additions, which are favoured on In-Memory-Computing (IMC) devices. IMC acceleration for BWNs has been widely studied. However, though TWNs have higher accuracy and better sparsity than BWNs, IMC acceleration for TWNs has limited research. TWNs on existing IMC devices are inefficient because the sparsity is not well utilized, and the addition operation is not efficient. In this paper, we propose FAT as a novel IMC accelerator for TWNs. First, we propose a Sparse Addition Control Unit, which utilizes the sparsity of TWNs to skip the null operations on zero weights. Second, we propose a fast addition scheme based on the memory Sense Amplifier to avoid the time overhead of both carry propagation and writing back the carry to memory cells. Third, we further propose a Combined-Stationary data mapping to reduce the data movement of activations and weights and increase the parallelism across memory columns. Simulation results show that for addition operations at the Sense Amplifier level, FAT achieves 2.00X speedup, 1.22X power efficiency, and 1.22X area efficiency compared with a State-Of-The-Art IMC accelerator ParaPIM. FAT achieves 10.02X speedup and 12.19X energy efficiency compared with ParaPIM on networks with 80% average sparsity.

cs.AR↗

Bi-Static Sensing for Near-Field RIS Localization

We address the localization of a reconfigurable intelligent surface (RIS) for a single-input single-output multi-carrier system using bi-static sensing between a fixed transmitter and a fixed receiver. Due to the deployment of RISs with a large dimension, near-field (NF) scenarios are likely to occur, especially for indoor applications, and are the focus of this work. We first derive the Cramer-Rao bounds (CRBs) on the estimation error of the RIS position and orientation and the time of arrival (TOA) for the path transmitter-RIS-receiver. We propose a multi-stage low-complexity estimator for RIS localization purposes. In this proposed estimator, we first perform a line search to estimate the TOA. Then, we use the far-field approximation of the NF signal model to implicitly estimate the angle of arrival and the angle of departure at the RIS center. Finally, the RIS position and orientation estimate are refined via a quasi-Newton method. Simulation results reveal that the proposed estimator can attain the CRBs. We also investigate the effects of several influential factors on the accuracy of the proposed estimator like the RIS size, transmitted power, system bandwidth, and RIS position and orientation.

eess.SP↗

High-Capacity Rechargeable $Li/Cl_2$ Batteries with Graphite Positive Electrodes

Developing new types of high-capacity and high-energy density rechargeable battery is important to future generations of consumer electronics, electric vehicles, and mass energy storage applications. Recently we reported ~ 3.5 V sodium/chlorine $(Na/Cl_2)$ and lithium/chlorine $(Li/Cl_2)$ batteries with up to 1200 mAh $g^{-1}$ reversible capacity, using either a Na or Li metal as the negative electrode, an amorphous carbon nanosphere (aCNS) as the positive electrode, and aluminum chloride $(AlCl_3)$ dissolved in thionyl chloride $(SOCl_2)$ with fluoride-based additives as the electrolyte. The high surface area and large pore volume of aCNS in the positive electrode facilitated NaCl or LiCl deposition and trapping of $Cl_2$ for reversible $NaCl/Cl_2$ or $LiCl/Cl_2$ redox reactions and battery discharge/charge cycling. Here we report an initially low surface area/porosity graphite (DGr) material as the positive electrode in a $Li/Cl_2$ battery, attaining high battery performance after activation in carbon dioxide $(CO_2)$ at 1000 °C (DGr_ac) with the first discharge capacity ~ 1910 mAh $g^{-1}$ and a cycling capacity up to 1200 mAh $g^{-1}$. Ex situ Raman spectroscopy and X-ray diffraction (XRD) revealed the evolution of graphite over battery cycling, including intercalation/de-intercalation and exfoliation that generated sufficient pores for hosting $LiCl/Cl_2$ redox. This work opens up widely available, low-cost graphitic materials for high-capacity alkali metal/$Cl_2$ batteries. Lastly, we employed mass spectrometry to probe the $Cl_2$ trapped in the graphitic positive electrode, shedding light into the $Li/Cl_2$ battery operation.

physics.app-ph↗

Channel Model Mismatch Analysis for XL-MIMO Systems from a Localization Perspective

Radio localization is applied in high-frequency (e.g., mmWave and THz) systems to support communication and to provide location-based services without extra infrastructure. {For solving localization problems, a simplified, stationary, narrowband far-field channel model is widely used due to its compact formulation.} However, with increased array size in extra-large MIMO systems and increased bandwidth at upper mmWave bands, the effect of channel spatial non-stationarity (SNS), spherical wave model (SWM), and beam squint effect (BSE) cannot be ignored. In this case, localization performance will be affected when an inaccurate channel model deviating from the true model is adopted. In this work, we employ the MCRB (misspecified Cramér-Rao lower bound) to lower bound the localization error using a simplified mismatched model while the observed data is governed by a more complex true model. The simulation results show that among all the model impairments, the SNS has the least contribution, the SWM dominates when the distance is small compared to the array size, and the BSE has a more significant effect when the distance is much larger than the array size.

eess.SP↗

Doppler-Enabled Single-Antenna Localization and Mapping Without Synchronization

Radio localization is a key enabler for joint communication and sensing in the fifth/sixth generation (5G/6G) communication systems. With the help of multipath components (MPCs), localization and mapping tasks can be done with a single base station (BS) and single unsynchronized user equipment (UE) if both of them are equipped with an antenna array. However, the antenna array at the UE side increases the hardware and computational cost, preventing localization functionality. In this work, we show that with Doppler estimation and MPCs, localization and mapping tasks can be performed even with a single-antenna mobile UE. Furthermore, we show that the localization and mapping performance will improve and then saturate at a certain level with an increased UE speed. Both theoretical Cramér-Rao bound analysis and simulation results show the potential of localization under mobility and the effectiveness of the proposed localization algorithm.

eess.SP↗

MCRB-based Performance Analysis of 6G Localization under Hardware Impairments

Location information is expected to be the key to meeting the needs of communication and context-aware services in 6G systems. User localization is achieved based on delay and/or angle estimation using uplink or downlink pilot signals. However, hardware impairments (HWIs) distort the signals at both the transmitter and receiver sides and thus affect the localization performance. While this impact can be ignored at lower frequencies where HWIs are less severe, modeling and analysis efforts are needed for 6G to evaluate the localization degradation due to HWIs. In this work, we model various types of impairments and conduct a misspecified Cramér-Rao bound analysis to evaluate the HWI-induced performance loss. Simulation results with different types of HWIs show that each HWI leads to a different level of degradation in angle and delay estimation performance.

eess.SP↗

6G Radio Requirements to Support Integrated Communication, Localization, and Sensing

6G will be characterized by extreme use cases, not only for communication, but also for localization, and sensing. The use cases can be directly mapped to requirements in terms of standard key performance indicators (KPIs), such as data rate, latency, or localization accuracy. The goal of this paper is to go one step further and map these standard KPIs to requirements on signals, on hardware architectures, and on deployments. Based on this, system solutions can be identified that can support several use cases simultaneously. Since there are several ways to meet the KPIs, there is no unique solution and preferable configurations will be discussed.

eess.SP↗

Antenna Selection in Switch-Based MIMO Arrays via DOA threshold region Approximation

Direction-of-arrival (DOA) information is vital for multiple-input-multiple-output (MIMO) systems to complete localization and beamforming tasks. Switched antenna arrays have recently emerged as an effective solution to reduce the cost and power consumption of MIMO systems. Switch-based array architectures connect a limited number of radio frequency chains to a subset of the antenna elements forming a subarray. This paper addresses the problem of antenna selection to optimize DOA estimation performance. We first perform a subarray layout alignment process to remove subarrays with identical beampatterns and create a unique subarray set. By using this set, and based on a DOA threshold region performance approximation, we propose two antenna selection algorithms; a greedy algorithm and a deep-learning-based algorithm. The performance of the proposed algorithms is evaluated numerically. The results show a significant performance improvement over selected benchmark approaches in terms of DOA estimation in the threshold region and computational complexity.

eess.SP↗

Bridging the Gap between Reality and Ideality of Entity Matching: A Revisiting and Benchmark Re-Construction

Entity matching (EM) is the most critical step for entity resolution (ER). While current deep learningbased methods achieve very impressive performance on standard EM benchmarks, their realworld application performance is much frustrating. In this paper, we highlight that such the gap between reality and ideality stems from the unreasonable benchmark construction process, which is inconsistent with the nature of entity matching and therefore leads to biased evaluations of current EM approaches. To this end, we build a new EM corpus and re-construct EM benchmarks to challenge critical assumptions implicit in the previous benchmark construction process by step-wisely changing the restricted entities, balanced labels, and single-modal records in previous benchmarks into open entities, imbalanced labels, and multimodal records in an open environment. Experimental results demonstrate that the assumptions made in the previous benchmark construction process are not coincidental with the open environment, which conceal the main challenges of the task and therefore significantly overestimate the current progress of entity matching. The constructed benchmarks and code are publicly released

cs.CL↗

OntoED: Low-resource Event Detection with Ontology Embedding

Event Detection (ED) aims to identify event trigger words from a given text and classify it into an event type. Most of current methods to ED rely heavily on training instances, and almost ignore the correlation of event types. Hence, they tend to suffer from data scarcity and fail to handle new unseen event types. To address these problems, we formulate ED as a process of event ontology population: linking event instances to pre-defined event types in event ontology, and propose a novel ED framework entitled OntoED with ontology embedding. We enrich event ontology with linkages among event types, and further induce more event-event correlations. Based on the event ontology, OntoED can leverage and propagate correlation knowledge, particularly from data-rich to data-poor event types. Furthermore, OntoED can be applied to new unseen event types, by establishing linkages to existing ones. Experiments indicate that OntoED is more predominant and robust than previous approaches to ED, especially in data-scarce scenarios.

cs.IR↗

Constrained Wrapped Least Squares: A Tool for High Accuracy GNSS Attitude Determination

Attitude determination is a popular application of Global Navigation Satellite Systems (GNSS). Many methods have been developed to solve the attitude determination problem with different performance offerings. We develop a constrained wrapped least-squares (C-WLS) method for high-accuracy attitude determination. This approach is built on an optimization model that leverages prior information related to the antenna array and the integer nature of the carrier-phase ambiguities in an innovative way. The proposed approach adopts an efficient search strategy to estimate the vehicle's attitude parameters using ambiguous carrier-phase observations directly, without requiring prior carrier-phase ambiguity fixing. The performance of the proposed method is evaluated via simulations and experimentally utilizing data collected using multiple GNSS receivers. The simulation and experimental results demonstrate excellent performance, with the proposed method outperforming the ambiguity function method, the constrained LAMBDA and multivariate constrained LAMBDA methods, three prominent attitude determination algorithms.

eess.SP↗

Ontology-enhanced Prompt-tuning for Few-shot Learning

Few-shot Learning (FSL) is aimed to make predictions based on a limited number of samples. Structured data such as knowledge graphs and ontology libraries has been leveraged to benefit the few-shot setting in various tasks. However, the priors adopted by the existing methods suffer from challenging knowledge missing, knowledge noise, and knowledge heterogeneity, which hinder the performance for few-shot learning. In this study, we explore knowledge injection for FSL with pre-trained language models and propose ontology-enhanced prompt-tuning (OntoPrompt). Specifically, we develop the ontology transformation based on the external knowledge graph to address the knowledge missing issue, which fulfills and converts structure knowledge to text. We further introduce span-sensitive knowledge injection via a visible matrix to select informative knowledge to handle the knowledge noise issue. To bridge the gap between knowledge and text, we propose a collective training algorithm to optimize representations jointly. We evaluate our proposed OntoPrompt in three tasks, including relation extraction, event extraction, and knowledge graph completion, with eight datasets. Experimental results demonstrate that our approach can obtain better few-shot performance than baselines.

cs.CL↗

Direct measurement of non-thermal electron acceleration from magnetically driven reconnection in a laboratory plasma

Magnetic reconnection is a ubiquitous astrophysical process that rapidly converts magnetic energy into some combination of plasma flow energy, thermal energy, and non-thermal energetic particles, including energetic electrons. Various reconnection acceleration mechanisms in different low-$β$ (plasma-to-magnetic pressure ratio) and collisionless environments have been proposed theoretically and studied numerically, including first- and second-order Fermi acceleration, betatron acceleration, parallel electric field acceleration along magnetic fields, and direct acceleration by the reconnection electric field. However, none of them have been heretofore confirmed experimentally, as the direct observation of non-thermal particle acceleration in laboratory experiments has been difficult due to short Debye lengths for \textit{in-situ} measurements and short mean free paths for \textit{ex-situ} measurements. Here we report the direct measurement of accelerated non-thermal electrons from low-$β$ magnetically driven reconnection in experiments using a laser-powered capacitor coil platform. We use kiloJoule lasers to drive parallel currents to reconnect MegaGauss-level magnetic fields in a quasi-axisymmetric geometry. The angular dependence of the measured electron energy spectrum and the resulting accelerated energies, supported by particle-in-cell simulations, indicate that the mechanism of direct electric field acceleration by the out-of-plane reconnection electric field is at work. Scaled energies using this mechanism show direct relevance to astrophysical observations. Our results therefore validate one of the proposed acceleration mechanisms by reconnection, and establish a new approach to study reconnection particle acceleration with laboratory experiments in relevant regimes.

physics.plasm-ph↗