arXiv subjects

Hao Wu

Publications and source records attributed to Hao Wu.

At least 613 records · Page 34Linked to original sources

arXiv2022

MoQuad: Motion-focused Quadruple Construction for Video Contrastive Learning

Learning effective motion features is an essential pursuit of video representation learning. This paper presents a simple yet effective sample construction strategy to boost the learning of motion features in video contrastive learning. The proposed method, dubbed Motion-focused Quadruple Construction (MoQuad), augments the instance discrimination by meticulously disturbing the appearance and motion of both the positive and negative samples to create a quadruple for each video instance, such that the model is encouraged to exploit motion information. Unlike recent approaches that create extra auxiliary tasks for learning motion features or apply explicit temporal modelling, our method keeps the simple and clean contrastive learning paradigm (i.e.,SimCLR) without multi-task learning or extra modelling. In addition, we design two extra training strategies by analyzing initial MoQuad experiments. By simply applying MoQuad to SimCLR, extensive experiments show that we achieve superior performance on downstream tasks compared to the state of the arts. Notably, on the UCF-101 action recognition task, we achieve 93.7% accuracy after pre-training the model on Kinetics-400 for only 200 epochs, surpassing various previous methods

cs.CV↗

arXiv2022

A Communication Optimal Transport Approach to the Computation of Rate Distortion Functions

In this paper, we propose a new framework named Communication Optimal Transport (CommOT) for computing the rate distortion (RD) function. This work is motivated by observing the fact that the transition law and the relative entropy in communication theory can be viewed as the transport plan and the regularized objective function in the optimal transport (OT) model. However, unlike in classical OT problems, the RD function only possesses one-side marginal distribution. Hence, to maintain the OT structure, we introduce slackness variables to fulfill the other-side marginal distribution and then propose a general framework (CommOT) for the RD function. The CommOT model is solved via the alternating optimization technique and the well-known Sinkhorn algorithm. In particular, the expected distortion threshold can be converted into finding the unique root of a one-dimensional monotonic function with only a few steps. Numerical experiments show that our proposed framework (CommOT) for solving the RD function with given distortion threshold is efficient and accurate.

cs.IT↗

arXiv2022

Online Handbook of Argumentation for AI: Volume 3

This volume contains revised versions of the papers selected for the third volume of the Online Handbook of Argumentation for AI (OHAAI). Previously, formal theories of argument and argument interaction have been proposed and studied, and this has led to the more recent study of computational models of argument. Argumentation, as a field within artificial intelligence (AI), is highly relevant for researchers interested in symbolic representations of knowledge and defeasible reasoning. The purpose of this handbook is to provide an open access and curated anthology for the argumentation research community. OHAAI is designed to serve as a research hub to keep track of the latest and upcoming PhD-driven research on the theory and application of argumentation in all areas related to AI.

cs.AI↗

arXiv2022

A Realizable GAS-based Quantum Algorithm for Traveling Salesman Problem

The paper proposes a quantum algorithm for the traveling salesman problem (TSP) based on the Grover Adaptive Search (GAS), which can be successfully executed on IBM's Qiskit library. Under the GAS framework, there are at least two fundamental difficulties that limit the application of quantum algorithms for combinatorial optimization problems. One difficulty is that the solutions given by the quantum algorithms may not be feasible. The other difficulty is that the number of qubits of current quantum computers is still very limited, and it cannot meet the minimum requirements for the number of qubits required by the algorithm. In response to the above difficulties, we designed and improved the Hamiltonian Cycle Detection (HCD) oracle based on mathematical theorems. It can automatically eliminate infeasible solutions during the execution of the algorithm. On the other hand, we design an anchor register strategy to save the usage of qubits. The strategy fully considers the reversibility requirement of quantum computing, overcoming the difficulty that the used qubits cannot be simply overwritten or released. As a result, we successfully implemented the numerical solution to TSP on IBM's Qiskit. For the seven-node TSP, we only need 31 qubits, and the success rate in obtaining the optimal solution is 86.71%.

quant-ph↗

arXiv2022

Superradiant Masing with Solid-state Spins at Room Temperature

Steady-state superradiance and superradiant lasing attract significant attentions in the field of optical lattice clocks, but have not been achieved so far due to the technical challenges and atom loss problem. In this article, we propose that their counter-part may be observed in the microwave domain with solid-state spins-microwave resonator systems at room temperature with realistic technical restrictions. To validate our proposal, we investigate systematically the system dynamics and steady-state by solving quantum master equations for the multi-level and multi-process dynamic of trillions of spins. To this end, we employ a mean-field approach, and convert the mean-field dynamics of the spin ensemble into the one in a more intuitive Dicke state picture. Our calculations show that for systems with nitrogen vacancy center spins and pentacene molecular spins the superradiant Rabi oscillations occur firstly due to transitions among different Dicke states, and the subsequent continuous-wave superradiant masing can achieve a linewidth well below millihertz. Our work may guide further exploration of transient and steady-state superradiant masing with the mentioned and other solid-state spins systems, such as silicon vacancy centers in silicon carbide and boron vacancy centers in hexagonal boron nitride, where the coherent radiation with ultra-narrow linewidth may find applications in deep-space communications, radio astronomy and high-precision metrology.

quant-ph↗

arXiv2022

An ADMM-Incorporated Latent Factorization of Tensors Method for QoS Prediction

As the Internet developed rapidly, it is important to choose suitable web services from a wide range of candidates. Quality of service (QoS) describes the performance of a web service dynamically with respect to the service requested by the service consumer. Moreover, the latent factorization of tenors (LFT) is very effective for discovering temporal patterns in high dimensional and sparse (HiDS) tensors. However, current LFT models suffer from a low convergence rate and rarely account for the effects of outliers. To address the above problems, this paper proposes an Alternating direction method of multipliers (ADMM)-based Outlier-Resilient Nonnegative Latent-factorization of Tensors model. We maintain the non-negativity of the model by constructing an augmented Lagrangian function with the ADMM optimization framework. In addition, the Cauchy function is taken as the metric function to reduce the impact on the model training. The empirical work on two dynamic QoS datasets shows that the proposed method has faster convergence and better performance on prediction accuracy.

cs.LG↗

arXiv2022

The Double Regularization Method for Capacity Constrained Optimal Transport

Capacity constrained optimal transport is a variant of optimal transport, which adds extra constraints on the set of feasible couplings in the original optimal transport problem to limit the mass transported between each pair of source and sink. Based on this setting, constrained optimal transport has numerous applications, e.g., finance, network flow. However, due to the large number of constraints in this problem, existing algorithms are both time-consuming and space-consuming. In this paper, inspired by entropic regularization for the classical optimal transport problem, we introduce a novel regularization term for capacity constrained optimal transport. The regularized problem naturally satisfies the capacity constraints and consequently makes it possible to analyze the duality. Unlike the matrix-vector multiplication in the alternate iteration scheme for solving classical optimal transport, in our algorithm, each alternate iteration step is to solve several single-variable equations. Fortunately, we find that each of these equations corresponds to a single-variable monotonic function, and we convert solving these equations into finding the unique zero point of each single-variable monotonic function with Newton's method. Extensive numerical experiments demonstrate that our proposed method has a significant advantage in terms of accuracy, efficiency, and memory consumption compared with existing methods.

math.OC↗

arXiv2022

RIS-assisted Scheduling for High-Speed Railway Secure Communications

With the rapid development of high-speed railway systems and railway wireless communication, the application of ultra-wideband millimeter wave band is an inevitable trend. However, the millimeter wave channel has large propagation loss and is easy to be blocked. Moreover, there are many problems such as eavesdropping between the base station (BS) and the train. As an emerging technology, reconfigurable intelligent surface (RIS) can achieve the effect of passive beamforming by controlling the propagation of the incident electromagnetic wave in the desired direction.We propose a RIS-assisted scheduling scheme for scheduling interrupted transmission and improving quality of service (QoS).In the propsed scheme, an RIS is deployed between the BS and multiple mobile relays (MRs). By jointly optimizing the beamforming vector and the discrete phase shift of the RIS, the constructive interference between direct link signals and indirect link signals can be achieved, and the channel capacity of eavesdroppers is guaranteed to be within a controllable range. Finally, the purpose of maximizing the number of successfully scheduled tasks and satisfying their QoS requirements can be practically realized. Extensive simulations demonstrate that the proposed scheme has superior performance regarding the number of completed tasks and the system secrecy capacity over four baseline schemes in literature.

cs.IT↗

arXiv2022

LEAP: TrustZone Based Developer-Friendly TEE for Intelligent Mobile Apps

ARM TrustZone is widely deployed on commercial-off-the-shelf mobile devices for secure execution. However, many Apps cannot enjoy this feature because it brings many constraints to App developers. Previous works have been proposed to build a secure execution environment for developers on top of TrustZone. Unfortunately, these works are still not fully-fledged solutions for mobile Apps, especially for emerging intelligent Apps. To this end, we propose LEAP, which is a lightweight developer-friendly TEE solution for mobile Apps. LEAP enables isolated codes to execute in parallel and access peripheral (e.g., mobile GPUs) with ease, flexibly manages system resources upon different workloads, and offers the auto DevOps tool to help developers prepare the codes running on it. We implement the LEAP prototype on the off-the-shelf ARM platform and conduct extensive experiments on it. The experimental results show that Apps can be adapted to run with LEAP easily and efficiently. Compared to the state-of-the-art work along this research line, LEAP can achieve an average 3.57x speedup in supporting intelligent Apps using mobile GPU acceleration.

cs.CR↗

arXiv2022

Move aside pentacene: Diazapentacene doped para-terphenyl as a zero-field room-temperature maser with strong coupling for cavity quantum electrodynamics

Masers, the microwave analogue of lasers, promise to deliver ultra-low noise amplification of microwave signals for use in medical MRI imaging and deep-space communication. Research on masers in modern times was rekindled thanks to the discovery of gain media that were operable at room-temperature, eschewing bulky cryogenics that hindered their use. However, besides the two known materials of pentacene doped in para-terphenyl and negatively-charged nitrogen-vacancy defects in diamond, there has been scarce progress in the search for completely new room-temperature gain media. Here we show the discovery of 6,13-diazapentacene doped in para-terphenyl as a maser gain medium that can operate at room-temperature and without an external magnetic field. A measured maser pulse power of -10 dBm shows it is on par with pentacene-doped para-terphenyl in absolute power, while possessing compelling advantages against its pentacene predecessor in that it has a faster amplification startup time, can be excited with longer wavelength light at 620 nm and enjoys greater chemical stability from added nitrogen groups. Furthermore, we show that the maser bursts allow 6,13-diazapentacene-doped para-terphenyl to reach the strong coupling regime for cavity quantum electrodynamics, where it has a high cooperativity of 182. We study the optical and microwave spin dynamics of 6,13-diazapentacene-doped para-terphenyl in order to evaluate its behavior as a maser gain medium, where it features fast intersystem crossing and an advantageously higher triplet quantum yield. Our results pave the way for the future discovery of other similar maser materials and help point to such materials as promising candidates for the study of cavity quantum electrodynamic effects at room-temperature.

quant-ph↗

arXiv2022

Room-Temperature Spin-Valve Effect in Fe$_3$GaTe$_2$/MoS$_2$/Fe$_3$GaTe$_2$ 2D van der Waals Heterojunction Devices

Spin-valve effect has been the focus of spintronics over the last decades due to its potential in many spintronic devices. Two-dimensional (2D) van der Waals (vdW) materials are highly expected to build the spin-valve heterojunction. However, the Curie temperatures (TC) of the vdW ferromagnetic 2D crystals are mostly below room temperature (~30-220 K). It is very challenging to develop room temperature, ferromagnetic (FM) 2D crystals based spin-valve devices which are still not available to date. We report the first room temperature, FM 2D crystal based all-2D vdW Fe3GaTe2/MoS2/Fe3GaTe2 spin valve devices. The Magnetoresistance (MR) of the all- devices is up to 15.89% at 2.3 K and 11.97% at 10 K, 4-30 times of MR from the spin valves of Fe$_3$GaTe$_2$/MoS$_2$/Fe$_3$GaTe$_2$ and conventional NiFe/MoS$_2$/NiFe. Typical spin valve effect shows strong dependence on MoS2 spacer thickness in the vdW heterojunction. Importantly, the spin valve effect (0.31%) still robustly exists at 300 K with low working currents down to 10 nA (0.13 A/cm$^2$). The results provide a general vdW platform to room temperature, 2D FM crystals based 2D spin valve devices.

cond-mat.mes-hall↗

arXiv2022

A Labelled Sequent Calculus for Public Announcement Logic

Public announcement logic(PAL) is an extension of epistemic logic (EL) with some reduction axioms. In this paper, we propose a cut-free labelled sequent calculus for PAL, which is an extension of that for EL with sequent rules adapted from the reduction axioms. This calculus admits cut and allows terminating proof search.

cs.LO↗

arXiv2022

Crossing Probabilities of Multiple Ising Interfaces

We prove that in the scaling limit, the crossing probabilities of multiple interfaces in the critical planar Ising model with alternating boundary conditions are conformally invariant expressions given by the pure partition functions of multiple SLE(κ) with κ=3. In particular, this identifies the scaling limits with ratios of specific correlation functions of conformal field theory.

math-ph↗

arXiv2022

Prediction for the synthesis cross sections of new moscovium isotopes in fusion-evaporation reactions

In the framework of the dinuclear system model, the synthesis mechanism of the superheavy nuclides with atomic number $Z=112, 114, 115$ in the reactions of projectiles $^{40,48}$Ca bombarding on targets $^{238}$U, $^{242}$Pu, and $^{243}$Am at a wide incident energies (excitation energy from 0-100 MeV) have been investigated systematically. Based on the available experimental excitation functions, the dependence of calculated synthesis cross sections on collision orientations has been studied thoroughly. The TKEs of these collisions with the fixed collision orientation show its orientation dependence which can be used to predict the tendency of kinetic energy diffusion. The TKEs are dependent on incident energies which have been discussed. The method of Coulomb barrier distribution function has been applied in our calculations which could treat all of the collision orientations from the tip-tip to side-side approximately. The calculations of excitation functions of $^{48}$Ca + $^{238}$U, $^{48}$Ca + $^{242}$Pu, and $^{48}$Ca + $^{243}$Am have a nice agreement with the available experimental data. The isospin effect of projectiles on production cross sections of moscovium isotopes and the influence of entrance channel effect on the synthesis cross sections of superheavy nuclei have been discussed. The synthesis cross section of new moscovium isotopes $^{278-286}$Mc have been predicted as large as hundreds pb, in the fusion-evaporation reactions of $^{35,37}$Cl + $^{248}$Cf, $^{38,40}$Ar + $^{247}$Bk, $^{39,41}$K + $^{247}$Cm, $^{40,42,44,46}$Ca + $^{238}$Am, $^{45}$Sc + $^{242}$Pu, and $^{46,48,50}$Ti + $^{243}$Np, $^{51}$V + $^{238}$U at the excitation energy interval of 0-100 MeV.

nucl-th↗

arXiv2022

Track Targets by Dense Spatio-Temporal Position Encoding

In this work, we propose a novel paradigm to encode the position of targets for target tracking in videos using transformers. The proposed paradigm, Dense Spatio-Temporal (DST) position encoding, encodes spatio-temporal position information in a pixel-wise dense fashion. The provided position encoding provides location information to associate targets across frames beyond appearance matching by comparing objects in two bounding boxes. Compared to the typical transformer positional encoding, our proposed encoding is applied to the 2D CNN features instead of the projected feature vectors to avoid losing positional information. Moreover, the designed DST encoding can represent the location of a single-frame object and the evolution of the location of the trajectory among frames uniformly. Integrated with the DST encoding, we build a transformer-based multi-object tracking model. The model takes a video clip as input and conducts the target association in the clip. It can also perform online inference by associating existing trajectories with objects from the new-coming frames. Experiments on video multi-object tracking (MOT) and multi-object tracking and segmentation (MOTS) datasets demonstrate the effectiveness of the proposed DST position encoding.

cs.CV↗

arXiv2022

Enhancing Spatiotemporal Prediction Model using Modular Design and Beyond

Predictive learning uses a known state to generate a future state over a period of time. It is a challenging task to predict spatiotemporal sequence because the spatiotemporal sequence varies both in time and space. The mainstream method is to model spatial and temporal structures at the same time using RNN-based or transformer-based architecture, and then generates future data by using learned experience in the way of auto-regressive. The method of learning spatial and temporal features simultaneously brings a lot of parameters to the model, which makes the model difficult to be convergent. In this paper, a modular design is proposed, which decomposes spatiotemporal sequence model into two modules: a spatial encoder-decoder and a predictor. These two modules can extract spatial features and predict future data respectively. The spatial encoder-decoder maps the data into a latent embedding space and generates data from the latent space while the predictor forecasts future embedding from past. By applying the design to the current research and performing experiments on KTH-Action and MovingMNIST datasets, we both improve computational performance and obtain state-of-the-art results.

cs.CV↗

arXiv2022

FP8 Formats for Deep Learning

FP8 is a natural progression for accelerating deep learning training inference beyond the 16-bit formats common in modern processors. In this paper we propose an 8-bit floating point (FP8) binary interchange format consisting of two encodings - E4M3 (4-bit exponent and 3-bit mantissa) and E5M2 (5-bit exponent and 2-bit mantissa). While E5M2 follows IEEE 754 conventions for representatio of special values, E4M3's dynamic range is extended by not representing infinities and having only one mantissa bit-pattern for NaNs. We demonstrate the efficacy of the FP8 format on a variety of image and language tasks, effectively matching the result quality achieved by 16-bit training sessions. Our study covers the main modern neural network architectures - CNNs, RNNs, and Transformer-based models, leaving all the hyperparameters unchanged from the 16-bit baseline training sessions. Our training experiments include large, up to 175B parameter, language models. We also examine FP8 post-training-quantization of language models trained using 16-bit formats that resisted fixed point int8 quantization.

cs.LG↗

arXiv2022

Stochastic approximation to MBAR and TRAM: batch-wise free energy estimation

The dynamics of molecules are governed by rare event transitions between long-lived (metastable) states. To explore these transitions efficiently, many enhanced sampling protocols have been introduced that involve using simulations with biases or changed temperatures. Two established statistically optimal estimators for obtaining unbiased equilibrium properties from such simulations are the multistate Bennett Acceptance Ratio (MBAR) and the transition-based reweighting analysis method (TRAM). Both MBAR and TRAM are solved iteratively and can suffer from long convergence times. Here we introduce stochastic approximators (SA) for both estimators, resulting in SAMBAR and SATRAM, which are shown to converge faster than their deterministic counterparts, without significant accuracy loss. Both methods are demonstrated on different molecular systems.

physics.chem-ph↗