arXiv Science⌕ Search

arXiv subjects

Qing Wang

Publications and source records attributed to Qing Wang.

At least 217 records · Page 12Linked to original sources
arXiv2023

MP-MVS: Multi-Scale Windows PatchMatch and Planar Prior Multi-View Stereo

Significant strides have been made in enhancing the accuracy of Multi-View Stereo (MVS)-based 3D reconstruction. However, untextured areas with unstable photometric consistency often remain incompletely reconstructed. In this paper, we propose a resilient and effective multi-view stereo approach (MP-MVS). We design a multi-scale windows PatchMatch (mPM) to obtain reliable depth of untextured areas. In contrast with other multi-scale approaches, which is faster and can be easily extended to PatchMatch-based MVS approaches. Subsequently, we improve the existing checkerboard sampling schemes by limiting our sampling to distant regions, which can effectively improve the efficiency of spatial propagation while mitigating outlier generation. Finally, we introduce and improve planar prior assisted PatchMatch of ACMP. Instead of relying on photometric consistency, we utilize geometric consistency information between multi-views to select reliable triangulated vertices. This strategy can obtain a more accurate planar prior model to rectify photometric consistency measurements. Our approach has been tested on the ETH3D High-res multi-view benchmark with several state-of-the-art approaches. The results demonstrate that our approach can reach the state-of-the-art. The associated codes will be accessible at https://github.com/RongxuanTan/MP-MVS.

cs.CV↗
arXiv2023

Learning Segment Similarity and Alignment in Large-Scale Content Based Video Retrieval

With the explosive growth of web videos in recent years, large-scale Content-Based Video Retrieval (CBVR) becomes increasingly essential in video filtering, recommendation, and copyright protection. Segment-level CBVR (S-CBVR) locates the start and end time of similar segments in finer granularity, which is beneficial for user browsing efficiency and infringement detection especially in long video scenarios. The challenge of S-CBVR task is how to achieve high temporal alignment accuracy with efficient computation and low storage consumption. In this paper, we propose a Segment Similarity and Alignment Network (SSAN) in dealing with the challenge which is firstly trained end-to-end in S-CBVR. SSAN is based on two newly proposed modules in video retrieval: (1) An efficient Self-supervised Keyframe Extraction (SKE) module to reduce redundant frame features, (2) A robust Similarity Pattern Detection (SPD) module for temporal alignment. In comparison with uniform frame extraction, SKE not only saves feature storage and search time, but also introduces comparable accuracy and limited extra computation time. In terms of temporal alignment, SPD localizes similar segments with higher accuracy and efficiency than existing deep learning methods. Furthermore, we jointly train SSAN with SKE and SPD and achieve an end-to-end improvement. Meanwhile, the two key modules SKE and SPD can also be effectively inserted into other video retrieval pipelines and gain considerable performance improvements. Experimental results on public datasets show that SSAN can obtain higher alignment accuracy while saving storage and online query computational cost compared to existing methods.

cs.CV↗
arXiv2023

SIDNet: Learning Shading-aware Illumination Descriptor for Image Harmonization

Image harmonization aims at adjusting the appearance of the foreground to make it more compatible with the background. Without exploring background illumination and its effects on the foreground elements, existing works are incapable of generating a realistic foreground shading. In this paper, we decompose the image harmonization task into two sub-problems: 1) illumination estimation of the background image and 2) re-rendering of foreground objects under background illumination. Before solving these two sub-problems, we first learn a shading-aware illumination descriptor via a well-designed neural rendering framework, of which the key is a shading bases module that generates multiple shading bases from the foreground image. Then we design a background illumination estimation module to extract the illumination descriptor from the background. Finally, the Shading-aware Illumination Descriptor is used in conjunction with the neural rendering framework (SIDNet) to produce the harmonized foreground image containing a novel harmonized shading. Moreover, we construct a photo-realistic synthetic image harmonization dataset that contains numerous shading variations with image-based lighting. Extensive experiments on both synthetic and real data demonstrate the superiority of the proposed method, especially in dealing with foreground shadings.

cs.CV↗
arXiv2023

Hierarchical Audio-Visual Information Fusion with Multi-label Joint Decoding for MER 2023

In this paper, we propose a novel framework for recognizing both discrete and dimensional emotions. In our framework, deep features extracted from foundation models are used as robust acoustic and visual representations of raw video. Three different structures based on attention-guided feature gathering (AFG) are designed for deep feature fusion. Then, we introduce a joint decoding structure for emotion classification and valence regression in the decoding stage. A multi-task loss based on uncertainty is also designed to optimize the whole process. Finally, by combining three different structures on the posterior probability level, we obtain the final predictions of discrete and dimensional emotions. When tested on the dataset of multimodal emotion recognition challenge (MER 2023), the proposed framework yields consistent improvements in both emotion classification and valence regression. Our final system achieves state-of-the-art performance and ranks third on the leaderboard on MER-MULTI sub-challenge.

eess.AS↗
arXiv2023

Timbre-reserved Adversarial Attack in Speaker Identification

As a type of biometric identification, a speaker identification (SID) system is confronted with various kinds of attacks. The spoofing attacks typically imitate the timbre of the target speakers, while the adversarial attacks confuse the SID system by adding a well-designed adversarial perturbation to an arbitrary speech. Although the spoofing attack copies a similar timbre as the victim, it does not exploit the vulnerability of the SID model and may not make the SID system give the attacker's desired decision. As for the adversarial attack, despite the SID system can be led to a designated decision, it cannot meet the specified text or speaker timbre requirements for the specific attack scenarios. In this study, to make the attack in SID not only leverage the vulnerability of the SID model but also reserve the timbre of the target speaker, we propose a timbre-reserved adversarial attack in the speaker identification. We generate the timbre-reserved adversarial audios by adding an adversarial constraint during the different training stages of the voice conversion (VC) model. Specifically, the adversarial constraint is using the target speaker label to optimize the adversarial perturbation added to the VC model representations and is implemented by a speaker classifier joining in the VC model training. The adversarial constraint can help to control the VC model to generate the speaker-wised audio. Eventually, the inference of the VC model is the ideal adversarial fake audio, which is timbre-reserved and can fool the SID system.

cs.SD↗
arXiv2023

PT-Symmetric Quantum Field Theory in Path Integral Formalism and Arbitrariness Problem

Perturbative PT-symmetric quantum field theories with anti-Hermitian and P-odd interaction terms are studied in path integral formalism and the i phi^3 model is calculated in detail. The nonlocal field transformation induced by the C operator and corresponding transformations to Hermitian theories are given systematically, which are manifestly 4-dimensional invariant. It is found that the i phi^3 model can be transformed into infinitely many physically inequivalent Hermitian theories with different S matrices under above nonlocal transformations. Similar problem caused by nonlocal tranformations in Hermitian quantum field theories is also discussed. 0-dimensional models are studied numerically to verify the validity of those transformations. We put forward the question of physical meaning of PT-symmetric quantum field theory based on the arbitrariness caused by the seemingly inevitable nonlocality.

hep-th↗
arXiv2023

Incorporating Connectivity among Internet Search Data for Enhanced Influenza-like Illness Tracking

Big data collected from the Internet possess great potential to reveal the ever-changing trends in society. In particular, accurate infectious disease tracking with Internet data has grown in popularity, providing invaluable information for public health decision makers and the general public. However, much of the complex connectivity among the Internet search data is not effectively addressed among existing disease tracking frameworks. To this end, we propose ARGO-C (Augmented Regression with Clustered GOogle data), an integrative, statistically principled approach that incorporates the clustering structure of Internet search data to enhance the accuracy and interpretability of disease tracking. Focusing on multi-resolution %ILI (influenza-like illness) tracking, we demonstrate the improved performance and robustness of ARGO-C over benchmark methods at various geographical resolutions. We also highlight the adaptability of ARGO-C to track various diseases in addition to influenza, and to track other social or economic trends.

stat.AP↗
arXiv2023

Accelerating large-eddy simulations of clouds with Tensor Processing Units

Clouds, especially low clouds, are crucial for regulating Earth's energy balance and mediating the response of the climate system to changes in greenhouse gas concentrations. Despite their importance for climate, they remain relatively poorly understood and are inaccurately represented in climate models. A principal reason is that the high computational expense of simulating them with large-eddy simulations (LES) has inhibited broad and systematic numerical experimentation and the generation of large datasets for training parametrization schemes for climate models. Here we demonstrate LES of low clouds on Tensor Processing Units (TPUs), application-specific integrated circuits that were originally developed for machine learning applications. We show that TPUs in conjunction with tailored software implementations can be used to simulate computationally challenging stratocumulus clouds in conditions observed during the Dynamics and Chemistry of Marine Stratocumulus (DYCOMS) field study. The TPU-based LES code successfully reproduces clouds during DYCOMS and opens up the large computational resources available on TPUs to cloud simulations. The code enables unprecedented weak and strong scaling of LES, making it possible, for example, to simulate stratocumulus with $10\times$ speedup over real-time evolution in domains with a $34.7~\mathrm{km} \times 53.8~\mathrm{km}$ horizontal cross section. The results open up new avenues for computational experiments and for substantially enlarging the sample of LES available to train parameterizations of low clouds.

physics.ao-ph↗
arXiv2023

Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks

With the growing popularity of electric vehicles (EVs), maintaining power grid stability has become a significant challenge. To address this issue, EV charging control strategies have been developed to manage the switch between vehicle-to-grid (V2G) and grid-to-vehicle (G2V) modes for EVs. In this context, multi-agent deep reinforcement learning (MADRL) has proven its effectiveness in EV charging control. However, existing MADRL-based approaches fail to consider the natural power flow of EV charging/discharging in the distribution network and ignore driver privacy. To deal with these problems, this paper proposes a novel approach that combines multi-EV charging/discharging with a radial distribution network (RDN) operating under optimal power flow (OPF) to distribute power flow in real time. A mathematical model is developed to describe the RDN load. The EV charging control problem is formulated as a Markov Decision Process (MDP) to find an optimal charging control strategy that balances V2G profits, RDN load, and driver anxiety. To effectively learn the optimal EV charging control strategy, a federated deep reinforcement learning algorithm named FedSAC is further proposed. Comprehensive simulation results demonstrate the effectiveness and superiority of our proposed algorithm in terms of the diversity of the charging control strategy, the power fluctuations on RDN, the convergence efficiency, and the generalization ability.

eess.SY↗
arXiv2023

Decentralized Threshold Signatures with Dynamically Private Accountability

Threshold signatures are a fundamental cryptographic primitive used in many practical applications. As proposed by Boneh and Komlo (CRYPTO'22), TAPS is a threshold signature that is a hybrid of privacy and accountability. It enables a combiner to combine t signature shares while revealing nothing about the threshold t or signing quorum to the public and asks a tracer to track a signature to the quorum that generates it. However, TAPS has three disadvantages: it 1) structures upon a centralized model, 2) assumes that both combiner and tracer are honest, and 3) leaves the tracing unnotarized and static. In this work, we introduce Decentralized, Threshold, dynamically Accountable and Private Signature (DeTAPS) that provides decentralized combining and tracing, enhanced privacy against untrusted combiners (tracers), and notarized and dynamic tracing. Specifically, we adopt Dynamic Threshold Public-Key Encryption (DTPKE) to dynamically notarize the tracing process, design non-interactive zero knowledge proofs to achieve public verifiability of notaries, and utilize the Key-Aggregate Searchable Encryption to bridge TAPS and DTPKE so as to awaken the notaries securely and efficiently. In addition, we formalize the definitions and security requirements for DeTAPS. Then we present a generic construction and formally prove its security and privacy. To evaluate the performance, we build a prototype based on SGX2 and Ethereum.

cs.CR↗
arXiv2023

The FlySpeech Audio-Visual Speaker Diarization System for MISP Challenge 2022

This paper describes the FlySpeech speaker diarization system submitted to the second \textbf{M}ultimodal \textbf{I}nformation Based \textbf{S}peech \textbf{P}rocessing~(\textbf{MISP}) Challenge held in ICASSP 2022. We develop an end-to-end audio-visual speaker diarization~(AVSD) system, which consists of a lip encoder, a speaker encoder, and an audio-visual decoder. Specifically, to mitigate the degradation of diarization performance caused by separate training, we jointly train the speaker encoder and the audio-visual decoder. In addition, we leverage the large-data pretrained speaker extractor to initialize the speaker encoder.

cs.SD↗
arXiv2023

Highly Tunable Perpendicular Magnetic Anisotropy and Anisotropic Magnetoresistance in Ru-doped La0.67Sr0.33MnO3 Epitaxial Films

As a prototypical half-metallic ferromagnet, La0.67Sr0.33MnO3 (LSMO) has been extensively studied due to its versatile physical properties and great potential in spintronic applications. However, the weak perpendicular magnetic anisotropy (PMA) limits the controllability and detection of magnetism in LSMO, thus hindering the realization of oxide-based spintronic devices with low energy consumption and high integration level. Motivated by this challenge, we develop an experimental approach to enhance the PMA of LSMO epitaxial films. By cooperatively introducing 4d Ru doping and a moderate compressive strain, the maximum uniaxial magnetic anisotropy in Ru-doped LSMO can reach 3.0 to 1E5 J/m3 at 10 K. Furthermore, we find a significant anisotropic magnetoresistance effect in these Ru-doped LSMO films, which is dominated by the strong PMA. Our findings offer an effective pathway to harness and detect the orientations of magnetic moments in LSMO films, thus promoting the feasibility of oxide-based spintronic devices, such as spin valves and magnetic tunnel junctions.

cond-mat.mtrl-sci↗
arXiv2023

Ru doping induced spin frustration and enhancement of the room-temperature anomalous Hall effect in La2/3Sr1/3MnO3 films

In transition-metal-oxide heterostructures, the anomalous Hall effect (AHE) is a powerful tool for detecting the magnetic state and revealing intriguing interfacial magnetic orderings. However, achieving a larger AHE at room temperature in oxide heterostructures is still challenging due to the dilemma of mutually strong spin-orbit coupling and magnetic exchange interactions. Here, we exploit the Ru doping-enhanced AHE in LSMRO epitaxial films. As the B-site Ru doping level increases up to 20 percent, the anomalous Hall resistivity at room temperature can be enhanced from nOhmcm to uOhmcm scale. Ru doping leads to strong competition between ferromagnetic double-exchange interaction and antiferromagnetic super-exchange interaction. The resultant spin frustration and spin-glass state facilitate a strong skew-scattering process, thus significantly enhancing the extrinsic AHE. Our findings could pave a feasible approach for boosting the controllability and reliability of oxide-based spintronic devices.

cond-mat.mtrl-sci↗
arXiv2023

Pressure Tuned 2D Superconductivity in Black Phosphorus

This paper examines the micro-parameters of superconductors. It studies the modulations from weak van der Waals interaction to strong covalence bonding of superconductors. In particular, we studied layered black phosphorus (BP) as a function of pressure. These results reveal a rich scenario of phase transitions and related quantum phenomena, which show that the phases exhibit superconducting states at a pressure higher than 5.0 GPa. In addition, they indicate an angle-dependent upper critical field that demonstrates the dimensional characteristics of superconductivities. This result suggests that the A17 and cubic phases are three-dimensional (3D). The A7 phase shows a two-dimensional (2D) character. The 2D behavior is related to a weakened, distorted, entangled interlayer coupling.

cond-mat.supr-con↗
arXiv2023

A High-resolution Large-eddy Simulation Framework for Wildland Fire Predictions using TensorFlow

As the impact of wildfires has become increasingly more severe over the last decades, there is continued pressure for improvements in our ability to predict wildland fire behavior over a wide range of conditions. One approach towards this goal is through coupled fire/atmosphere modeling tools. While significant progress has been made on advancing their physical fidelity, existing modeling tools have not taken full advantage of emerging programming paradigms and computing architectures to enable high-resolution wildfire simulations. By addressing this gap, this work presents a new wildfire simulation framework that enables landscape-scale wildfire simulations with physical representation of the combustion at affordable computational cost. This is achieved by developing a coupled fire/atmosphere model in the TensorFlow programming paradigm, which enables highly efficient and scalable computations on Tensor Processing Unit (TPU) hardware architecture. To validate this simulation framework and demonstrate its efficiency, simulations of the prescribed fire experiment FireFlux II (Clements et al., 2019) are performed. By considering a parametric study on the mesh resolution, we show that the global quantities such as volumetric heat release and fire-spread rate are insensitive to the horizontal mesh resolution within a range between 0.5 m and 2 m, which is sufficient for predicting fire intermittency and dynamic fire properties associated with fine-scale turbulent structures in the atmospheric boundary layer.

physics.flu-dyn↗
arXiv2023

Vertex algebras and TKK algebras

In this paper, we associate the TKK algebra $\widehat{\mathcal{G}}(\mathcal{J})$ with vertex algebras through twisted modules. Firstly, we prove that for any complex number $\ell$, the category of restricted $\widehat{\mathcal{G}}(\mathcal{J})$-modules of level $\ell$ is canonically isomorphic to the category of $σ$-twisted $V_{\widehat{\mathcal{C}_{\mathfrak g}}}(\ell,0)$-modules, where $V_{\widehat{\mathcal{C}_{\mathfrak g}}}(\ell,0)$ is a vertex algebra arising from the toroidal Lie algebra of type $C_2$ and $σ$ is an isomorphism of $V_{\widehat{\mathcal{C}_{\mathfrak g}}}(\ell,0)$ induced from the involution of this toroidal Lie algebra. Secondly, we prove that for any nonnegative integer $\ell$, the integrable restricted $\widehat{\mathcal{G}}(\mathcal{J})$-modules of level $\ell$ are exactly the $σ$-twisted modules for the quotient vertex algebra $L_{\widehat{\mathcal{C}_{\mathfrak g}}}(\ell,0)$ of $V_{\widehat{\mathcal{C}_{\mathfrak g}}}(\ell,0)$. Finally, we classify the irreducible $\frac{1}{2}{\mathbb{N}}$-graded $σ$-twisted $L_{\widehat{\mathcal{C}_{\mathfrak g}}}(\ell,0)$-modules.

math.QA↗
arXiv2023

A Unified Object Counting Network with Object Occupation Prior

The counting task, which plays a fundamental role in numerous applications (e.g., crowd counting, traffic statistics), aims to predict the number of objects with various densities. Existing object counting tasks are designed for a single object class. However, it is inevitable to encounter newly coming data with new classes in our real world. We name this scenario as \textit{evolving object counting}. In this paper, we build the first evolving object counting dataset and propose a unified object counting network as the first attempt to address this task. The proposed model consists of two key components: a class-agnostic mask module and a class-incremental module. The class-agnostic mask module learns generic object occupation prior via predicting a class-agnostic binary mask (e.g., 1 denotes there exists an object at the considering position in an image and 0 otherwise). The class-incremental module is used to handle new coming classes and provides discriminative class guidance for density map prediction. The combined outputs of class-agnostic mask module and image feature extractor are used to predict the final density map. When new classes come, we first add new neural nodes into the last regression and classification layers of class-incremental module. Then, instead of retraining the model from scratch, we utilize knowledge distillation to help the model remember what have already learned about previous object classes. We also employ a support sample bank to store a small number of typical training samples of each class, which are used to prevent the model from forgetting key information of old data. With this design, our model can efficiently and effectively adapt to new coming classes while keeping good performance on already seen data without large-scale retraining. Extensive experiments on the collected dataset demonstrate the favorable performance.

cs.CV↗
arXiv2023

Performance and Reliability Analysis for Practical Byzantine Fault Tolerance with Repairable Voting Nodes

The practical Byzantine fault tolerant (PBFT) consensus protocol is one of the basic consensus protocols in the development of blockchain technology. At the same time, the PBFT consensus protocol forms a basis for some other important BFT consensus protocols, such as Tendermint, Streamlet, HotStuff, and LibraBFT. In general, the voting nodes may always fail so that they can leave the PBFT-based blockchain system in a random time interval, making the number of timely available voting nodes uncertain. Thus, this uncertainty leads to the analysis of the PBFT-based blockchain systems with repairable voting nodes being more challenging. In this paper, we develop a novel PBFT consensus protocol with repairable voting nodes and study such a new blockchain system using a multi-dimensional Markov process and the first passage time method. Based on this, we provide performance and reliability analysis, including throughput, availability, and reliability, for the new PBFT-based blockchain system with repairable voting nodes. Furthermore, we provide an approximate algorithm for computing the throughput of the new PBFT-based blockchain system. We employ numerical examples to demonstrate the validity of our theoretical results and illustrate how the key system parameters influence performance measures of the PBFT-based blockchain system with repairable voting nodes. We hope the methodology and results developed in this paper will stimulate future research endeavors and open up new research trajectories in this field.

cs.PF↗