arXiv subjects

Ziqing Wang

Publications and source records attributed to Ziqing Wang.

51 records · Page 3Linked to original sources

arXiv2024

Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networks

Spiking Neural Networks (SNNs) have emerged as a promising energy-efficient alternative to traditional Artificial Neural Networks (ANNs). Despite this, bridging the performance gap with ANNs in practical scenarios remains a significant challenge. This paper focuses on addressing the dual objectives of enhancing the performance and efficiency of SNNs through the established SNN Calibration conversion framework. Inspired by the biological nervous system, we propose a novel Adaptive-Firing Neuron Model (AdaFire) that dynamically adjusts firing patterns across different layers, substantially reducing conversion errors within limited timesteps. Moreover, to meet our efficiency objectives, we propose two novel strategies: an Sensitivity Spike Compression (SSC) technique and an Input-aware Adaptive Timesteps (IAT) technique. These techniques synergistically reduce both energy consumption and latency during the conversion process, thereby enhancing the overall efficiency of SNNs. Extensive experiments demonstrate our approach outperforms state-of-the-art SNNs methods, showcasing superior performance and efficiency in 2D, 3D, and event-driven classification, as well as object detection and segmentation tasks.

cs.CV↗

arXiv2023

AutoST: Training-free Neural Architecture Search for Spiking Transformers

Spiking Transformers have gained considerable attention because they achieve both the energy efficiency of Spiking Neural Networks (SNNs) and the high capacity of Transformers. However, the existing Spiking Transformer architectures, derived from Artificial Neural Networks (ANNs), exhibit a notable architectural gap, resulting in suboptimal performance compared to their ANN counterparts. Manually discovering optimal architectures is time-consuming. To address these limitations, we introduce AutoST, a training-free NAS method for Spiking Transformers, to rapidly identify high-performance Spiking Transformer architectures. Unlike existing training-free NAS methods, which struggle with the non-differentiability and high sparsity inherent in SNNs, we propose to utilize Floating-Point Operations (FLOPs) as a performance metric, which is independent of model computations and training dynamics, leading to a stronger correlation with performance. Our extensive experiments show that AutoST models outperform state-of-the-art manually or automatically designed SNN architectures on static and neuromorphic datasets. Full code, model, and data are released for reproduction.

cs.NE↗

arXiv2023

Spiking Denoising Diffusion Probabilistic Models

Spiking neural networks (SNNs) have ultra-low energy consumption and high biological plausibility due to their binary and bio-driven nature compared with artificial neural networks (ANNs). While previous research has primarily focused on enhancing the performance of SNNs in classification tasks, the generative potential of SNNs remains relatively unexplored. In our paper, we put forward Spiking Denoising Diffusion Probabilistic Models (SDDPM), a new class of SNN-based generative models that achieve high sample quality. To fully exploit the energy efficiency of SNNs, we propose a purely Spiking U-Net architecture, which achieves comparable performance to its ANN counterpart using only 4 time steps, resulting in significantly reduced energy consumption. Extensive experimental results reveal that our approach achieves state-of-the-art on the generative tasks and substantially outperforms other SNN-based generative models, achieving up to 12x and 6x improvement on the CIFAR-10 and the CelebA datasets, respectively. Moreover, we propose a threshold-guided strategy that can further improve the performances by 2.69% in a training-free manner. The SDDPM symbolizes a significant advancement in the field of SNN generation, injecting new perspectives and potential avenues of exploration. Our code is available at https://github.com/AndyCao1125/SDDPM.

cs.NE↗

arXiv2023

AMD-DBSCAN: An Adaptive Multi-density DBSCAN for datasets of extremely variable density

DBSCAN has been widely used in density-based clustering algorithms. However, with the increasing demand for Multi-density clustering, previous traditional DSBCAN can not have good clustering results on Multi-density datasets. In order to address this problem, an adaptive Multi-density DBSCAN algorithm (AMD-DBSCAN) is proposed in this paper. An improved parameter adaptation method is proposed in AMD-DBSCAN to search for multiple parameter pairs (i.e., Eps and MinPts), which are the key parameters to determine the clustering results and performance, therefore allowing the model to be applied to Multi-density datasets. Moreover, only one hyperparameter is required for AMD-DBSCAN to avoid the complicated repetitive initialization operations. Furthermore, the variance of the number of neighbors (VNN) is proposed to measure the difference in density between each cluster. The experimental results show that our AMD-DBSCAN reduces execution time by an average of 75% due to lower algorithm complexity compared with the traditional adaptive algorithm. In addition, AMD-DBSCAN improves accuracy by 24.7% on average over the state-of-the-art design on Multi-density datasets of extremely variable density, while having no performance loss in Single-density scenarios. Our code and datasets are available at https://github.com/AlexandreWANG915/AMD-DBSCAN.

cs.DB↗

arXiv2023

Masked Spiking Transformer

The combination of Spiking Neural Networks (SNNs) and Transformers has attracted significant attention due to their potential for high energy efficiency and high-performance nature. However, existing works on this topic typically rely on direct training, which can lead to suboptimal performance. To address this issue, we propose to leverage the benefits of the ANN-to-SNN conversion method to combine SNNs and Transformers, resulting in significantly improved performance over existing state-of-the-art SNN models. Furthermore, inspired by the quantal synaptic failures observed in the nervous system, which reduces the number of spikes transmitted across synapses, we introduce a novel Masked Spiking Transformer (MST) framework that incorporates a Random Spike Masking (RSM) method to prune redundant spikes and reduce energy consumption without sacrificing performance. Our experimental results demonstrate that the proposed MST model achieves a significant reduction of 26.8% in power consumption when the masking ratio is 75% while maintaining the same level of performance as the unmasked model.

cs.NE↗

arXiv2021

Parallel and real-time post-processing for quantum random number generators

Quantum random number generators (QRNG) based on continuous variable (CV) quantum fluctuations offer great potential for their advantages in measurement bandwidth, stability and integrability. More importantly, it provides an efficient and extensible path for significant promotion of QRNG generation rate. During this process, real-time randomness extraction using information theoretically secure randomness extractors is vital, because it plays critical role in the limit of throughput rate and implementation cost of QRNGs. In this work, we investigate parallel and real-time realization of several Toeplitz-hashing extractors within one field-programmable gate array (FPGA) for parallel QRNG. Elaborate layout of Toeplitz matrixes and efficient utilization of hardware computing resource in the FPGA are emphatically studied. Logic source occupation for different scale and quantity of Toeplitz matrices is analyzed and two-layer parallel pipeline algorithm is delicately designed to fully exploit the parallel algorithm advantage and hardware source of the FPGA. This work finally achieves a real-time post-processing rate of QRNG above 8 Gbps. Matching up with integrated circuit for parallel extraction of multiple quantum sideband modes of vacuum state, our demonstration shows an important step towards chip-based parallel QRNG, which could effectively improve the practicality of CV QRNGs, including device trusted, device-independent, and semi-device-independent schemes.

quant-ph↗

arXiv2021

Temporal Modes of Light in Satellite-to-Earth Quantum Communications

The photonic Temporal Mode (TM) represents a possible candidate for the delivery of viable multidimensional quantum communications. However, relative to other multidimensional quantum information carriers such as the Orbital Angular Momentum (OAM), the TM has received less attention. Moreover, in the context of the emerging quantum internet and satellite-based quantum communications, the TM has received no attention. In this work, we remedy this situation by considering the traversal through the satellite-to-Earth channel of single photons encoded in TM space. Our results indicate that for anticipated atmospheric conditions the photonic TM offers a promising avenue for the delivery of high-throughput quantum communications from a satellite to a terrestrial receiver. In particular, we show how these modes can provide for improved multiplexing performance and superior quantum key distribution in the satellite-to-Earth channel, relative to OAM single-photon states. The levels of TM discrimination that guarantee this outcome are outlined and implications of our results for the emerging satellite-based quantum internet are discussed.

quant-ph↗

arXiv2021

Video-Based Inpatient Fall Risk Assessment: A Case Study

Inpatient falls are a serious safety issue in hospitals and healthcare facilities. Recent advances in video analytics for patient monitoring provide a non-intrusive avenue to reduce this risk through continuous activity monitoring. However, in-bed fall risk assessment systems have received less attention in the literature. The majority of prior studies have focused on fall event detection, and do not consider the circumstances that may indicate an imminent inpatient fall. Here, we propose a video-based system that can monitor the risk of a patient falling, and alert staff of unsafe behaviour to help prevent falls before they occur. We propose an approach that leverages recent advances in human localisation and skeleton pose estimation to extract spatial features from video frames recorded in a simulated environment. We demonstrate that body positions can be effectively recognised and provide useful evidence for fall risk assessment. This work highlights the benefits of video-based models for analysing behaviours of interest, and demonstrates how such a system could enable sufficient lead time for healthcare professionals to respond and address patient needs, which is necessary for the development of fall intervention programs.

cs.CV↗

arXiv2021

Enhanced Uplink Quantum Communication with Satellites via Downlink Channels

In developing the global Quantum Internet, quantum communication with low-Earth-orbit satellites will play a pivotal role. Such communication will need to be two way: effective not only in the satellite-to-ground (downlink) channel but also in the ground-to-satellite channel (uplink). Given that losses on this latter channel are significantly larger relative to the former, techniques that can exploit the superior downlink to enhance quantum communication in the uplink should be explored. In this work we do just that - exploring how continuous variable entanglement in the form of two-mode squeezed vacuum (TMSV) states can be used to significantly enhance the fidelity of ground-to-satellite quantum-state transfer relative to direct uplink-transfer. More specifically, through detailed phase-screen simulations of beam evolution through turbulent atmospheres in both the downlink and uplink channels, we demonstrate how a TMSV teleportation channel created by the satellite can be used to dramatically improve the fidelity of uplink coherent-state transfer relative to direct transfer. We then show how this, in turn, leads to the uplink-transmission of a higher alphabet of coherent states. Additionally, we show how non-Gaussian operations acting on the received component of the TMSV state at the ground station can lead to even further enhancement. Since TMSV states can be readily produced in situ on a satellite platform and form a reliable teleportation channel for most quantum states, our work suggests future satellites forming part of the emerging Quantum Internet should be designed with uplink-communication via TMSV teleportation in mind.

quant-ph↗

arXiv2020

Satellite-to-Earth Quantum Key Distribution via Orbital Angular Momentum

In this work, we explore the feasibility of performing satellite-to-Earth quantum key distribution (QKD) using the orbital angular momentum (OAM) of light. Due to the fragility of OAM states the conventional wisdom is that turbulence would render OAM-QKD non-viable in a satellite-to-Earth channel. However, based on detailed phase screen simulations of the anticipated atmospheric turbulence we find that OAM-QKD is viable in some system configurations, especially if quantum channel information is utilized in the processing of post-selected states. More specifically, using classically entangled light as a probe of the quantum channel, and reasonably-sized transmitter-receiver apertures, we find that non-zero QKD rates are achievable on sea-level ground stations. Without using classical light probes, OAM-QKD is relegated to high-altitude ground stations with large receiver apertures. Our work represents the first quantitative assessment of the performance of OAM-QKD from satellites, showing under what circumstances the much-touted higher dimensionality of OAM can be utilized in the context of secure communications.

quant-ph↗

arXiv2019

Detecting Orbital Angular Momentum of Light in Satellite-to-Ground Quantum Communications

Satellite-based quantum communications enable a bright future for global-scale information security. However, the spin orbital momentum of light, currently used in many mainstream quantum communication systems, only allows for quantum encoding in a two-dimensional Hilbert space. The orbital angular momentum (OAM) of light, on the other hand, enables quantum encoding in higher-dimensional Hilbert spaces, opening up new opportunities for high-capacity quantum communications. Due to its turbulence-induced decoherence effects, however, the atmospheric channel may limit the practical usage of OAM. In order to determine whether OAM is useful for satellite-based quantum communications, we numerically investigate the detection likelihoods for OAM states that traverse satellite-to-ground channels. We show that the use of OAM through such channels is in fact feasible. We use our new results to then investigate design specifications that could improve OAM detection - particularly the use of advanced adaptive optics techniques. Finally, we discuss how our work provides new insights into future implementations of space-based OAM systems within the context of quantum communications.

quant-ph↗

arXiv2019

Artificial Intelligence and Location Verification in Vehicular Networks

Location information claimed by devices will play an ever-increasing role in future wireless networks such as 5G, the Internet of Things (IoT). Against this background, the verification of such claimed location information will be an issue of growing importance. A formal information-theoretic Location Verification System (LVS) can address this issue to some extent, but such a system usually operates within the limits of idealistic assumptions on a-priori information on the proportion of genuine users in the field. In this work we address this critical limitation by using a Neural Network (NN) showing how such a NN based LVS is capable of efficiently functioning even when the proportion of genuine users is completely unknown a-priori. We demonstrate the improved performance of this new form of LVS based on Time of Arrival measurements from multiple verifying base stations within the context of vehicular networks, quantifying how our NN-LVS outperforms the stand-alone information-theoretic LVS in a range of anticipated real-world conditions. We also show the efficient performance for the NN-LVS when the users' signals have added Non-Line-of-Site (NLoS) bias in them. This new LVS can be applied to a range of location-centric applications within the domain of the IoT.

eess.SP↗

arXiv2019

Inter-satellite Quantum Key Distribution at Terahertz Frequencies

Terahertz (THz) communication is a topic of much research in the context of high-capacity next-generation wireless networks. Quantum communication is also a topic of intensive research, most recently in the context of space-based deployments. In this work we explore the use of THz frequencies as a means to achieve quantum communication within a constellation of micro-satellites in Low-Earth-Orbit (LEO). Quantum communication between the micro-satellite constellation and high-altitude terrestrial stations is also investigated. Our work demonstrates that THz quantum entanglement distribution and THz quantum key distribution are viable deployment options in the micro-satellite context. We discuss how such deployment opens up the possibility for simpler integration of global quantum and wireless networks. The possibility of using THz frequencies for quantum-radar applications in the context of LEO deployments is briefly discussed.

quant-ph↗

arXiv2011

A new cooperation mechanism of kinesin motors when extracting membrane tube

Membrane tubes are important elements for living cells to organize many functions. Experiments have found that membrane tube can be extracted from giant lipid vesicles by a group of kinesin. How these motors cooperate in extracting the fluid-like membrane tube is still unclear. In this paper, we propose a new cooperation mechanism called two-track-dumbbell model, in which kinesin is regarded as a dumbbell with an end (tail domain) tightly bound onto the fluid-like membrane and the other end (head domain) stepping on or unbinding from the microtubule. Taking account of the elasticity of kinesin molecule and the exclude volume effect of both the head domain and the tail domain of kinesin, which are not considered in previous models, we simulate the growth process of the membrane tube pulled by kinesin motors. Our results indicate that motors along a single microtubule protofilament can generate enough force to extract membrane tubes from vesicles, and the average number of motors pulling the tube is about 8~9. These results are quite different from previous studies (Ref. \cite{camp.08}), and further experimental tests are necessary to elucidate the cooperation mechanism.

physics.bio-ph↗

arXiv2009

Force-velocity relations for multiple-molecular-motor transport

A transition rate model of cargo transport by $N$ molecular motors is proposed. Under the assumption of steady state, the force-velocity curve of multi-motor system can be derived from the force-velocity curve of single motor. Our work shows, in the case of low load, the velocity of multi-motor system can decrease or increase with increasing motor number, which is dependent on the single motor force-velocity curve. And most commonly, the velocity decreases. This gives a possible explanation to some recent

physics.bio-ph↗