arXiv subjects

Ping Wang

Publications and source records attributed to Ping Wang.

At least 145 records · Page 8Linked to original sources

arXiv2024

Hierarchical Separable Video Transformer for Snapshot Compressive Imaging

Transformers have achieved the state-of-the-art performance on solving the inverse problem of Snapshot Compressive Imaging (SCI) for video, whose ill-posedness is rooted in the mixed degradation of spatial masking and temporal aliasing. However, previous Transformers lack an insight into the degradation and thus have limited performance and efficiency. In this work, we tailor an efficient reconstruction architecture without temporal aggregation in early layers and Hierarchical Separable Video Transformer (HiSViT) as building block. HiSViT is built by multiple groups of Cross-Scale Separable Multi-head Self-Attention (CSS-MSA) and Gated Self-Modulated Feed-Forward Network (GSM-FFN) with dense connections, each of which is conducted within a separate channel portions at a different scale, for multi-scale interactions and long-range modeling. By separating spatial operations from temporal ones, CSS-MSA introduces an inductive bias of paying more attention within frames instead of between frames while saving computational overheads. GSM-FFN further enhances the locality via gated mechanism and factorized spatial-temporal convolutions. Extensive experiments demonstrate that our method outperforms previous methods by $\!>\!0.5$ dB with comparable or fewer parameters and complexity. The source codes and pretrained models are released at https://github.com/pwangcs/HiSViT.

cs.CV↗

arXiv2024

Hypergraph based Understanding for Document Semantic Entity Recognition

Semantic entity recognition is an important task in the field of visually-rich document understanding. It distinguishes the semantic types of text by analyzing the position relationship between text nodes and the relation between text content. The existing document understanding models mainly focus on entity categories while ignoring the extraction of entity boundaries. We build a novel hypergraph attention document semantic entity recognition framework, HGA, which uses hypergraph attention to focus on entity boundaries and entity categories at the same time. It can conduct a more detailed analysis of the document text representation analyzed by the upstream model and achieves a better performance of semantic information. We apply this method on the basis of GraphLayoutLM to construct a new semantic entity recognition model HGALayoutLM. Our experiment results on FUNSD, CORD, XFUND and SROIE show that our method can effectively improve the performance of semantic entity recognition tasks based on the original model. The results of HGALayoutLM on FUNSD and XFUND reach the new state-of-the-art results.

cs.AI↗

arXiv2024

Semantics-Preserved Distortion for Personal Privacy Protection in Information Management

In recent years, machine learning - particularly deep learning - has significantly impacted the field of information management. While several strategies have been proposed to restrict models from learning and memorizing sensitive information from raw texts, this paper suggests a more linguistically-grounded approach to distort texts while maintaining semantic integrity. To this end, we leverage Neighboring Distribution Divergence, a novel metric to assess the preservation of semantic meaning during distortion. Building on this metric, we present two distinct frameworks for semantic-preserving distortion: a generative approach and a substitutive approach. Our evaluations across various tasks, including named entity recognition, constituency parsing, and machine reading comprehension, affirm the plausibility and efficacy of our distortion technique in personal privacy protection. We also test our method against attribute attacks in three privacy-focused assignments within the NLP domain, and the findings underscore the simplicity and efficacy of our data-based improvement approach over structural improvement approaches. Moreover, we explore privacy protection in a specific medical information management scenario, showing our method effectively limits sensitive data memorization, underscoring its practicality.

cs.CL↗

arXiv2024

The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models

Benchmark plays a pivotal role in assessing the advancements of large language models (LLMs). While numerous benchmarks have been proposed to evaluate LLMs' capabilities, there is a notable absence of a dedicated benchmark for assessing their musical abilities. To address this gap, we present ZIQI-Eval, a comprehensive and large-scale music benchmark specifically designed to evaluate the music-related capabilities of LLMs. ZIQI-Eval encompasses a wide range of questions, covering 10 major categories and 56 subcategories, resulting in over 14,000 meticulously curated data entries. By leveraging ZIQI-Eval, we conduct a comprehensive evaluation over 16 LLMs to evaluate and analyze LLMs' performance in the domain of music. Results indicate that all LLMs perform poorly on the ZIQI-Eval benchmark, suggesting significant room for improvement in their musical capabilities. With ZIQI-Eval, we aim to provide a standardized and robust evaluation framework that facilitates a comprehensive assessment of LLMs' music-related abilities. The dataset is available at GitHub\footnote{https://github.com/zcli-charlie/ZIQI-Eval} and HuggingFace\footnote{https://huggingface.co/datasets/MYTH-Lab/ZIQI-Eval}.

cs.SD↗

arXiv2024

Zone Evaluation: Revealing Spatial Bias in Object Detection

A fundamental limitation of object detectors is that they suffer from "spatial bias", and in particular perform less satisfactorily when detecting objects near image borders. For a long time, there has been a lack of effective ways to measure and identify spatial bias, and little is known about where it comes from and what degree it is. To this end, we present a new zone evaluation protocol, extending from the traditional evaluation to a more generalized one, which measures the detection performance over zones, yielding a series of Zone Precisions (ZPs). For the first time, we provide numerical results, showing that the object detectors perform quite unevenly across the zones. Surprisingly, the detector's performance in the 96% border zone of the image does not reach the AP value (Average Precision, commonly regarded as the average detection performance in the entire image zone). To better understand spatial bias, a series of heuristic experiments are conducted. Our investigation excludes two intuitive conjectures about spatial bias that the object scale and the absolute positions of objects barely influence the spatial bias. We find that the key lies in the human-imperceptible divergence in data patterns between objects in different zones, thus eventually forming a visible performance gap between the zones. With these findings, we finally discuss a future direction for object detection, namely, spatial disequilibrium problem, aiming at pursuing a balanced detection ability over the entire image zone. By broadly evaluating 10 popular object detectors and 5 detection datasets, we shed light on the spatial bias of object detectors. We hope this work could raise a focus on detection robustness. The source codes, evaluation protocols, and tutorials are publicly available at https://github.com/Zzh-tju/ZoneEval.

cs.CV↗

arXiv2024

DVS-RG: Differential Variable Speed Limits Control using Deep Reinforcement Learning with Graph State Representation

Variable speed limit (VSL) control is an established yet challenging problem to improve freeway traffic mobility and alleviate bottlenecks by customizing speed limits at proper locations based on traffic conditions. Recent advances in deep reinforcement learning (DRL) have shown promising results in solving VSL control problems by interacting with sophisticated environments. However, the modeling of these methods ignores the inherent graph structure of the traffic state which can be a key factor for more efficient VSL control. Graph structure can not only capture the static spatial feature but also the dynamic temporal features of traffic. Therefore, we propose the DVS-RG: DRL-based differential variable speed limit controller with graph state representation. DVS-RG provides distinct speed limits per lane in different locations dynamically. The road network topology and traffic information(e.g., occupancy, speed) are integrated as the state space of DVS-RG so that the spatial features can be learned. The normalization reward which combines efficiency and safety is used to train the VSL controller to avoid excessive inefficiencies or low safety. The results obtained from the simulation study on SUMO show that DRL-RG achieves higher traffic efficiency (the average waiting time reduced to 68.44\%) and improves the safety measures (the number of potential collision reduced by 15.93\% ) compared to state-of-the-art DRL methods.

eess.SY↗

arXiv2024

Blood Works for Graphene Production

Blood, a ubiquitous and fundamental carbohydrate material composed of plasma, red blood cells, white blood cells, and platelets, has been playing an important role in biology, life science, history, and religious study, while graphene has garnered significant attention due to its exceptional properties and extensive range of potential applications. Achieving environmentally friendly, cost-effective growth using hybrid precursors and obtaining high-quality graphene through a straightforward CVD process has been traditionally considered mutually exclusive. This study demonstrates that we can produce high-quality graphene domains with controlled thickness through a one-step growth process at atmospheric pressure using blood as a precursor. Raman spectroscopy confirms the uniformity of the blood-grown graphene films, and observing the half-integer quantum Hall effect in the measured devices highlights its outstanding electronic properties. This unprecedented approach opens possibilities for blood application, facilitating an unconventional route in graphene growth applications.

cond-mat.mes-hall↗

arXiv2024

Gate control of 2D magnetism in tri- and four-layers $\rm CrI_3$/graphene heterostructures

We conduct experimental studies on the electrical transport properties of monolayer graphene directly covered by a few layers of $\rm CrI_3$. We do not observe the expected magnetic exchange coupling in the graphene but instead discover proximity effects featuring gate and magnetic field tunability. The tunability of gate voltage is manifested in the alignment of the lowest conduction band of $\rm CrI_3$ and the Fermi level of graphene, which can be controlled by the gate voltage. The coexistence of the normal and atypical quantum Hall effects in our device also corresponds to gate-control modulation doping. The lowest conduction band depends on the magnetic states of the $\rm CrI_3$ and can be altered by the magnetic field, which corresponds to the resistance loops during back-and-forth sweeps of the magnetic field. Our results serve as a reference for exploiting the magnetic proximity effects in graphene.

cond-mat.mes-hall↗

arXiv2024

Scaling and Universality in the Temporal Occurrence of Repeating FRBs

Fast Radio Bursts (FRBs) are energetic phenomena that have significant implications for understanding fundamental physics and the universe. Recent observations of FRB 121102, FRB 20220912A, and FRB 20201124A by the Five-hundred-meter Aperture Spherical Telescope (FAST) showed high burst rates and distinctive energy distribution and temporal properties. In this study, we examine these observations to investigate the scale invariance of the waiting times between bursts for intervals longer than approximately 1 second. Our analysis revealed a unified scaling law for these longer intervals, which is similar to the behavior of solar flares. This discovery inspires us to suggest a dual analogy of the FRB scenario across the entire time intervals: with earthquake dynamics at subsecond scales and with solar flare dynamics beyond the one-second threshold. This threshold potentially aligns with the dynamic time scale of neutron star crusts, offering insight of the occurrence of FRBs into the internal processes of neutron stars.

astro-ph.HE↗

arXiv2024

Deep Optics for Video Snapshot Compressive Imaging

Video snapshot compressive imaging (SCI) aims to capture a sequence of video frames with only a single shot of a 2D detector, whose backbones rest in optical modulation patterns (also known as masks) and a computational reconstruction algorithm. Advanced deep learning algorithms and mature hardware are putting video SCI into practical applications. Yet, there are two clouds in the sunshine of SCI: i) low dynamic range as a victim of high temporal multiplexing, and ii) existing deep learning algorithms' degradation on real system. To address these challenges, this paper presents a deep optics framework to jointly optimize masks and a reconstruction network. Specifically, we first propose a new type of structural mask to realize motion-aware and full-dynamic-range measurement. Considering the motion awareness property in measurement domain, we develop an efficient network for video SCI reconstruction using Transformer to capture long-term temporal dependencies, dubbed Res2former. Moreover, sensor response is introduced into the forward model of video SCI to guarantee end-to-end model training close to real system. Finally, we implement the learned structural masks on a digital micro-mirror device. Experimental results on synthetic and real data validate the effectiveness of the proposed framework. We believe this is a milestone for real-world video SCI. The source code and data are available at https://github.com/pwangcs/DeepOpticsSCI.

cs.CV↗

arXiv2024

Dual-Scale Transformer for Large-Scale Single-Pixel Imaging

Single-pixel imaging (SPI) is a potential computational imaging technique which produces image by solving an illposed reconstruction problem from few measurements captured by a single-pixel detector. Deep learning has achieved impressive success on SPI reconstruction. However, previous poor reconstruction performance and impractical imaging model limit its real-world applications. In this paper, we propose a deep unfolding network with hybrid-attention Transformer on Kronecker SPI model, dubbed HATNet, to improve the imaging quality of real SPI cameras. Specifically, we unfold the computation graph of the iterative shrinkagethresholding algorithm (ISTA) into two alternative modules: efficient tensor gradient descent and hybrid-attention multiscale denoising. By virtue of Kronecker SPI, the gradient descent module can avoid high computational overheads rooted in previous gradient descent modules based on vectorized SPI. The denoising module is an encoder-decoder architecture powered by dual-scale spatial attention for high- and low-frequency aggregation and channel attention for global information recalibration. Moreover, we build a SPI prototype to verify the effectiveness of the proposed method. Extensive experiments on synthetic and real data demonstrate that our method achieves the state-of-the-art performance. The source code and pre-trained models are available at https://github.com/Gang-Qu/HATNet-SPI.

cs.CV↗

arXiv2024

High quality Fe1+yTe synthesized by chemical vapor deposition with conspicuous vortex flow

Two-dimensional (2D) materials provide an ideal platform to explore novel superconducting behavior including Ising superconductivity, topological superconductivity and Majorana bound states in different 2D stoichiometric Ta-, Nb-, and Fe-based crystals. However, tuning the element content in 2D compounds for regulating their superconductivity has not been realized. In this work, we report the synthesis of high quality Fe1+yTe with tunable Fe content by chemical vapor deposition (CVD). The quality and composition of Fe1+yTe are characterized by Raman spectroscopy, X-ray photoelectron spectroscopy (XPS) and scanning transmission electron microscopy (STEM). The superconducting behavior of Fe1+yTe crystals with varying Fe contents is observed. The superconducting transition of selected Fe1.13Te sample is sharp (ΔTc = 1 K), while Fe1.43Te with a high-Fe content shows a relative broad superconducting transition (ΔTc = 2.6 K) at zero magnetic field. Significantly, the conspicuous vortex flow and a transition from a 3D vortex liquid state to a 2D vortex liquid state is observed in Fe1.43Te sample. Our work highlights the tunability of the superconducting properties of Fe1+yTe and sheds light on the vortex dynamics in Fe-based superconductors, which facilitates us to understand the intrinsic mechanisms of high-temperature superconductivity.

physics.app-ph↗

arXiv2024

SCINeRF: Neural Radiance Fields from a Snapshot Compressive Image

In this paper, we explore the potential of Snapshot Compressive Imaging (SCI) technique for recovering the underlying 3D scene representation from a single temporal compressed image. SCI is a cost-effective method that enables the recording of high-dimensional data, such as hyperspectral or temporal information, into a single image using low-cost 2D imaging sensors. To achieve this, a series of specially designed 2D masks are usually employed, which not only reduces storage requirements but also offers potential privacy protection. Inspired by this, to take one step further, our approach builds upon the powerful 3D scene representation capabilities of neural radiance fields (NeRF). Specifically, we formulate the physical imaging process of SCI as part of the training of NeRF, allowing us to exploit its impressive performance in capturing complex scene structures. To assess the effectiveness of our method, we conduct extensive evaluations using both synthetic data and real data captured by our SCI system. Extensive experimental results demonstrate that our proposed approach surpasses the state-of-the-art methods in terms of image reconstruction and novel view image synthesis. Moreover, our method also exhibits the ability to restore high frame-rate multi-view consistent images by leveraging SCI and the rendering capabilities of NeRF. The code is available at https://github.com/WU-CVGL/SCINeRF.

eess.IV↗

arXiv2024

RoboKeyGen: Robot Pose and Joint Angles Estimation via Diffusion-based 3D Keypoint Generation

Estimating robot pose and joint angles is significant in advanced robotics, enabling applications like robot collaboration and online hand-eye calibration.However, the introduction of unknown joint angles makes prediction more complex than simple robot pose estimation, due to its higher dimensionality.Previous methods either regress 3D keypoints directly or utilise a render&compare strategy. These approaches often falter in terms of performance or efficiency and grapple with the cross-camera gap problem.This paper presents a novel framework that bifurcates the high-dimensional prediction task into two manageable subtasks: 2D keypoints detection and lifting 2D keypoints to 3D. This separation promises enhanced performance without sacrificing the efficiency innate to keypoint-based techniques.A vital component of our method is the lifting of 2D keypoints to 3D keypoints. Common deterministic regression methods may falter when faced with uncertainties from 2D detection errors or self-occlusions.Leveraging the robust modeling potential of diffusion models, we reframe this issue as a conditional 3D keypoints generation task. To bolster cross-camera adaptability, we introduce theNormalised Camera Coordinate Space (NCCS), ensuring alignment of estimated 2D keypoints across varying camera intrinsics.Experimental results demonstrate that the proposed method outperforms the state-of-the-art render\&compare method and achieves higher inference speed.Furthermore, the tests accentuate our method's robust cross-camera generalisation capabilities.We intend to release both the dataset and code in https://nimolty.github.io/Robokeygen/

cs.RO↗

arXiv2024

Vision-based Vehicle Re-identification in Bridge Scenario using Flock Similarity

Due to the needs of road traffic flow monitoring and public safety management, video surveillance cameras are widely distributed in urban roads. However, the information captured directly by each camera is siloed, making it difficult to use it effectively. Vehicle re-identification refers to finding a vehicle that appears under one camera in another camera, which can correlate the information captured by multiple cameras. While license plate recognition plays an important role in some applications, there are some scenarios where re-identification method based on vehicle appearance are more suitable. The main challenge is that the data of vehicle appearance has the characteristics of high inter-class similarity and large intra-class differences. Therefore, it is difficult to accurately distinguish between different vehicles by relying only on vehicle appearance information. At this time, it is often necessary to introduce some extra information, such as spatio-temporal information. Nevertheless, the relative position of the vehicles rarely changes when passing through two adjacent cameras in the bridge scenario. In this paper, we present a vehicle re-identification method based on flock similarity, which improves the accuracy of vehicle re-identification by utilizing vehicle information adjacent to the target vehicle. When the relative position of the vehicles remains unchanged and flock size is appropriate, we obtain an average relative improvement of 204% on VeRi dataset in our experiments. Then, the effect of the magnitude of the relative position change of the vehicles as they pass through two cameras is discussed. We present two metrics that can be used to quantify the difference and establish a connection between them. Although this assumption is based on the bridge scenario, it is often true in other scenarios due to driving safety and camera location.

cs.CV↗

arXiv2024

Orbital torque switching in perpendicularly magnetized materials

The orbital Hall effect in light materials has attracted considerable attention for developing novel orbitronic devices. Here we investigate the orbital torque efficiency and demonstrate the switching of the perpendicularly magnetized materials through the orbital Hall material (OHM), i.e., Zirconium (Zr). The orbital torque efficiency of approximately 0.78 is achieved in the Zr OHM with the perpendicularly magnetized [Co/Pt]3 sample, which significantly surpasses that of the perpendicularly magnetized CoFeB/Gd/CoFeB sample (approximately 0.04). Such notable difference is attributed to the different spin-orbit correlation strength between the [Co/Pt]3 sample and the CoFeB/Gd/CoFeB sample, which has been confirmed through the theoretical calculations. Furthermore, the full magnetization switching of the [Co/Pt]3 sample with a switching current density of approximately 2.6x106 A/cm2 has been realized through Zr, which even outperforms that of the W spin Hall material. Our finding provides a guideline to understand orbital torque efficiency and paves the way to develop energy-efficient orbitronic devices.

cond-mat.mtrl-sci↗

arXiv2024

Estimation of railway vehicle response for track geometry evaluation using branch Fourier neural operator

In railway transportation, the evaluation of track geometry is an indispensable requirement to ensure the safety and comfort of railway vehicles. A promising approach is to directly use vehicle dynamic responses to assess the impact of track geometry defects. However, the computational cost of obtaining the dynamic response of the vehicle body using dynamics simulation methods is large. Thus, it is important to obtain the dynamic response of the vehicle-track coupled system efficiently and accurately. In this work, a branch Fourier neural operator (BFNO) model is proposed to obtain the dynamic response of the vehicle-track coupled system. The model takes into account the nonlinear relationship of the vehicle-track coupled system and realizes the fast and accurate estimation of the system dynamic response. The relative loss (rLSE) of BFNO model is 2.04%, which is reduced by 64%, compared with the traditional neural network (CNN-GRU). In the frequency domain, BFNO model achieves the effective estimation of the dynamic response of the system within the primary frequency range. Compared with the existing methods, our proposed model can make predictions at unseen time steps, enabling predictions from low to high time resolutions. Meanwhile, our proposed model is superior to commercial software in terms of efficiency. In the evaluation of track geometry, users can use pre-trained BFNO to obtain the dynamic response with almost no computational cost.

physics.app-ph↗

arXiv2024

Clouds dissipate quickly during solar eclipses as the land surface cools

Clouds affected by solar eclipses could influence the reflection of sunlight back into space and might change local precipitation patterns. Satellite cloud retrievals have so far not taken into account the lunar shadow, hindering a reliable spaceborne assessment of the eclipse-induced cloud evolution. Here we use satellite cloud measurements during three solar eclipses between 2005 and 2016 that have been corrected for the partial lunar shadow together with large-eddy simulations to analyze the eclipse-induced cloud evolution. Our corrected data reveal that, over cooling land surfaces, shallow cumulus clouds start to disappear at very small solar obscurations. Our simulations explain that the cloud response was delayed and was initiated at even smaller solar obscurations. We demonstrate that neglecting the disappearance of clouds during a solar eclipse could lead to a considerable overestimation of the eclipse-related reduction of net incoming solar radiation. These findings should spur cloud model simulations of the direct consequences of sunlight-intercepting geoengineering proposals, for which our results serve as a unique benchmark.

physics.ao-ph↗