arXiv Science⌕ Search

arXiv subjects

Hao Yu

Publications and source records attributed to Hao Yu.

At least 199 records · Page 11Linked to original sources
arXiv2023

Modality Unifying Network for Visible-Infrared Person Re-Identification

Visible-infrared person re-identification (VI-ReID) is a challenging task due to large cross-modality discrepancies and intra-class variations. Existing methods mainly focus on learning modality-shared representations by embedding different modalities into the same feature space. As a result, the learned feature emphasizes the common patterns across modalities while suppressing modality-specific and identity-aware information that is valuable for Re-ID. To address these issues, we propose a novel Modality Unifying Network (MUN) to explore a robust auxiliary modality for VI-ReID. First, the auxiliary modality is generated by combining the proposed cross-modality learner and intra-modality learner, which can dynamically model the modality-specific and modality-shared representations to alleviate both cross-modality and intra-modality variations. Second, by aligning identity centres across the three modalities, an identity alignment loss function is proposed to discover the discriminative feature representations. Third, a modality alignment loss is introduced to consistently reduce the distribution distance of visible and infrared images by modality prototype modeling. Extensive experiments on multiple public datasets demonstrate that the proposed method surpasses the current state-of-the-art methods by a significant margin.

cs.CV↗
arXiv2023

TMac: Temporal Multi-Modal Graph Learning for Acoustic Event Classification

Audiovisual data is everywhere in this digital age, which raises higher requirements for the deep learning models developed on them. To well handle the information of the multi-modal data is the key to a better audiovisual modal. We observe that these audiovisual data naturally have temporal attributes, such as the time information for each frame in the video. More concretely, such data is inherently multi-modal according to both audio and visual cues, which proceed in a strict chronological order. It indicates that temporal information is important in multi-modal acoustic event modeling for both intra- and inter-modal. However, existing methods deal with each modal feature independently and simply fuse them together, which neglects the mining of temporal relation and thus leads to sub-optimal performance. With this motivation, we propose a Temporal Multi-modal graph learning method for Acoustic event Classification, called TMac, by modeling such temporal information via graph learning techniques. In particular, we construct a temporal graph for each acoustic event, dividing its audio data and video data into multiple segments. Each segment can be considered as a node, and the temporal relationships between nodes can be considered as timestamps on their edges. In this case, we can smoothly capture the dynamic information in intra-modal and inter-modal. Several experiments are conducted to demonstrate TMac outperforms other SOTA models in performance. Our code is available at https://github.com/MGitHubL/TMac.

cs.SD↗
arXiv2023

NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimation

Pose estimation of 3D objects in monocular images is a fundamental and long-standing problem in computer vision. Existing deep learning approaches for 6D pose estimation typically rely on the assumption of availability of 3D object models and 6D pose annotations. However, precise annotation of 6D poses in real data is intricate, time-consuming and not scalable, while synthetic data scales well but lacks realism. To avoid these problems, we present a weakly-supervised reconstruction-based pipeline, named NeRF-Pose, which needs only 2D object segmentation and known relative camera poses during training. Following the first-reconstruct-then-regress idea, we first reconstruct the objects from multiple views in the form of an implicit neural representation. Then, we train a pose regression network to predict pixel-wise 2D-3D correspondences between images and the reconstructed model. At inference, the approach only needs a single image as input. A NeRF-enabled PnP+RANSAC algorithm is used to estimate stable and accurate pose from the predicted correspondences. Experiments on LineMod and LineMod-Occlusion show that the proposed method has state-of-the-art accuracy in comparison to the best 6D pose estimation methods in spite of being trained only with weak labels. Besides, we extend the Homebrewed DB dataset with more real training images to support the weakly supervised task and achieve compelling results on this dataset. The extended dataset and code will be released soon.

cs.CV↗
arXiv2023

Skew Product Groups for 2-Groups of Maximal Class

Skew morphisms, which generalise automorphisms for groups, provide a fundamental tool for the study of regular Cayley maps and, more generally, for finite groups with a complementary factorisation $X = GY$, where $Y$ is cyclic and core-free in $X$. $X$ is called the skew product group associated with $G$ and $Y$. In this paper, we classify skew product groups for the maximal class 2-groups.

math.GR↗
arXiv2023

Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstruction

Reconstructing both objects and hands in 3D from a single RGB image is complex. Existing methods rely on manually defined hand-object constraints in Euclidean space, leading to suboptimal feature learning. Compared with Euclidean space, hyperbolic space better preserves the geometric properties of meshes thanks to its exponentially-growing space distance, which amplifies the differences between the features based on similarity. In this work, we propose the first precise hand-object reconstruction method in hyperbolic space, namely Dynamic Hyperbolic Attention Network (DHANet), which leverages intrinsic properties of hyperbolic space to learn representative features. Our method that projects mesh and image features into a unified hyperbolic space includes two modules, ie. dynamic hyperbolic graph convolution and image-attention hyperbolic graph convolution. With these two modules, our method learns mesh features with rich geometry-image multi-modal information and models better hand-object interaction. Our method provides a promising alternative for fine hand-object reconstruction in hyperbolic space. Extensive experiments on three public datasets demonstrate that our method outperforms most state-of-the-art methods.

cs.CV↗
arXiv2023

Open, Closed, or Small Language Models for Text Classification?

Recent advancements in large language models have demonstrated remarkable capabilities across various NLP tasks. But many questions remain, including whether open-source models match closed ones, why these models excel or struggle with certain tasks, and what types of practical procedures can improve performance. We address these questions in the context of classification by evaluating three classes of models using eight datasets across three distinct tasks: named entity recognition, political party prediction, and misinformation detection. While larger LLMs often lead to improved performance, open-source models can rival their closed-source counterparts by fine-tuning. Moreover, supervised smaller models, like RoBERTa, can achieve similar or even greater performance in many datasets compared to generative LLMs. On the other hand, closed models maintain an advantage in hard tasks that demand the most generalizability. This study underscores the importance of model selection based on task requirements

cs.CL↗
arXiv2023

GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformer

We study the problem of extracting accurate correspondences for point cloud registration. Recent keypoint-free methods have shown great potential through bypassing the detection of repeatable keypoints which is difficult to do especially in low-overlap scenarios. They seek correspondences over downsampled superpoints, which are then propagated to dense points. Superpoints are matched based on whether their neighboring patches overlap. Such sparse and loose matching requires contextual features capturing the geometric structure of the point clouds. We propose Geometric Transformer, or GeoTransformer for short, to learn geometric feature for robust superpoint matching. It encodes pair-wise distances and triplet-wise angles, making it invariant to rigid transformation and robust in low-overlap cases. The simplistic design attains surprisingly high matching accuracy such that no RANSAC is required in the estimation of alignment transformation, leading to $100$ times acceleration. Extensive experiments on rich benchmarks encompassing indoor, outdoor, synthetic, multiway and non-rigid demonstrate the efficacy of GeoTransformer. Notably, our method improves the inlier ratio by $18{\sim}31$ percentage points and the registration recall by over $7$ points on the challenging 3DLoMatch benchmark. Our code and models are available at \url{https://github.com/qinzheng93/GeoTransformer}.

cs.CV↗
arXiv2023

Blockchain technology research and application: a systematic literature review and future trends

Blockchain, as the basis for cryptocurrencies, has received extensive attentions recently. Blockchain serves as an immutable distributed ledger technology which allows transactions to be carried out credibly in a decentralized environment. Blockchain-based applications are springing up, covering numerous fields including financial services, reputation system and Internet of Things (IoT), and so on. However, there are still many challenges of blockchain technology such as scalability, security and other issues waiting to be overcome. This article provides a comprehensive overview of blockchain technology and its applications. We begin with a summary of the development of blockchain, and then give an overview of the blockchain architecture and a systematic review of the research and application of blockchain technology in different fields from the perspective of academic research and industry technology. Furthermore, technical challenges and recent developments are also briefly listed. We also looked at the possible future trends of blockchain.

cs.CR↗
arXiv2023

Group cohesion under asymmetric voting behaviors

Cohesion plays a crucial role in achieving collective goals, promoting cooperation and trust, and improving efficiency within social groups. To gain deeper insights into the dynamics of group cohesion, we have extended our previous model of noisy group formation by incorporating asymmetric voting behaviors. Through a combination of theoretical analysis and numerical simulations, we have explored the impact of asymmetric voting noise, the attention decay rate, voter selection methods, and group sizes on group cohesion. For a single voter, we discovered that as the group size approaches infinity, group cohesion converges to $1/(R+1)$, where $R$ represents the ratio of asymmetric voting noise. Remarkably, even in scenarios with extreme voting asymmetry ($R \to \infty$), a significant level of group cohesion can be maintained. Furthermore, when the positive or negative voter's voting noise surpasses or falls below the phase transition point of $R_c=1$, a higher rate of attention decay can lead to increased group cohesion. In the case of multiple voters, a similar phenomenon arises when the attention decay rate reaches a critical point. These insights provide practical implications for fostering effective collaboration and teamwork within growing groups striving to achieve shared objectives.

physics.soc-ph↗
arXiv2023

Protecting User Privacy in Remote Conversational Systems: A Privacy-Preserving framework based on text sanitization

Large Language Models (LLMs) are gaining increasing attention due to their exceptional performance across numerous tasks. As a result, the general public utilize them as an influential tool for boosting their productivity while natural language processing researchers endeavor to employ them in solving existing or new research problems. Unfortunately, individuals can only access such powerful AIs through APIs, which ultimately leads to the transmission of raw data to the models' providers and increases the possibility of privacy data leakage. Current privacy-preserving methods for cloud-deployed language models aim to protect privacy information in the pre-training dataset or during the model training phase. However, they do not meet the specific challenges presented by the remote access approach of new large-scale language models. This paper introduces a novel task, "User Privacy Protection for Dialogue Models," which aims to safeguard sensitive user information from any possible disclosure while conversing with chatbots. We also present an evaluation scheme for this task, which covers evaluation metrics for privacy protection, data availability, and resistance to simulation attacks. Moreover, we propose the first framework for this task, namely privacy protection through text sanitization. Before sending the input to remote large models, it filters out the sensitive information, using several rounds of text sanitization based on privacy types that users define. Upon receiving responses from the larger model, our framework automatically restores privacy to ensure that the conversation goes smoothly, without intervention from the privacy filter. Experiments based on real-world datasets demonstrate the efficacy of our privacy-preserving approach against eavesdropping from potential attackers.

cs.CR↗
arXiv2023

WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferences

We present WebGLM, a web-enhanced question-answering system based on the General Language Model (GLM). Its goal is to augment a pre-trained large language model (LLM) with web search and retrieval capabilities while being efficient for real-world deployments. To achieve this, we develop WebGLM with strategies for the LLM-augmented retriever, bootstrapped generator, and human preference-aware scorer. Specifically, we identify and address the limitations of WebGPT (OpenAI), through which WebGLM is enabled with accuracy, efficiency, and cost-effectiveness advantages. In addition, we propose systematic criteria for evaluating web-enhanced QA systems. We conduct multi-dimensional human evaluation and quantitative ablation studies, which suggest the outperformance of the proposed WebGLM designs over existing systems. WebGLM with the 10-billion-parameter GLM (10B) is shown to perform better than the similar-sized WebGPT (13B) and even comparably to WebGPT (175B) in human evaluation. The code, demo, and data are at \url{https://github.com/THUDM/WebGLM}.

cs.CL↗
arXiv2023

Using entropy bounds to avoid the cosmological singularity and constrain cosmological particle production

In this work, we study the applications of entropy bounds in two toy cosmological models with particle production (annihilation), i.e., a radiation-dominated universe and a dust-dominated universe. We consider the co-moving volume and the volume covered by the particle horizon of a given observer as the thermodynamic systems satisfying entropy bounds. For the Bekenstein bound and the spherical entropy bound, it is found that the cosmological singularity can be avoided and cosmological particle production needs to be truncated in some special cases. Our study can be extended to other cosmological models with particle production.

astro-ph.CO↗
arXiv2023

On a new geometric homology theory and an application in categorical Gromov-Witten theory

The purpose of this paper is twofold: 1. we prove the triangulability of smooth orbifolds with corners, generalizing the same statement for orbifolds. 2. based on 1, we propose a new homology theory. We call it geometric homology theory (GHT for abbreviaty). GHT is a natural and flexible generalization of singular homology. It has some advantages overcoming the unpleasant combinatoric rigidity of singular homology, e.g. ill-defined pullbacks of singular chains along fiber bundles. The method we use are mainly based on the celebrated stratification and triangulation theories of Lie groupoids and their orbit spaces, as well as the extension to Lie groupoids with corners by us. We illustrate a simple application of GHT in categorical Gromov-Witten theory, initiatied by Costello. We will develop further of this theory in our sequel paper.

math.AT↗
arXiv2023

The Product of a Generalized Quaternion Group And a Cyclic Group

Let $X(Q)=QC$ be a group, where $Q$ is a generalized quaternion group and $C$ is a cyclic group such that $Q\cap C=1$. In this paper, $X(Q)$ will be characterized and moreover, a complete classification for that will be given, provided $C$ is core-free. For the reason of self-constraint, in this paper a classification of the group $X(D)=DC$ is also given, where $D$ is a dihedral group and $C$ is a cyclic group such that $D\cap C=1$ and $C$ is core-free. Remind that the group $X(D)$ was recently classified in [12], based on a number of papers on skew-morphisms of dihedral groups. In this paper, a different approach from that in [12] will be used.

math.GR↗
arXiv2023

Modeling opinion polarization under perception bias

Social networks have provided a platform for the effective exchange of ideas or opinions but also served as a hotbed of polarization. While much research attempts to explore different causes of opinion polarization, the effect of perception bias caused by the network structure itself is largely understudied. To this end, we propose a threshold model that simulates the evolution of opinions by taking into account the perception bias, which is the gap between global information and locally available information from the neighborhood within networks. Our findings suggest that polarization occurs when the collective stubbornness of the population exceeds a critical value which is largely affected by the perception bias. In addition, as the level of stubbornness grows, the occurrence of first-order and second-order phase transitions between consensus and polarization becomes more prevalent, and the types of these phase transitions rely on the initial proportion of active opinions. Notably, for regular network structures, a step-wise pattern emerges that corresponds to various levels of polarization and is strongly associated with the formation of echo chambers. Our research presents a valuable framework for investigating the connection between perception bias and opinion polarization and provides valuable insights for mitigating polarization in the context of biased information.

physics.soc-ph↗
arXiv2023

High-performance and Scalable Software-based NVMe Virtualization Mechanism with I/O Queues Passthrough

NVMe(Non-Volatile Memory Express) is an industry standard for solid-state drives (SSDs) that has been widely adopted in data centers. NVMe virtualization is crucial in cloud computing as it allows for virtualized NVMe devices to be used by virtual machines (VMs), thereby improving the utilization of storage resources. However, traditional software-based solutions have flexibility benefits but often come at the cost of performance degradation or high CPU overhead. On the other hand, hardware-assisted solutions offer high performance and low CPU usage, but their adoption is often limited by the need for special hardware support or the requirement for new hardware development. In this paper, we propose LightIOV, a novel software-based NVMe virtualization mechanism that achieves high performance and scalability without consuming valuable CPU resources and without requiring special hardware support. LightIOV can support thousands of VMs on each server. The key idea behind LightIOV is NVMe hardware I/O queues passthrough, which enables VMs to directly access I/O queues of NVMe devices, thus eliminating virtualization overhead and providing near-native performance. Results from our experiments show that LightIOV can provide comparable performance to VFIO, with an IOPS of 97.6%-100.2% of VFIO. Furthermore, in high-density VMs environments, LightIOV achieves 31.4% lower latency than SPDK-Vhost when running 200 VMs, and an improvement of 27.1% in OPS performance in real-world applications.

cs.AR↗
arXiv2023

Online Camera-to-ground Calibration for Autonomous Driving

Online camera-to-ground calibration is to generate a non-rigid body transformation between the camera and the road surface in a real-time manner. Existing solutions utilize static calibration, suffering from environmental variations such as tire pressure changes, vehicle loading volume variations, and road surface diversity. Other online solutions exploit the usage of road elements or photometric consistency between overlapping views across images, which require continuous detection of specific targets on the road or assistance with multiple cameras to facilitate calibration. In our work, we propose an online monocular camera-to-ground calibration solution that does not utilize any specific targets while driving. We perform a coarse-to-fine approach for ground feature extraction through wheel odometry and estimate the camera-to-ground calibration parameters through a sliding-window-based factor graph optimization. Considering the non-rigid transformation of camera-to-ground while driving, we provide metrics to quantify calibration performance and stopping criteria to report/broadcast our satisfying calibration results. Extensive experiments using real-world data demonstrate that our algorithm is effective and outperforms state-of-the-art techniques.

cs.CV↗