arXiv subjects

Dawei Yang

Publications and source records attributed to Dawei Yang.

At least 73 records · Page 4Linked to original sources

arXiv2024

SRB measures for mostly expanding partially hyperbolic diffeomorphisms via the variational approach

By using the variational approach, we prove the existence of Sinai-Ruelle-Bowen measures for partially hyperbolic $\mathcal C^1$ diffeomorphisms with mostly expanding properties. The same conclusion holds true if one considers a dominated splitting $E\oplus F$, where $\dim E=1$ and $F$ is mostly expanding. When the diffeomorphisms are $\mathcal C^{1+α}$, we prove the basin covering property for both cases.

math.DS↗

arXiv2023

Post-Training Quantization for Re-parameterization via Coarse & Fine Weight Splitting

Although neural networks have made remarkable advancements in various applications, they require substantial computational and memory resources. Network quantization is a powerful technique to compress neural networks, allowing for more efficient and scalable AI deployments. Recently, Re-parameterization has emerged as a promising technique to enhance model performance while simultaneously alleviating the computational burden in various computer vision tasks. However, the accuracy drops significantly when applying quantization on the re-parameterized networks. We identify that the primary challenge arises from the large variation in weight distribution across the original branches. To address this issue, we propose a coarse & fine weight splitting (CFWS) method to reduce quantization error of weight, and develop an improved KL metric to determine optimal quantization scales for activation. To the best of our knowledge, our approach is the first work that enables post-training quantization applicable on re-parameterized networks. For example, the quantized RepVGG-A1 model exhibits a mere 0.3% accuracy loss. The code is in https://github.com/NeonHo/Coarse-Fine-Weight-Split.git

cs.CV↗

arXiv2023

On the nonlinear Poincaré flow

We develop a tool in order to analyse the dynamics of differentiable flows with singularities. It provides an abstract model for the local dynamics that can be used in order to control the size of invariant manifolds. This work is the first part of the results announced in [CY2].

math.DS↗

arXiv2023

FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugin

Given the capability of mitigating the long-tail deficiencies and intricate-shaped absence prevalent in 3D object detection, occupancy prediction has become a pivotal component in autonomous driving systems. However, the procession of three-dimensional voxel-level representations inevitably introduces large overhead in both memory and computation, obstructing the deployment of to-date occupancy prediction approaches. In contrast to the trend of making the model larger and more complicated, we argue that a desirable framework should be deployment-friendly to diverse chips while maintaining high precision. To this end, we propose a plug-and-play paradigm, namely FlashOCC, to consolidate rapid and memory-efficient occupancy prediction while maintaining high precision. Particularly, our FlashOCC makes two improvements based on the contemporary voxel-level occupancy prediction approaches. Firstly, the features are kept in the BEV, enabling the employment of efficient 2D convolutional layers for feature extraction. Secondly, a channel-to-height transformation is introduced to lift the output logits from the BEV into the 3D space. We apply the FlashOCC to diverse occupancy prediction baselines on the challenging Occ3D-nuScenes benchmarks and conduct extensive experiments to validate the effectiveness. The results substantiate the superiority of our plug-and-play paradigm over previous state-of-the-art methods in terms of precision, runtime efficiency, and memory costs, demonstrating its potential for deployment. The code will be made available.

cs.CV↗

arXiv2023

TryOnDiffusion: A Tale of Two UNets

Given two images depicting a person and a garment worn by another person, our goal is to generate a visualization of how the garment might look on the input person. A key challenge is to synthesize a photorealistic detail-preserving visualization of the garment, while warping the garment to accommodate a significant body pose and shape change across the subjects. Previous methods either focus on garment detail preservation without effective pose and shape variation, or allow try-on with the desired shape and pose but lack garment details. In this paper, we propose a diffusion-based architecture that unifies two UNets (referred to as Parallel-UNet), which allows us to preserve garment details and warp the garment for significant pose and body change in a single network. The key ideas behind Parallel-UNet include: 1) garment is warped implicitly via a cross attention mechanism, 2) garment warp and person blend happen as part of a unified process as opposed to a sequence of two separate tasks. Experimental results indicate that TryOnDiffusion achieves state-of-the-art performance both qualitatively and quantitatively.

cs.CV↗

arXiv2023

Reference-based OCT Angiogram Super-resolution with Learnable Texture Generation

Optical coherence tomography angiography (OCTA) is a new imaging modality to visualize retinal microvasculature and has been readily adopted in clinics. High-resolution OCT angiograms are important to qualitatively and quantitatively identify potential biomarkers for different retinal diseases accurately. However, one significant problem of OCTA is the inevitable decrease in resolution when increasing the field-of-view given a fixed acquisition time. To address this issue, we propose a novel reference-based super-resolution (RefSR) framework to preserve the resolution of the OCT angiograms while increasing the scanning area. Specifically, textures from the normal RefSR pipeline are used to train a learnable texture generator (LTG), which is designed to generate textures according to the input. The key difference between the proposed method and traditional RefSR models is that the textures used during inference are generated by the LTG instead of being searched from a single reference image. Since the LTG is optimized throughout the whole training process, the available texture space is significantly enlarged and no longer limited to a single reference image, but extends to all textures contained in the training samples. Moreover, our proposed LTGNet does not require a reference image at the inference phase, thereby becoming invulnerable to the selection of the reference image. Both experimental and visual results show that LTGNet has superior performance and robustness over state-of-the-art methods, indicating good reliability and promise in real-life deployment. The source code will be made available upon acceptance.

eess.IV↗

arXiv2023

Improving Post-Training Quantization on Object Detection with Task Loss-Guided Lp Metric

Efficient inference for object detection networks is a major challenge on edge devices. Post-Training Quantization (PTQ), which transforms a full-precision model into low bit-width directly, is an effective and convenient approach to reduce model inference complexity. But it suffers severe accuracy drop when applied to complex tasks such as object detection. PTQ optimizes the quantization parameters by different metrics to minimize the perturbation of quantization. The p-norm distance of feature maps before and after quantization, Lp, is widely used as the metric to evaluate perturbation. For the specialty of object detection network, we observe that the parameter p in Lp metric will significantly influence its quantization performance. We indicate that using a fixed hyper-parameter p does not achieve optimal quantization performance. To mitigate this problem, we propose a framework, DetPTQ, to assign different p values for quantizing different layers using an Object Detection Output Loss (ODOL), which represents the task loss of object detection. DetPTQ employs the ODOL-based adaptive Lp metric to select the optimal quantization parameters. Experiments show that our DetPTQ outperforms the state-of-the-art PTQ methods by a significant margin on both 2D and 3D object detectors. For example, we achieve 31.1/31.7(quantization/full-precision) mAP on RetinaNet-ResNet18 with 4-bit weight and 4-bit activation.

cs.CV↗

arXiv2023

PD-Quant: Post-Training Quantization based on Prediction Difference Metric

Post-training quantization (PTQ) is a neural network compression technique that converts a full-precision model into a quantized model using lower-precision data types. Although it can help reduce the size and computational cost of deep neural networks, it can also introduce quantization noise and reduce prediction accuracy, especially in extremely low-bit settings. How to determine the appropriate quantization parameters (e.g., scaling factors and rounding of weights) is the main problem facing now. Existing methods attempt to determine these parameters by minimize the distance between features before and after quantization, but such an approach only considers local information and may not result in the most optimal quantization parameters. We analyze this issue and ropose PD-Quant, a method that addresses this limitation by considering global information. It determines the quantization parameters by using the information of differences between network prediction before and after quantization. In addition, PD-Quant can alleviate the overfitting problem in PTQ caused by the small number of calibration sets by adjusting the distribution of activations. Experiments show that PD-Quant leads to better quantization parameters and improves the prediction accuracy of quantized models, especially in low-bit settings. For example, PD-Quant pushes the accuracy of ResNet-18 up to 53.14% and RegNetX-600MF up to 40.67% in weight 2-bit activation 2-bit. The code is released at https://github.com/hustvl/PD-Quant.

cs.CV↗

arXiv2023

Benchmarking the Reliability of Post-training Quantization: a Particular Focus on Worst-case Performance

Post-training quantization (PTQ) is a popular method for compressing deep neural networks (DNNs) without modifying their original architecture or training procedures. Despite its effectiveness and convenience, the reliability of PTQ methods in the presence of some extrem cases such as distribution shift and data noise remains largely unexplored. This paper first investigates this problem on various commonly-used PTQ methods. We aim to answer several research questions related to the influence of calibration set distribution variations, calibration paradigm selection, and data augmentation or sampling strategies on PTQ reliability. A systematic evaluation process is conducted across a wide range of tasks and commonly-used PTQ paradigms. The results show that most existing PTQ methods are not reliable enough in term of the worst-case group performance, highlighting the need for more robust methods. Our findings provide insights for developing PTQ methods that can effectively handle distribution shift scenarios and enable the deployment of quantized DNNs in real-world applications.

cs.LG↗

arXiv2022

A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advances

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion recognition and sentiment analysis). Affective computing is realized based on unimodal or multimodal data, primarily consisting of physical information (e.g., textual, audio, and visual data) and physiological signals (e.g., EEG and ECG signals). Physical-based affect recognition caters to more researchers due to multiple public databases. However, it is hard to reveal one's inner emotion hidden purposely from facial expressions, audio tones, body gestures, etc. Physiological signals can generate more precise and reliable emotional results; yet, the difficulty in acquiring physiological signals also hinders their practical application. Thus, the fusion of physical information and physiological signals can provide useful features of emotional states and lead to higher accuracy. Instead of focusing on one specific field of affective analysis, we systematically review recent advances in the affective computing, and taxonomize unimodal affect recognition as well as multimodal affective analysis. Firstly, we introduce two typical emotion models followed by commonly used databases for affective computing. Next, we survey and taxonomize state-of-the-art unimodal affect recognition and multimodal affective analysis in terms of their detailed architectures and performances. Finally, we discuss some important aspects on affective computing and their applications and conclude this review with an indication of the most promising future directions, such as the establishment of baseline dataset, fusion strategies for multimodal affective analysis, and unsupervised learning models.

cs.MM↗

arXiv2021

Lyapunov optimizing measures and periodic measures for $C^2$ expanding maps

We prove that there exists an open and dense subset $\mathcal{U}$ in the space of $C^{2}$ expanding self-maps of the circle $\mathbb{T}$ such that the Lyapunov minimizing measures of any $T\in{\mathcal U}$ are uniquely supported on a periodic orbit.This answers a conjecture of Jenkinson-Morris in the $C^2$ topology.

math.DS↗

arXiv2020

Volume growth and topological entropy of certain partially hyperbolic systems

Let $f$ be a $C^{1}$ diffeomorphism on a compact manifold $M$ admitting a partially hyperbolic splitting $TM=E^{s}\oplus_{\prec} E^{1}\oplus_{\prec} E^{2}\cdots \oplus_{\prec}E^{l}\oplus_{\prec} E^{u}$ where $E^{s}$ is uniformly contracting, $E^{u}$ is uniformly expanding and $\dim E^{i}=1,\,1\leq i\leq l.$ We prove an entropy formula w.r.t. the volume growth rate of subspaces in the tangent bundle: $$h_{\rm{top}}(f)=\lim_{n\to+\infty}\frac{1}{n}\log\int\max_{V\subset T_{x}M}|\det Df_{x}^{n}|_{V}|\,d x.$$

math.DS↗

arXiv2020

Rel3D: A Minimally Contrastive Benchmark for Grounding Spatial Relations in 3D

Understanding spatial relations (e.g., "laptop on table") in visual input is important for both humans and robots. Existing datasets are insufficient as they lack large-scale, high-quality 3D ground truth information, which is critical for learning spatial relations. In this paper, we fill this gap by constructing Rel3D: the first large-scale, human-annotated dataset for grounding spatial relations in 3D. Rel3D enables quantifying the effectiveness of 3D information in predicting spatial relations on large-scale human data. Moreover, we propose minimally contrastive data collection -- a novel crowdsourcing method for reducing dataset bias. The 3D scenes in our dataset come in minimally contrastive pairs: two scenes in a pair are almost identical, but a spatial relation holds in one and fails in the other. We empirically validate that minimally contrastive examples can diagnose issues with current relation detection models as well as lead to sample-efficient training. Code and data are available at https://github.com/princeton-vl/Rel3D.

cs.CV↗

arXiv2020

Ergodic optimization for some dynamical systems beyond uniform hyperbolicity

In this paper, we show that for several interesting systems beyond uniform hyperbolicity, any generic continuous function has a unique maximizing measure with zero entropy. In some cases, we also know that the maximizing measure has full support. These interesting systems including singular hyperbolic attractors, $C^\infty$ surface diffeomorphisms and diffeomorphisms away from homoclinic tangencies.

math.DS↗

arXiv2020

Learning to Generate Synthetic 3D Training Data through Hybrid Gradient

Synthetic images rendered by graphics engines are a promising source for training deep networks. However, it is challenging to ensure that they can help train a network to perform well on real images, because a graphics-based generation pipeline requires numerous design decisions such as the selection of 3D shapes and the placement of the camera. In this work, we propose a new method that optimizes the generation of 3D training data based on what we call "hybrid gradient". We parametrize the design decisions as a real vector, and combine the approximate gradient and the analytical gradient to obtain the hybrid gradient of the network performance with respect to this vector. We evaluate our approach on the task of estimating surface normal, depth or intrinsic decomposition from a single image. Experiments on standard benchmarks show that our approach can outperform the prior state of the art on optimizing the generation of 3D training data, particularly in terms of computational efficiency.

cs.CV↗

arXiv2020

On the notions of singular domination and (multi-)singular hyperbolicity

The properties of uniform hyperbolicity and dominated splitting have been introduced to study the stability of the dynamics of diffeomorphisms. One meets difficulties when one tries to extend these definitions to vector fields and Shantao Liao has shown that it is more relevant to consider the linear Poincaré flow rather than the tangent flow in order to study the properties of the derivative. In this paper we define the notion of singular domination, an analog of the dominated splitting for the linear Poincaré flow which is robust under perturbations. Based on this, we give a new definition of multi-singular hyperbolicity which is equivalent to the one recently introduced by Bonatti-da Luz. The novelty of our definition is that it does not involve the blowup of the singular set and the renormalization cocycle of the linear flows.

math.DS↗

arXiv2020

On the partial hyperbolicity of robustly transitive sets with singularities

Homoclinic tangencies and singular hyperbolicity are involved in the Palis conjecture for vector fields. Typical three dimensional vector fields are well understood by recent works. We study the dynamics of higher dimensional vector fields that are away from homoclinic tangencies. More precisely, we prove that for \emph{any} dimensional vector field that is away from homoclinic tangencies, all singularities contained in its robustly transitive singular set are all hyperbolic and have the same index. Moreover, the robustly transitive set is {$C^1$-generically }partially hyperbolic if the vector field cannot be accumulated by ones with a homoclinic tangency.

math.DS↗

arXiv2020

Robust transitivity of singular hyperbolic attractors

Singular hyperbolicity is a weakened form of hyperbolicity that has been introduced for vector fields in order to allow non-isolated singularities inside the non-wandering set. A typical example of a singular hyperbolic set is the Lorenz attractor. However, in contrast to uniform hyperbolicity, singular hyperbolicity does not immediately imply robust topological properties, such as the transitivity. In this paper, we prove that open and densely inside the space of $C^1$ vector fields of a compact manifold, any singular hyperbolic attractors is robustly transitive.

math.DS↗