arXiv subjects
Publications and source records attributed to Yi Wang.
We show that for any $\varepsilon>0$ and $Δ\in\mathbb{N}$, there exists $α>0$ such that for sufficiently large $n$, every $n$-vertex graph $G$ satisfying that $δ(G)\geq\varepsilon n$ and $e(X, Y)>0$ for every pair of disjoint vertex sets $X, Y\subseteq V(G)$ of size $αn$ contains all spanning trees with maximum degree at most $Δ$. This strengthens a result of Böttcher et al.
The spiking neural network (SNN) using leaky-integrated-and-fire (LIF) neurons has been commonly used in automatic speech recognition (ASR) tasks. However, the LIF neuron is still relatively simple compared to that in the biological brain. Further research on more types of neurons with different scales of neuronal dynamics is necessary. Here we introduce four types of neuronal dynamics to post-process the sequential patterns generated from the spiking transformer to get the complex dynamic neuron improved spiking transformer neural network (DyTr-SNN). We found that the DyTr-SNN could handle the non-toy automatic speech recognition task well, representing a lower phoneme error rate, lower computational cost, and higher robustness. These results indicate that the further cooperation of SNNs and neural dynamics at the neuron and network scales might have much in store for the future, especially on the ASR tasks.
In the past decades, lots of progress have been done in the video compression field including traditional video codec and learning-based video codec. However, few studies focus on using preprocessing techniques to improve the rate-distortion performance. In this paper, we propose a rate-perception optimized preprocessing (RPP) method. We first introduce an adaptive Discrete Cosine Transform loss function which can save the bitrate and keep essential high frequency components as well. Furthermore, we also combine several state-of-the-art techniques from low-level vision fields into our approach, such as the high-order degradation model, efficient lightweight network design, and Image Quality Assessment model. By jointly using these powerful techniques, our RPP approach can achieve on average, 16.27% bitrate saving with different video encoders like AVC, HEVC, and VVC under multiple quality metrics. In the deployment stage, our RPP method is very simple and efficient which is not required any changes in the setting of video encoding, streaming, and decoding. Each input frame only needs to make a single pass through RPP before sending into video encoders. In addition, in our subjective visual quality test, 87% of users think videos with RPP are better or equal to videos by only using the codec to compress, while these videos with RPP save about 12% bitrate on average. Our RPP framework has been integrated into the production environment of our video transcoding services which serve millions of users every day.
We systematically investigate the microlensing effect of charged spherically symmetric wormhole, where the light source is remote from the throat. Remarkably, there will be at most three images by considering the charge part. We study all situations including three images, two images, and one image, respectively. The numerical result shows that the range of total magnification is from $10^5$ to $10^{-2}$ depending on various metrics. In the case of three images, there will be two maximal values of magnification (a peak, and a gentle peak) when the contribution via mass is much less than that of charge. However, we cannot distinguish the case that forms three images or only one image as the total magnification is of order $10^5$. Finally, our theoretical investigation could shed new light on exploring the wormhole with the microlensing effect.
How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative pairs for contrastive learning or posing tighter class separating margins. These methods do not exploit the similarity between different classes as they adhere to i.i.d. assumption in data. In this paper, we embrace the real-world data distribution setting that some classes share semantic overlaps due to their similar appearances or concepts. Regarding this hypothesis, we propose a novel regularization to improve discriminative learning. We first calibrate the estimated highest likelihood of one sample based on its semantically neighboring classes, then encourage the overall likelihood predictions to be deterministic by imposing an adaptive exponential penalty. As the gradient of the proposed method is roughly proportional to the uncertainty of the predicted likelihoods, we name it adaptive discriminative regularization (ADR), trained along with a standard cross entropy loss in classification. Extensive experiments demonstrate that it can yield consistent and non-trivial performance improvements in a variety of visual classification tasks (over 10 benchmarks). Furthermore, we find it is robust to long-tailed and noisy label data distribution. Its flexible design enables its compatibility with mainstream classification architectures and losses.
We present some necessary and/or sufficient conditions for the positivity problem of three-term recurrence sequences. As applications we show the positivity of diagonal Taylor coefficients of some rational functions in a unified approach. We also establish a criterion for the positivity and log-convexity of such sequences.
The inflationary 1-loop tensor power spectrum from an excited spectator scalar field is calculated. Recent studies on primordial black holes suggest that the inflationary curvature perturbation may be huge on small scales. An enhanced curvature perturbation may arise from a drastic enhancement of spectator scalar field fluctuations. In this letter, using the in-in formalism, we calculate 1-loop quantum corrections to primordial gravitational waves by such an excited spectator field with a sharp peak in momentum space. We find scale-invariant loop corrections in this full quantum setup, in contrast to the sharply peaked corrections in the previously calculated scalar-induced tensor modes. Especially, on super Hubble scales, the primordial gravitational waves are also amplified, which can be understood as a Bogolyubov transformation of the vacuum due to the excited scalar field. This mechanism allows us to probe the scalar field properties on extremely short-distance scales with the current and future cosmic microwave background and gravitational wave experiments, opening a novel window for inflationary cosmology.
Recent years witnessed the breakthrough of face recognition with deep convolutional neural networks. Dozens of papers in the field of FR are published every year. Some of them were applied in the industrial community and played an important role in human life such as device unlock, mobile payment, and so on. This paper provides an introduction to face recognition, including its history, pipeline, algorithms based on conventional manually designed features or deep learning, mainstream training, evaluation datasets, and related applications. We have analyzed and compared state-of-the-art works as many as possible, and also carefully designed a set of experiments to find the effect of backbone size and data distribution. This survey is a material of the tutorial named The Practical Face Recognition Technology in the Industrial World in the FG2023.
We introduce a new image segmentation task, called Entity Segmentation (ES), which aims to segment all visual entities (objects and stuffs) in an image without predicting their semantic labels. By removing the need of class label prediction, the models trained for such task can focus more on improving segmentation quality. It has many practical applications such as image manipulation and editing where the quality of segmentation masks is crucial but class labels are less important. We conduct the first-ever study to investigate the feasibility of convolutional center-based representation to segment things and stuffs in a unified manner, and show that such representation fits exceptionally well in the context of ES. More specifically, we propose a CondInst-like fully-convolutional architecture with two novel modules specifically designed to exploit the class-agnostic and non-overlapping requirements of ES. Experiments show that the models designed and trained for ES significantly outperforms popular class-specific panoptic segmentation models in terms of segmentation quality. Moreover, an ES model can be easily trained on a combination of multiple datasets without the need to resolve label conflicts in dataset merging, and the model trained for ES on one or more datasets can generalize very well to other test datasets of unseen domains. The code has been released at https://github.com/dvlab-research/Entity/.
The foundation models have recently shown excellent performance on a variety of downstream tasks in computer vision. However, most existing vision foundation models simply focus on image-level pretraining and adpation, which are limited for dynamic and complex video-level understanding tasks. To fill the gap, we present general video foundation models, InternVideo, by taking advantage of both generative and discriminative self-supervised video learning. Specifically, InternVideo efficiently explores masked video modeling and video-language contrastive learning as the pretraining objectives, and selectively coordinates video representations of these two complementary frameworks in a learnable manner to boost various video applications. Without bells and whistles, InternVideo achieves state-of-the-art performance on 39 video datasets from extensive tasks including video action recognition/detection, video-language alignment, and open-world video applications. Especially, our methods can obtain 91.1% and 77.2% top-1 accuracy on the challenging Kinetics-400 and Something-Something V2 benchmarks, respectively. All of these results effectively show the generality of our InternVideo for video understanding. The code will be released at https://github.com/OpenGVLab/InternVideo .
It has been a long challenge to analytically construct the quantitative temperature-dependent multi-well free-energy landscape over the space of order parameters describing phase transitions and associated critical phenomena. Here we propose a simple analytical model for the free energy landscape based on a priori concept of Boltzmann thermal mixing among multiple parabolic potentials representing different energetically degenerated ground states in contrast to the popular Landau theory using the high-temperature disordered state as a reference. The model recovers both the Weiss molecular field theory and the temperature dependent behaviors of the second order Landau coefficient. It is rather remarkable that such a simple analytical expression can describe a wide variety of properties across the ferroelectric phase transition in PbTiO3, including the temperature dependences of the spontaneous polarization, the heat capacities, the permittivity tensor, and the lattice parameters. The approach also allows parametrization of the free energy function across phase transitions based directly on the 0 K thermodynamics data that can be obtained from DFT calculations. We anticipate that the approach can be equally applied to other types of critical phenomena, e.g., the superconducting phase transition, the metal-insulator transition, and the magnetic transitions.
The Lorenz number (L) contained in the Wiedemann-Franz law represents the ratio of two kinetic parameters of electronic charge carriers: the electronic contribution to the thermal conductivity (K_el) and the electrical conductivity (sigma), , and can be expressed as LT=K_el/sigma where T is temperature. We demonstrate that the Lorenz number simply equals to the ratio of two thermodynamic quantities: the electronic heat capacity (c_el) and the electrochemical capacitance (c_N) through LT=c_el/c_N , a purely thermodynamic quantity, and thus it can be calculated solely based on the electron density of states of a material. It is shown that our thermodynamic formulation for the Lorenz number leads to: i) the well-known Sommerfeld value L=pi^2/3(k_B/e)^2 at the low temperature limit, ii) the Drude value L=3/2(k_B/e)^2 at the high temperature limit with the free electron gas model, and iii) possible higher values than the Sommerfeld limit for semiconductors. It is also demonstrated that the purely electronic contribution to the thermoelectric figure-of-merit can be directly computed using high-throughput DFT calculations without resorting to the computationally more expensive Boltzmann transport theory to the electronic thermal conductivity and electrical conductivity.
Task learning in neural networks typically requires finding a globally optimal minimizer to a loss function objective. Conventional designs of swarm based optimization methods apply a fixed update rule, with possibly an adaptive step-size for gradient descent based optimization. While these methods gain huge success in solving different optimization problems, there are some cases where these schemes are either inefficient or suffering from local-minimum. We present a new particle-swarm-based framework utilizing Gaussian Process Regression to learn the underlying dynamical process of descent. The biggest advantage of this approach is greater exploration around the current state before deciding a descent direction. Empirical results show our approach can escape from the local minima compare with the widely-used state-of-the-art optimizers when solving non-convex optimization problems. We also test our approach under high-dimensional parameter space case, namely, image classification task.
This paper presents our solution for the 2nd COVID-19 Competition, occurring in the framework of the AIMIA Workshop at the European Conference on Computer Vision (ECCV 2022). In our approach, we employ the winning solution last year which uses a strong 3D Contrastive Mixup Classifcation network (CMC v1) as the baseline method, composed of contrastive representation learning and mixup classification. In this paper, we propose CMC v2 by introducing natural video priors to COVID-19 diagnosis. Specifcally, we adapt a pre-trained (on video dataset) video transformer backbone to COVID-19 detection. Moreover, advanced training strategies, including hybrid mixup and cutmix, slicelevel augmentation, and small resolution training are also utilized to boost the robustness and the generalization ability of the model. Among 14 participating teams, CMC v2 ranked 1st in the 2nd COVID-19 Competition with an average Macro F1 Score of 89.11%.
We present a consistent one-loop calculation for the inflationary tensor power spectrum in the presence of an excited spectator scalar field using the in-in formalism. We find that the super-horizon primordial power spectrum of the tensor mode can be scale-invariantly enhanced or reduced by the loop effects of a subhorizon scalar field. Our calculation also includes the scalar-induced gravitational wave spectrum classically computed in the previous literature, which is significant only near the scales where the scalar field is amplified. The super-horizon enhancement is a higher-order effect of the interaction Hamiltonian, which can be understood as a Bogoliubov transformation introduced by nonlinear interactions. On the other hand, the scale-invariant reduction of the tensor power spectrum may occur due to the fourth-order scalar-scalar-tensor-tensor coupling. This phenomenon can be understood as the evolution of an anisotropic Bianchi type-I background in the separate universe approach. Our result suggests that large-scale measurements may indirectly test the dramatic effects of small-scale cosmological perturbations through loop corrections. This possibility opens a new ground in probing the small-scale physics of the primordial Universe through gravitational wave detectors of cosmological scales.
We study the thermodynamics of accelerating asymptotically AdS black holes with scalar hair in four-dimensional Einstein-Maxwell-dilaton theories, which can be embedded in gauged supergravities for specific dilaton coupling constants. These accelerating black holes are described by charged dilaton C metrics, which have unique features but are almost unexplored before. Thermodynamics of slowly accelerating black holes is generalized to include scalar hair. We find that properly accounting for mixed boundary conditions for the scalar field leads to standard consistent first law and other thermodynamic relations. We compute the dual stress-energy tensor and the mass through holographic renormalization, which is associated with the boundary conditions of the scalar field. We also find that the conformal mass is the same as the holographic mass. Along the same line, we also obtain the thermodynamics of $U(1)^2$-charged accelerating black holes.
Presto is an open-source distributed SQL query engine for OLAP, aiming for "SQL on everything". Since open-sourced in 2013, Presto has been consistently gaining popularity in large-scale data analytics and attracting adoption from a wide range of enterprises. From the development and operation of Presto, we witnessed a significant amount of CPU consumption on parsing column-oriented data files in Presto worker nodes. This blocks some companies, including Meta, from increasing analytical data volumes. In this paper, we present a metadata caching layer, built on top of the Alluxio SDK cache and incorporated in each Presto worker node, to cache the intermediate results in file parsing. The metadata cache provides two caching methods: caching the decompressed metadata bytes from raw data files and caching the deserialized metadata objects. Our evaluation of the TPC-DS benchmark on Presto demonstrates that when the cache is warm, the first method can reduce the query's CPU consumption by 10%-20%, whereas the second method can minimize the CPU usage by 20%-40%.
More and more attention has been paid to the segmentation of pulmonary nodules. Among the current methods based on deep learning, 3D segmentation methods directly input 3D images, which takes up a lot of memory and brings huge computation. However, most of the 2D segmentation methods with less parameters and calculation have the problem of lacking spatial relations between slices, resulting in poor segmentation performance. In order to solve these problems, we propose an adjacent slice feature guided 2.5D network. In this paper, we design an adjacent slice feature fusion model to introduce information from adjacent slices. To further improve the model performance, we construct a multi-scale fusion module to capture more context information, in addition, we design an edge-constrained loss function to optimize the segmentation results in the edge region. Fully experiments show that our method performs better than other existing methods in pulmonary nodule segmentation task.