arXiv subjects

Ke Chen

Publications and source records attributed to Ke Chen.

At least 253 records · Page 14Linked to original sources

arXiv2022

Fine-Grained Object Classification via Self-Supervised Pose Alignment

Semantic patterns of fine-grained objects are determined by subtle appearance difference of local parts, which thus inspires a number of part-based methods. However, due to uncontrollable object poses in images, distinctive details carried by local regions can be spatially distributed or even self-occluded, leading to a large variation on object representation. For discounting pose variations, this paper proposes to learn a novel graph based object representation to reveal a global configuration of local parts for self-supervised pose alignment across classes, which is employed as an auxiliary feature regularization on a deep representation learning network.Moreover, a coarse-to-fine supervision together with the proposed pose-insensitive constraint on shallow-to-deep sub-networks encourages discriminative features in a curriculum learning manner. We evaluate our method on three popular fine-grained object classification benchmarks, consistently achieving the state-of-the-art performance. Source codes are available at https://github.com/yangxh11/P2P-Net.

cs.CV↗

arXiv2022

Low-rank approximation for multiscale PDEs

Historically, analysis for multiscale PDEs is largely unified while numerical schemes tend to be equation-specific. In this paper, we propose a unified framework for computing multiscale problems through random sampling. This is achieved by incorporating randomized SVD solvers and manifold learning techniques to numerically reconstruct the low-rank features of multiscale PDEs. We use multiscale radiative transfer equation and elliptic equation with rough media to showcase the application of this framework.

math.NA↗

arXiv2022

Classification of Single-View Object Point Clouds

Object point cloud classification has drawn great research attention since the release of benchmarking datasets, such as the ModelNet and the ShapeNet. These benchmarks assume point clouds covering complete surfaces of object instances, for which plenty of high-performing methods have been developed. However, their settings deviate from those often met in practice, where, due to (self-)occlusion, a point cloud covering partial surface of an object is captured from an arbitrary view. We show in this paper that performance of existing point cloud classifiers drops drastically under the considered single-view, partial setting; the phenomenon is consistent with the observation that semantic category of a partial object surface is less ambiguous only when its distribution on the whole surface is clearly specified. To this end, we argue for a single-view, partial setting where supervised learning of object pose estimation should be accompanied with classification. Technically, we propose a baseline method of Pose-Accompanied Point cloud classification Network (PAPNet); built upon SE(3)-equivariant convolutions, the PAPNet learns intermediate pose transformations for equivariant features defined on vector fields, which makes the subsequent classification easier (ideally) in the category-level, canonical pose. By adapting existing ModelNet40 and ScanNet datasets to the single-view, partial setting, experiment results can verify the necessity of object pose estimation and superiority of our PAPNet to existing classifiers.

cs.CV↗

arXiv2022

Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data

Deep learning techniques for separating audio into different sound sources face several challenges. Standard architectures require training separate models for different types of audio sources. Although some universal separators employ a single model to target multiple sources, they have difficulty generalizing to unseen sources. In this paper, we propose a three-component pipeline to train a universal audio source separator from a large, but weakly-labeled dataset: AudioSet. First, we propose a transformer-based sound event detection system for processing weakly-labeled training data. Second, we devise a query-based audio separation model that leverages this data for model training. Third, we design a latent embedding processor to encode queries that specify audio targets for separation, allowing for zero-shot generalization. Our approach uses a single model for source separation of multiple sound types, and relies solely on weakly-labeled data for training. In addition, the proposed audio separator can be used in a zero-shot setting, learning to separate types of audio sources that were never seen in training. To evaluate the separation performance, we test our model on MUSDB18, while training on the disjoint AudioSet. We further verify the zero-shot performance by conducting another experiment on audio source types that are held-out from training. The model achieves comparable Source-to-Distortion Ratio (SDR) performance to current supervised models in both cases.

cs.SD↗

arXiv2022

HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection

Audio classification is an important task of mapping audio samples into their corresponding labels. Recently, the transformer model with self-attention mechanisms has been adopted in this field. However, existing audio transformers require large GPU memories and long training time, meanwhile relying on pretrained vision models to achieve high performance, which limits the model's scalability in audio tasks. To combat these problems, we introduce HTS-AT: an audio transformer with a hierarchical structure to reduce the model size and training time. It is further combined with a token-semantic module to map final outputs into class featuremaps, thus enabling the model for the audio event detection (i.e. localization in time). We evaluate HTS-AT on three datasets of audio classification where it achieves new state-of-the-art (SOTA) results on AudioSet and ESC-50, and equals the SOTA on Speech Command V2. It also achieves better performance in event localization than the previous CNN-based models. Moreover, HTS-AT requires only 35% model parameters and 15% training time of the previous audio transformer. These results demonstrate the high performance and high efficiency of HTS-AT.

cs.SD↗

arXiv2022

TONet: Tone-Octave Network for Singing Melody Extraction from Polyphonic Music

Singing melody extraction is an important problem in the field of music information retrieval. Existing methods typically rely on frequency-domain representations to estimate the sung frequencies. However, this design does not lead to human-level performance in the perception of melody information for both tone (pitch-class) and octave. In this paper, we propose TONet, a plug-and-play model that improves both tone and octave perceptions by leveraging a novel input representation and a novel network architecture. First, we present an improved input representation, the Tone-CFP, that explicitly groups harmonics via a rearrangement of frequency-bins. Second, we introduce an encoder-decoder architecture that is designed to obtain a salience feature map, a tone feature map, and an octave feature map. Third, we propose a tone-octave fusion mechanism to improve the final salience feature map. Experiments are done to verify the capability of TONet with various baseline backbone models. Our results show that tone-octave fusion with Tone-CFP can significantly improve the singing voice extraction performance across various datasets -- with substantial gains in octave and tone accuracy.

eess.AS↗

arXiv2021

The Muskat problem with $C^1$ data

In this paper we prove that the Cauchy problem of the Muskat equation is wellposed locally in time for any initial data in $\dot C^1(\mathbb{R}^d)\cap L^2(\mathbb{R}^d)$.

math.AP↗

arXiv2021

The Peskin problem with $\dot B^1_{\infty,\infty}$ initial data

In this paper we study the Peskin problem in 2D, which describes the dynamics of a 1D closed elastic structure immersed in a steady Stokes flow. We prove the local well-posedness for arbitrary initial configuration in $(C^2)^{\dot B^1_{\infty,\infty}}$ satisfying the well-stretched condition, and the global well-posedness when the initial configuration is sufficiently close to an equilibrium in $\dot B^1_{\infty,\infty}$. Here $(C^2)^{\dot B^1_{\infty,\infty}}$ is the closure of $C^2$ in the Besov space $\dot B^1_{\infty,\infty}$. The global-in-time solution will converge to an equilibrium exponentially as $t\rightarrow+\infty$. This is the first well-posedness result for the Peskin problem with non-Lipschitz initial data.

math.AP↗

arXiv2021

Using Deep Image Prior to Assist Variational Selective Segmentation Deep Learning Algorithms

Variational segmentation algorithms require a prior imposed in the form of a regularisation term to enforce smoothness of the solution. Recently, it was shown in the Deep Image Prior work that the explicit regularisation in a model can be removed and replaced by the implicit regularisation captured by the architecture of a neural network. The Deep Image Prior approach is competitive, but is only tailored to one specific image and does not allow us to predict future images. We propose to incorporate the ideas from Deep Image Prior into a more traditional learning algorithm to allow us to use the implicit regularisation offered by the Deep Image Prior, but still be able to predict future images.

cs.CV↗

arXiv2021

Synthesis and thermal expansion of chalcogenide MAX phase Hf2SeC

Thermal expansion of MAX phases along different directions tended to be different because of the anisotropy of hexagonal crystals. Herein, a new Hf2SeC phase was synthesized and confirmed to be relatively isotropic, whose coefficients of thermal expansion (CTEs) were determined to be 9.73 μK-1 and 10.18 μK-1 along a and c directions. The strong M-S bond endowed Hf2SC and Zr2SC lower CTEs than Hf2SeC and Zr2SeC. A good relationship between the thermal expansion anisotropy and the ratio of elastic stiffness constant c11 and c33 was established. This straightforward approximation could be used to roughly predict the thermal expansion anisotropy of MAX phases.

cond-mat.mtrl-sci↗

arXiv2021

Tunable mid-infrared hyperbolic van der Waals metasurfaces by strong plasmon-phonon polaritons coupling

Hyperbolic metasurfaces based on van der Waals (vdW) materials support propagation of extremely anisotropic polaritons towards nanoscale light compression and manipulation, and thus has great potential in the applications of planar hyperlens, nanolasing, quantum optics and ultrasensitive infrared spectroscopy. Two-dimensional hexagonal boron nitride (h-BN) as a vdW metasurface can manipulate the propagation of hyperbolic polaritons at the level of single atomic layers, possessing higher degree of field confinement and lower losses than the conventional media. However, active manipulation of hyperbolic polaritonic waves in h-BN midinfrared metasurfaces remains elusive. Herein, we provide an effective strategy for constructing tunable mid-infrared hyperbolic vdW metasurfaces (HMSs). They are composed of meta-atoms that are the in-plane heterostructures of thin-layer h-BN and monolayer graphene strips (iHBNG). The strong coupling of h-BN phonons and graphene plasmons enables the large tunability of light fields by tailoring chemical potentials of graphene without frequency shift, which involves topological transitions of polaritonic modes, unidirectional polariton propagation and local-density-of-state enhancement. Simulated visual near-field distributions of iHBNG metasurfaces reveal the unique transformations of hyperbolic polariton propagations, distinguished from that of individual h-BN and graphene metasurfaces. Our findings provide a platform of optical nanomanipulation towards emerging on-chip polaritonic devices.

physics.optics↗

arXiv2021

Sparse Steerable Convolutions: An Efficient Learning of SE(3)-Equivariant Features for Estimation and Tracking of Object Poses in 3D Space

As a basic component of SE(3)-equivariant deep feature learning, steerable convolution has recently demonstrated its advantages for 3D semantic analysis. The advantages are, however, brought by expensive computations on dense, volumetric data, which prevent its practical use for efficient processing of 3D data that are inherently sparse. In this paper, we propose a novel design of Sparse Steerable Convolution (SS-Conv) to address the shortcoming; SS-Conv greatly accelerates steerable convolution with sparse tensors, while strictly preserving the property of SE(3)-equivariance. Based on SS-Conv, we propose a general pipeline for precise estimation of object poses, wherein a key design is a Feature-Steering module that takes the full advantage of SE(3)-equivariance and is able to conduct an efficient pose refinement. To verify our designs, we conduct thorough experiments on three tasks of 3D object semantic analysis, including instance-level 6D pose estimation, category-level 6D pose and size estimation, and category-level 6D pose tracking. Our proposed pipeline based on SS-Conv outperforms existing methods on almost all the metrics evaluated by the three tasks. Ablation studies also show the superiority of our SS-Conv over alternative convolutions in terms of both accuracy and efficiency. Our code is released publicly at https://github.com/Gorilla-Lab-SCUT/SS-Conv.

cs.CV↗

arXiv2021

Global Calderón--Zygmund theory for parabolic $p$-Laplacian system: the case $1<p\leq \frac{2n}{n+2}$

The aim of this paper is to establish global Calderón--Zygmund theory to parabolic $p$-Laplacian system: $$ u_t -\operatorname{div}(|\nabla u|^{p-2}\nabla u) = \operatorname{div} (|F|^{p-2}F)~\text{in}~Ω\times (0,T)\subset \mathbb{R}^{n+1}, $$ proving that $$F\in L^q\Rightarrow \nabla u\in L^q,$$ for any $q>\max\{p,\frac{n(2-p)}{2}\}$ and $p>1$. Acerbi and Mingione \cite{Acerbi07} proved this estimate in the case $p>\frac{2n}{n+2}$. In this article we settle the case $1<p\leq \frac{2n}{n+2}$. We also treat systems with discontinuous coefficients having small BMO (bounded mean oscillation) norm.

math.AP↗

arXiv2021

Tensor-structured sketching for constrained least squares

Constrained least squares problems arise in many applications. Their memory and computation costs are expensive in practice involving high-dimensional input data. We employ the so-called "sketching" strategy to project the least squares problem onto a space of a much lower "sketching dimension" via a random sketching matrix. The key idea of sketching is to reduce the dimension of the problem as much as possible while maintaining the approximation accuracy. Tensor structure is often present in the data matrices of least squares, including linearized inverse problems and tensor decompositions. In this work, we utilize a general class of row-wise tensorized sub-Gaussian matrices as sketching matrices in constrained optimizations for the sketching design's compatibility with tensor structures. We provide theoretical guarantees on the sketching dimension in terms of error criterion and probability failure rate. In the context of unconstrained linear regressions, we obtain an optimal estimate for the sketching dimension. For optimization problems with general constraint sets, we show that the sketching dimension depends on a statistical complexity that characterizes the geometry of the underlying problems. Our theories are demonstrated in a few concrete examples, including unconstrained linear regression and sparse recovery problems.

math.OC↗

arXiv2021

Geometry-Aware Self-Training for Unsupervised Domain Adaptationon Object Point Clouds

The point cloud representation of an object can have a large geometric variation in view of inconsistent data acquisition procedure, which thus leads to domain discrepancy due to diverse and uncontrollable shape representation cross datasets. To improve discrimination on unseen distribution of point-based geometries in a practical and feasible perspective, this paper proposes a new method of geometry-aware self-training (GAST) for unsupervised domain adaptation of object point cloud classification. Specifically, this paper aims to learn a domain-shared representation of semantic categories, via two novel self-supervised geometric learning tasks as feature regularization. On one hand, the representation learning is empowered by a linear mixup of point cloud samples with their self-generated rotation labels, to capture a global topological configuration of local geometries. On the other hand, a diverse point distribution across datasets can be normalized with a novel curvature-aware distortion localization. Experiments on the PointDA-10 dataset show that our GAST method can significantly outperform the state-of-the-art methods.

cs.CV↗

arXiv2021

Neural-to-Tree Policy Distillation with Policy Improvement Criterion

While deep reinforcement learning has achieved promising results in challenging decision-making tasks, the main bones of its success --- deep neural networks are mostly black-boxes. A feasible way to gain insight into a black-box model is to distill it into an interpretable model such as a decision tree, which consists of if-then rules and is easy to grasp and be verified. However, the traditional model distillation is usually a supervised learning task under a stationary data distribution assumption, which is violated in reinforcement learning. Therefore, a typical policy distillation that clones model behaviors with even a small error could bring a data distribution shift, resulting in an unsatisfied distilled policy model with low fidelity or low performance. In this paper, we propose to address this issue by changing the distillation objective from behavior cloning to maximizing an advantage evaluation. The novel distillation objective maximizes an approximated cumulative reward and focuses more on disastrous behaviors in critical states, which controls the data shift effect. We evaluate our method on several Gym tasks, a commercial fight game, and a self-driving car simulator. The empirical results show that the proposed method can preserve a higher cumulative reward than behavior cloning and learn a more consistent policy to the original one. Moreover, by examining the extracted rules from the distilled decision trees, we demonstrate that the proposed method delivers reasonable and robust decisions.

cs.LG↗

arXiv2021

GLIB: Towards Automated Test Oracle for Graphically-Rich Applications

Graphically-rich applications such as games are ubiquitous with attractive visual effects of Graphical User Interface (GUI) that offers a bridge between software applications and end-users. However, various types of graphical glitches may arise from such GUI complexity and have become one of the main component of software compatibility issues. Our study on bug reports from game development teams in NetEase Inc. indicates that graphical glitches frequently occur during the GUI rendering and severely degrade the quality of graphically-rich applications such as video games. Existing automated testing techniques for such applications focus mainly on generating various GUI test sequences and check whether the test sequences can cause crashes. These techniques require constant human attention to captures non-crashing bugs such as bugs causing graphical glitches. In this paper, we present the first step in automating the test oracle for detecting non-crashing bugs in graphically-rich applications. Specifically, we propose \texttt{GLIB} based on a code-based data augmentation technique to detect game GUI glitches. We perform an evaluation of \texttt{GLIB} on 20 real-world game apps (with bug reports available) and the result shows that \texttt{GLIB} can achieve 100\% precision and 99.5\% recall in detecting non-crashing bugs such as game GUI glitches. Practical application of \texttt{GLIB} on another 14 real-world games (without bug reports) further demonstrates that \texttt{GLIB} can effectively uncover GUI glitches, with 48 of 53 bugs reported by \texttt{GLIB} having been confirmed and fixed so far.

cs.SE↗

arXiv2021

Near-Room-Temperature Ferromagnetic Behavior of Single-Atom-Thick 2D Iron in Nanolaminated Ternary MAX Phases

Two dimensional (2D) ferromagnetic materials have attracted much attention in the fields of condensed matter physics and materials science, but their synthesis is still a challenge given their limitations on structural stability and susceptibility to oxidization. MAX phases nanolaminated ternary carbides or nitrides possess a unique crystal structure in which single-atom-thick A sublayers are interleaved by two dimensional MX slabs, providing nanostructured templates for designing 2D ferromagnetic materials if the non-magnetic A sublayers can be substituted replaced by magnetic elements. Here, we report three new ternary magnetic MAX phases (Ta2FeC, Ti2FeN and Nb2FeC) with A sublayers of single-atom-thick 2D iron through an isomorphous replacement reaction of MAX precursors (Ta2AlC, Ti2AlN and Nb2AlC) with a Lewis acid salts (FeCl2). All these MAX phases exhibit ferromagnetic (FM) behavior. The Curie temperature (Tc) of Ta2FeC and Nb2FeC MAX phase are 281 K and 291 K, respectively, i.e. close to room temperature. The saturation magnetization of these ternary magnetic MAX phases is almost two orders of magnitude higher than that of V2(Sn,Fe)C MAX phase whose A-site is partial substituted by Fe. Theoretical calculations on magnetic orderings of spin moments of Fe atoms in these nanolaminated magnetic MAX phases reveal that the magnetism can be mainly ascribed to intralayer exchange interaction of the 2D Fe atomic layers. Owning to the richness in composition of MAX phases, there is a large compositional space for constructing functional single-atom-thick 2D layers in materials using these nanolaminated templates.

cond-mat.mtrl-sci↗