arXiv Science⌕ Search

arXiv subjects

Jie Liu

Publications and source records attributed to Jie Liu.

At least 505 records · Page 28Linked to original sources
arXiv2022

Open Set Recognition using Vision Transformer with an Additional Detection Head

Deep neural networks have demonstrated prominent capacities for image classification tasks in a closed set setting, where the test data come from the same distribution as the training data. However, in a more realistic open set scenario, traditional classifiers with incomplete knowledge cannot tackle test data that are not from the training classes. Open set recognition (OSR) aims to address this problem by both identifying unknown classes and distinguishing known classes simultaneously. In this paper, we propose a novel approach to OSR that is based on the vision transformer (ViT) technique. Specifically, our approach employs two separate training stages. First, a ViT model is trained to perform closed set classification. Then, an additional detection head is attached to the embedded features extracted by the ViT, trained to force the representations of known data to class-specific clusters compactly. Test examples are identified as known or unknown based on their distance to the cluster centers. To the best of our knowledge, this is the first time to leverage ViT for the purpose of OSR, and our extensive evaluation against several OSR benchmark datasets reveals that our approach significantly outperforms other baseline methods and obtains new state-of-the-art performance.

cs.CV↗
arXiv2022

Cost-effective BlackWater Raft on Highly Unreliable Nodes at Scale Out

The Raft algorithm maintains strong consistency across data replicas in Cloud. This algorithm divides nodes into leaders and followers, to satisfy read/write requests spanning geo-diverse sites. With the increase of workload, Raft shall provide scale-out performance in proportion. However, traditional scale-out techniques encounter bottlenecks in Raft, and when the provisioned sites exhaust local resources, the performance loss will grow exponentially. To provide scalability in Raft, this paper proposes a cost-effective mechanism for elastic auto-scaling in Raft, called BlackWater-Raft or BW-Raft. BW-Raft extends the original Raft with the following abstractions: (1) secretary nodes that take over expensive log synchronization operations from the leader, relaxing the performance constraints on locks. (2) massive low cost observer nodes that handle reads only, improving throughput for typical data intensive services. These abstractions are stateless, allowing elastic scale-out on unreliable yet cheap spot instances. In theory, we demonstrate that BW-Raft can maintain Raft's strong consistency guarantees when scaling out, processing a 50X increase in the number of nodes compared to the original Raft. We have prototyped the BW-Raft on key-value services and evaluated it with many state-of-the-arts on Amazon EC2 and Alibaba Cloud. Our results show that within the same budget, BW-Raft's resource footprint increments are 5-7X smaller than Multi-Raft, and 2X better than original Raft. Using spot instances, BW-Raft can reduces costs by 84.5\% compared to Multi-Raft. In the real world experiments, BW-Raft improves goodput of the 95th-percentile SLO by 9.4X, thus serving as an alternative for services scaling out with strong consistency.

cs.DC↗
arXiv2022

From General to Specific: Online Updating for Blind Super-Resolution

Most deep learning-based super-resolution (SR) methods are not image-specific: 1) They are trained on samples synthesized by predefined degradations (e.g. bicubic downsampling), regardless of the domain gap between training and testing data. 2) During testing, they super-resolve all images by the same set of model weights, ignoring the degradation variety. As a result, most previous methods may suffer a performance drop when the degradations of test images are unknown and various (i.e. the case of blind SR). To address these issues, we propose an online SR (ONSR) method. It does not rely on predefined degradations and allows the model weights to be updated according to the degradation of the test image. Specifically, ONSR consists of two branches, namely internal branch (IB) and external branch (EB). IB could learn the specific degradation of the given test LR image, and EB could learn to super resolve images degraded by the learned degradation. In this way, ONSR could customize a specific model for each test image, and thus get more robust to various degradations. Extensive experiments on both synthesized and real-world images show that ONSR can generate more visually favorable SR results and achieve state-of-the-art performance in blind SR.

cs.CV↗
arXiv2022

On moment map and bigness of tangent bundles of $G$-varieties

Let $G$ be a connected algebraic group and let $X$ be a smooth projective $G$-variety. In this paper, we prove a sufficient criterion to determine the bigness of the tangent bundle $TX$ using the moment map $Φ_X^G:T^*X\rightarrow \mathfrak{g}^*$. As an application, the bigness of the tangent bundles of certain quasi-homogeneous varieties are verified, including symmetric varieties, horospherical varieties and equivariant compactifications of commutative linear algebraic groups. Finally, we study in details the Fano manifolds $X$ with Picard number $1$ which is an equivariant compactification of a vector group $\mathbb{G}_a^n$. In particular, we will determine the pseudoeffective cone of $\mathbb{P}(T^*X)$ and show that the image of the projectivised moment map along the boundary divisor $D$ of $X$ is projectively equivalent to the dual variety of the VMRT of $X$.

math.AG↗
arXiv2022

Privacy protection based on mask template

Powerful recognition algorithms are widely used in the Internet or important medical systems, which poses a serious threat to personal privacy. Although the law provides for diversity protection, e.g. The General Data Protection Regulation (GDPR) in Europe and Articles 1032 to 1039 of the civil code in China. However, as an important privacy disclosure event, biometric data is often hidden, which is difficult for the owner to detect and trace to the source. Human biometrics generally exist in images. In order to avoid the disclosure of personal privacy, we should prevent unauthorized recognition algorithms from acquiring the real features of the original image.

cs.CR↗
arXiv2022

Application of Color Block Code in Image Scaling

Aiming at the high cost of embedding annotation watermark in a narrow small area and the information distortion caused by the change of annotation watermark image resolution, this paper proposes a color block code technology, which uses location information and color code to form recognizable graphics, which can not only simplify the annotation graphics, but also ensure the recognition efficiency. First, the constituent elements of color block code are designed, and then the coding and decoding method of color block code is proposed. Experiments show that color block code has high anti-scaling and anti-interference, and can be widely used in the labeling of small object surface and low resolution image.

cs.GR↗
arXiv2022

A practical algorithm to minimize the overall error in FEM computations

Using the standard finite element method (FEM) to solve general partial differential equations, the round-off error is found to be proportional to $N^{β_{\rm R}}$, with $N$ the number of degrees of freedom (DoFs) and $β_{\rm R}$ a coefficient. A method which uses a few cheap numerical experiments is proposed to determine the coefficient of proportionality and $β_{\rm R}$ in various space dimensions and FEM packages. Using the coefficients obtained above, the strategy put forward in \cite{liu386balancing} for predicting the highest achievable accuracy $E_{\rm min}$ and the associated optimal number of DoFs $N_{\rm opt}$ for specific problems is extended to general problems. This strategy allows predicting $E_{\rm min}$ accurately for general problems, with the CPU time for obtaining the solution with the highest accuracy $E_{\rm min}$ typically reduced by 60\%--90\%.

math.NA↗
arXiv2022

Reducing circuit depth in adaptive variational quantum algorithms via effective Hamiltonian theories

Electronic structure simulation is an anticipated application for quantum computers. Due to high-dimensional quantum entanglement in strongly correlated systems, the quantum resources required to perform such simulations are far beyond the capacity of current quantum devices. To reduce the quantum circuit complexity, it has been suggested to incorporate a part of the electronic correlation into an effective Hamiltonian, which is often obtained from a similarity transformation of the electronic Hamiltonian. In this work, we introduce a new transformation in the form of a product of a linear combination of excitation operators to construct the effective Hamiltonian with finite terms. To demonstrate its accuracy, we also consider an equivalent adaptive variational algorithm with this transformation and show that it can obtain an accurate ground state wave function. The effective Hamiltonian defined with this new transformation is incorporated into the adaptive variational quantum algorithms to maintain constant-size quantum circuits. The new computational scheme is assessed by performing numerical simulations for small molecules. Chemical accuracy is achieved with a much shallower circuit depth.

quant-ph↗
arXiv2021

Resonant tunneling of deuteron-triton fusion in strong high-frequency electromagnetic fields

We investigate deuteron-triton (DT) fusion in the presence of linearly polarized strong electromagnetic fields in high-frequency limit, in which a complex spherical square-well potential is exploited to describe the nuclear potential. Within the framework of the Kramers-Henneberger (KH) transformation, we have calculated the total and angular differential fusion cross sections by investigating the asymptotical phase shifts of the Coulomb wavefunctions. With introducing a dimensionless quantity of $n_d$ representing the ratio of the particle quiver oscillation amplitude to the radius of nuclear potential, we find that, even though the tunneling probability of passing through the Coulomb repulsive potential keeps almost identical to that in the absence of electromagnetic fields, the peak of total fusion sections shows an apparent shift from the well known value of 110 keV to 78 keV for $n_d=0.01$. The angular differential cross sections also show some resonance peaks that shift from zero inclination angle to $π/2$ with increasing the parameter $n_d$. The corresponding astrophysical $S$-factors are found to be enhanced by several times in amplitudes. With the help of Wentzel-Kramers-Brillouin (WKB) approximate wavefunctions, the shape-resonance tunneling mechanism of the above findings are uncovered and some implications are discussed.

nucl-th↗
arXiv2021

Cross-domain User Preference Learning for Cold-start Recommendation

Cross-domain cold-start recommendation is an increasingly emerging issue for recommender systems. Existing works mainly focus on solving either cross-domain user recommendation or cold-start content recommendation. However, when a new domain evolves at its early stage, it has potential users similar to the source domain but with much fewer interactions. It is critical to learn a user's preference from the source domain and transfer it into the target domain, especially on the newly arriving contents with limited user feedback. To bridge this gap, we propose a self-trained Cross-dOmain User Preference LEarning (COUPLE) framework, targeting cold-start recommendation with various semantic tags, such as attributes of items or genres of videos. More specifically, we consider three levels of preferences, including user history, user content and user group to provide reliable recommendation. With user history represented by a domain-aware sequential model, a frequency encoder is applied to the underlying tags for user content preference learning. Then, a hierarchical memory tree with orthogonal node representation is proposed to further generalize user group preference across domains. The whole framework updates in a contrastive way with a First-In-First-Out (FIFO) queue to obtain more distinctive representations. Extensive experiments on two datasets demonstrate the efficiency of COUPLE in both user and content cold-start situations. By deploying an online A/B test for a week, we show that the Click-Through-Rate (CTR) of COUPLE is superior to other baselines used on Taobao APP. Now the method is serving online for the cross-domain cold micro-video recommendation.

cs.IR↗
arXiv2021

AdaDM: Enabling Normalization for Image Super-Resolution

Normalization like Batch Normalization (BN) is a milestone technique to normalize the distributions of intermediate layers in deep learning, enabling faster training and better generalization accuracy. However, in fidelity image Super-Resolution (SR), it is believed that normalization layers get rid of range flexibility by normalizing the features and they are simply removed from modern SR networks. In this paper, we study this phenomenon quantitatively and qualitatively. We found that the standard deviation of the residual feature shrinks a lot after normalization layers, which causes the performance degradation in SR networks. Standard deviation reflects the amount of variation of pixel values. When the variation becomes smaller, the edges will become less discriminative for the network to resolve. To address this problem, we propose an Adaptive Deviation Modulator (AdaDM), in which a modulation factor is adaptively predicted to amplify the pixel deviation. For better generalization performance, we apply BN in state-of-the-art SR networks with the proposed AdaDM. Meanwhile, the deviation amplification strategy in AdaDM makes the edge information in the feature more distinguishable. As a consequence, SR networks with BN and our AdaDM can get substantial performance improvements on benchmark datasets. Extensive experiments have been conducted to show the effectiveness of our method.

eess.IV↗
arXiv2021

Auto robust relative radiometric normalization via latent change noise modelling

Relative radiometric normalization(RRN) of different satellite images of the same terrain is necessary for change detection, object classification/segmentation, and map-making tasks. However, traditional RRN models are not robust, disturbing by object change, and RRN models precisely considering object change can not robustly obtain the no-change set. This paper proposes auto robust relative radiometric normalization methods via latent change noise modeling. They utilize the prior knowledge that no change points possess small-scale noise under relative radiometric normalization and that change points possess large-scale radiometric noise after radiometric normalization, combining the stochastic expectation maximization method to quickly and robustly extract the no-change set to learn the relative radiometric normalization mapping functions. This makes our model theoretically grounded regarding the probabilistic theory and mathematics deduction. Specifically, when we select histogram matching as the relative radiometric normalization learning scheme integrating with the mixture of Gaussian noise(HM-RRN-MoG), the HM-RRN-MoG model achieves the best performance. Our model possesses the ability to robustly against clouds/fogs/changes. Our method naturally generates a robust evaluation indicator for RRN that is the no-change set root mean square error. We apply the HM-RRN-MoG model to the latter vegetation/water change detection task, which reduces the radiometric contrast and NDVI/NDWI differences on the no-change set, generates consistent and comparable results. We utilize the no-change set into the building change detection task, efficiently reducing the pseudo-change and boosting the precision.

cs.CV↗
arXiv2021

Algebraic fibre spaces with strictly nef relative anti-log canonical divisor

Let $(X,Δ)$ be a projective klt pair, and $f:X\to Y$ a fibration to a smooth projective variety $Y$ with strictly nef relative anti-log canonical divisor $-(K_{X/Y}+Δ)$. We prove that $f$ is a locally constant fibration with rationally connected fibres, and the base $Y$ is a canonically polarized hyperbolic projective manifold. In particular, when $Y$ is a single point, we establish that $X$ is rationally connected. Moreover, when $\dim X=3$ and $-(K_X+Δ)$ is strictly nef, we prove that $-(K_X+Δ)$ is ample, which confirms the singular version of a conjecture of Campana-Peternell for threefolds.

math.AG↗
arXiv2021

An Eclipsing Black Widow Pulsar in NGC 6712

We report the discovery of the first radio pulsar associated with NGC 6712, an eclipsing black widow (BW) pulsar, J1853$-$0842A, found by high-sensitivity searches using the Five-hundred-meter Aperture Spherical radio Telescope. This 2.15 ms pulsar is in a 3.56 hr compact circular orbit with a very low mass companion likely of mass 0.018 to 0.036 $M_{\rm \odot}$ and exhibits eclipsing of the pulsar signal. Though the distance to PSR J1853$-$0842A predicted from its dispersion measure ($155.125 \pm 0.004$ cm$^{-3}$ pc) and Galactic free electron density models are about 30\% smaller than that of NGC 6712 obtained from interstellar reddening measurements, this is likely due to limited knowledge about the spiral arms and Scutum stellar cloud in this direction. Follow-up timing observations spanning 445 days allow us to localize the pulsar's position to be 0.14 core radii from the center of NGC 6712 and measure a negative spin-down rate for this pulsar of $-2.39(2)\times10^{-21}\rm s s^{-1}$. The latter cannot be explained without the acceleration of the GC and decisively supports the association between PSR J1853--0842A and NGC 6712. Considering the maximum GC acceleration, Galactic acceleration, and Shklovskii effect, we place an upper limit on the intrinsic spin-down rate to be $1.11\times10^{-20}\rm~s~s^{-1}$. From an analysis of the eclipsing observations, we estimate the electron density of the eclipse region to be about $1.88\times10^6\rm cm^{-3}$. We also place an upper limit of the accretion rate from the companion is about $3.05\times10^{-13}~M_{\rm \odot}\rm~yr^{-1}$ which is comparable with some other BWs.

astro-ph.HE↗
arXiv2021

Observations of Forbush Decreases of cosmic ray electrons and positrons with the Dark Matter Particle Explorer

The Forbush Decrease (FD) represents the rapid decrease of the intensities of charged particles accompanied with the coronal mass ejections (CMEs) or high-speed streams from coronal holes. It has been mainly explored with ground-based neutron monitors network which indirectly measure the integrated intensities of all species of cosmic rays by counting secondary neutrons produced from interaction between atmosphere atoms and cosmic rays. The space-based experiments can resolve the species of particles but the energy ranges are limited by the relative small acceptances except for the most abundant particles like protons and helium. Therefore, the FD of cosmic ray electrons and positrons have just been investigated by the PAMELA experiment in the low energy range ($<5$ GeV) with limited statistics. In this paper, we study the FD event occurred in September, 2017, with the electron and positron data recorded by the Dark Matter Particle Explorer. The evolution of the FDs from 2 GeV to 20 GeV with a time resolution of 6 hours are given. We observe two solar energetic particle events in the time profile of the intensity of cosmic rays, the earlier and weak one has not been shown in the neutron monitor data. Furthermore, both the amplitude and recovery time of fluxes of electrons and positrons show clear energy-dependence, which is important in probing the disturbances of the interplanetary environment by the coronal mass ejections.

astro-ph.HE↗
arXiv2021

Optical potential parameters of light nuclear fusion based on precise Coulomb wave functions

Based on precise Coulomb wave functions (CWFs), we attempt to calculate the fusion cross sections of light nuclei in a complex spherical square-well nuclear potential (i.e., optical potential model). Comparing with experimental benchmark cross section data, we can calibrate optical potential parameters associated with D+D, D+T, D+3He, p+D, p+6Li and p+7Li fusion reactions. Surprisingly, we find that our calculated optical potential parameters are quite different from those of many previous results (e.g., Phys. Rev. C. 61 (2000) 024610, Nucl. Phys. A 986 (2019) 98, etc.), in which approximate Coulomb wave functions (ACWFs) with only retaining the leading terms are exploited for the continuity conditions at the radius of nuclear potential. Furthermore, with the obtained optical potential parameters, we compare the fusion cross sections and astrophysical S-factors with that formulated from ACWFs approach, and also find apparent deviations especially for the fusion reactions with resonance peaks such as D+T and D+3He fusion reactions. We then calculate the phase diagrams of the fusion cross sections with respect to the optical potential parameters and demonstrate several narrow shape resonance belts. It implies that a small deviation of ACWFs from the exact CWFs at nuclear radius might lead to fall off the resonance regimes and therefore causes the big difference on the optical parameters as well as the cross sections.

nucl-th↗
arXiv2021

Anchor-based Plain Net for Mobile Image Super-Resolution

Along with the rapid development of real-world applications, higher requirements on the accuracy and efficiency of image super-resolution (SR) are brought forward. Though existing methods have achieved remarkable success, the majority of them demand plenty of computational resources and large amount of RAM, and thus they can not be well applied to mobile device. In this paper, we aim at designing efficient architecture for 8-bit quantization and deploy it on mobile device. First, we conduct an experiment about meta-node latency by decomposing lightweight SR architectures, which determines the portable operations we can utilize. Then, we dig deeper into what kind of architecture is beneficial to 8-bit quantization and propose anchor-based plain net (ABPN). Finally, we adopt quantization-aware training strategy to further boost the performance. Our model can outperform 8-bit quantized FSRCNN by nearly 2dB in terms of PSNR, while satisfying realistic needs at the same time. Code is avaliable at https://github.com/NJU- Jet/SR_Mobile_Quantization.

eess.IV↗