arXiv subjects

Feng Liu

Publications and source records attributed to Feng Liu.

At least 469 records · Page 26Linked to original sources

arXiv2022

Continuous Semi-Supervised Nonnegative Matrix Factorization

Nonnegative matrix factorization can be used to automatically detect topics within a corpus in an unsupervised fashion. The technique amounts to an approximation of a nonnegative matrix as the product of two nonnegative matrices of lower rank. In this paper, we show this factorization can be combined with regression on a continuous response variable. In practice, the method performs better than regression done after topics are identified and retrains interpretability.

cs.CL↗

arXiv2022

Optimal Sizing and Pricing of Renewable Power to Ammonia Systems Considering the Limited Flexibility of Ammonia Synthesis

Converting renewable energy into ammonia has been recognized as a promising way to realize ``green hydrogen substitution" in the chemical industry. However, renewable power to ammonia (RePtA) requires an essential investment in facilities to provide a buffer against the strong volatility of renewable energy and the limited flexibility of ammonia synthesis, which involves the three main stakeholders, namely, power, hydrogen, and ammonia. Therefore, the sizing and pricing of RePtA play a core role in balancing the interest demands of investors. This paper proposes an optimal sizing and pricing method for RePtA system planning. First, power to ammonia (P2A) is modeled as a flexible load, especially considering the limited flexibility of ammonia synthesis, which has been verified using real dynamic regulation data. Second, the multi-investor economic (MIE) model is established considering both external and internal trading modes. Then, a two-stage decomposed sizing and pricing method is proposed to solve the problem caused by the strong coupling of planning, operation, and trading, and information gap decision theory (IGDT) method is utilized to handle the uncertainty of renewable generation. Finally, real data from a real-life system in Inner Mongolia are utilized to verify the proposed approach. The results show that the system proposed has a yield of 8.15%.

eess.SY↗

arXiv2022

Integrally Migrating Pre-trained Transformer Encoder-decoders for Visual Object Detection

Modern object detectors have taken the advantages of backbone networks pre-trained on large scale datasets. Except for the backbone networks, however, other components such as the detector head and the feature pyramid network (FPN) remain trained from scratch, which hinders fully tapping the potential of representation models. In this study, we propose to integrally migrate pre-trained transformer encoder-decoders (imTED) to a detector, constructing a feature extraction path which is ``fully pre-trained" so that detectors' generalization capacity is maximized. The essential differences between imTED with the baseline detector are twofold: (1) migrating the pre-trained transformer decoder to the detector head while removing the randomly initialized FPN from the feature extraction path; and (2) defining a multi-scale feature modulator (MFM) to enhance scale adaptability. Such designs not only reduce randomly initialized parameters significantly but also unify detector training with representation learning intendedly. Experiments on the MS COCO object detection dataset show that imTED consistently outperforms its counterparts by $\sim$2.4 AP. Without bells and whistles, imTED improves the state-of-the-art of few-shot object detection by up to 7.6 AP. Code is available at https://github.com/LiewFeng/imTED.

cs.CV↗

arXiv2022

3D-EPI Blip-Up/Down Acquisition (BUDA) with CAIPI and Joint Hankel Structured Low-Rank Reconstruction for Rapid Distortion-Free High-Resolution T2* Mapping

Purpose: This work aims to develop a novel distortion-free 3D-EPI acquisition and image reconstruction technique for fast and robust, high-resolution, whole-brain imaging as well as quantitative T2* mapping. Methods: 3D-Blip-Up and -Down Acquisition (3D-BUDA) sequence is designed for both single- and multi-echo 3D GRE-EPI imaging using multiple shots with blip-up and -down readouts to encode B0 field map information. Complementary k-space coverage is achieved using controlled aliasing in parallel imaging (CAIPI) sampling across the shots. For image reconstruction, an iterative hard-thresholding algorithm is employed to minimize the cost function that combines field map information informed parallel imaging with the structured low-rank constraint for multi-shot 3D-BUDA data. Extending 3D-BUDA to multi-echo imaging permits T2* mapping. For this, we propose constructing a joint Hankel matrix along both echo and shot dimensions to improve the reconstruction. Results: Experimental results on in vivo multi-echo data demonstrate that, by performing joint reconstruction along with both echo and shot dimensions, reconstruction accuracy is improved compared to standard 3D-BUDA reconstruction. CAIPI sampling is further shown to enhance the image quality. For T2* mapping, T2* values from 3D-Joint-CAIPI-BUDA and reference multi-echo GRE are within limits of agreement as quantified by Bland-Altman analysis. Conclusions: The proposed technique enables rapid 3D distortion-free high-resolution imaging and T2* mapping. Specifically, 3D-BUDA enables 1-mm isotropic whole-brain imaging in 22 s at 3 T and 9 s on a 7 T scanner. The combination of multi-echo 3D-BUDA with CAIPI acquisition and joint reconstruction enables distortion-free whole-brain T2* mapping in 47 s at 1.1x1.1x1.0 mm3 resolution.

eess.IV↗

arXiv2022

View Synthesis of Dynamic Scenes based on Deep 3D Mask Volume

Image view synthesis has seen great success in reconstructing photorealistic visuals, thanks to deep learning and various novel representations. The next key step in immersive virtual experiences is view synthesis of dynamic scenes. However, several challenges exist due to the lack of high-quality training datasets, and the additional time dimension for videos of dynamic scenes. To address this issue, we introduce a multi-view video dataset, captured with a custom 10-camera rig in 120FPS. The dataset contains 96 high-quality scenes showing various visual effects and human interactions in outdoor scenes. We develop a new algorithm, Deep 3D Mask Volume, which enables temporally-stable view extrapolation from binocular videos of dynamic scenes, captured by static cameras. Our algorithm addresses the temporal inconsistency of disocclusions by identifying the error-prone areas with a 3D mask volume, and replaces them with static background observed throughout the video. Our method enables manipulation in 3D space as opposed to simple 2D masks, We demonstrate better temporal stability than frame-by-frame static view synthesis methods, or those that use 2D masks. The resulting view synthesis videos show minimal flickering artifacts and allow for larger translational movements.

cs.CV↗

arXiv2022

Online Optimization in Power Systems with High Penetration of Renewable Generation: Advances and Prospects

Traditionally, offline optimization of power systems is acceptable due to the largely predictable loads and reliable generation. The increasing penetration of fluctuating renewable generation and Internet-of-Things devices allowing for fine-grained controllability of loads have led to the diminishing applicability of offline optimization in the power systems domain, and have redirected attention to online optimization methods. However, online optimization is a broad topic that can be applied in and motivated by different settings, operated on different time scales, and built on different theoretical foundations. This paper reviews the various types of online optimization techniques used in the power systems domain and aims to make clear the distinction between the most common techniques used. In particular, we introduce and compare four distinct techniques used covering the breadth of online optimization techniques used in the power systems domain, i.e., optimization-guided dynamic control, feedback optimization for single-period problems, Lyapunov-based optimization, and online convex optimization techniques for multi-period problems. Lastly, we recommend some potential future directions for online optimization in the power systems domain.

math.OC↗

arXiv2022

Affine Transformation Edited and Refined Deep Neural Network for Quantitative Susceptibility Mapping

Deep neural networks have demonstrated great potential in solving dipole inversion for Quantitative Susceptibility Mapping (QSM). However, the performances of most existing deep learning methods drastically degrade with mismatched sequence parameters such as acquisition orientation and spatial resolution. We propose an end-to-end AFfine Transformation Edited and Refined (AFTER) deep neural network for QSM, which is robust against arbitrary acquisition orientation and spatial resolution up to 0.6 mm isotropic at the finest. The AFTER-QSM neural network starts with a forward affine transformation layer, followed by an Unet for dipole inversion, then an inverse affine transformation layer, followed by a Residual Dense Network (RDN) for QSM refinement. Simulation and in-vivo experiments demonstrated that the proposed AFTER-QSM network architecture had excellent generalizability. It can successfully reconstruct susceptibility maps from highly oblique and anisotropic scans, leading to the best image quality assessments in simulation tests and suppressed streaking artifacts and noise levels for in-vivo experiments compared with other methods. Furthermore, ablation studies showed that the RDN refinement network significantly reduced image blurring and susceptibility underestimation due to affine transformations. In addition, the AFTER-QSM network substantially shortened the reconstruction time from minutes using conventional methods to only a few seconds.

physics.med-ph↗

arXiv2022

Topological field-effect transistor with quantized ON/OFF conductance of helical/chiral dislocation states

Topology is a key ingredient driving the emergence of quantum devices. Topological field-effect transistor (TFET) has been proposed to outperform the conventional FET by replacing the ON state with topology-protected quantized conductance, while the OFF state remains the same normal insulating characteristics and hence bears similar drawbacks. Here, we demonstrate a proof-of-concept TFET having both ON and OFF quantized conductance, by switching between helical and chiral topological screw dislocation (SD) states in three-dimensional topological insulators. A pair of SDs are configured with one acting as channel and the other as gate controlled by local magnetic field. A reversible field-switching is achieved with the ON and OFF conductance of $2e^2/h$ and $e^2/h$, respectively, as shown by tight-binding quantum transport calculations. Furthermore, BaBiO$_3$ is shown as a candidate material having the desired topological SD states, based on first-principles calculations. Our findings open a new route to high-fidelity topological quantum devices.

cond-mat.mtrl-sci↗

arXiv2022

Semiconductor membranes for electrostatic exciton trapping in optically addressable quantum transport devices

Combining the capabilities of gate defined quantum transport devices in GaAs-based heterostructures and of optically addressed self-assembled quantum dots could open broad perspectives for new devices and functionalities. For example, interfacing stationary solid-state qubits with photonic quantum states would open a new pathway towards the realization of a quantum network with extended quantum processing capacity in each node. While gated devices allow very flexible confinement of electrons or holes, the confinement of excitons without some element of self-assembly is much harder. To address this limitation, we introduce a technique to realize exciton traps in quantum wells via local electric fields by thinning a heterostructure down to a 220 nm thick membrane. We show that mobilities over $1 \times 10^{6}$ cm$^{2}$V$^{-1}$s$^{-1}$ can be retained and that quantum point contacts and Coulomb oscillations can be observed on this structure, which implies that the thinning does not compromise the heterostructure quality. Furthermore, the local lowering of the exciton energy via the quantum-confined Stark effect is confirmed, thus forming exciton traps. These results lay the technological foundations for devices like single photon sources, spin photon interfaces and eventually quantum network nodes in GaAs quantum wells, realized entirely with a top-down fabrication process.

cond-mat.mes-hall↗

arXiv2022

Watermarking for Out-of-distribution Detection

Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully unleash their intrinsic strength: without modifying parameters of a well-trained deep model, we can reprogram this model for a new purpose via data-level manipulation (e.g., adding a specific feature perturbation to the data). This property motivates us to reprogram a classification model to excel at OOD detection (a new task), and thus we propose a general methodology named watermarking in this paper. Specifically, we learn a unified pattern that is superimposed onto features of original data, and the model's detection capability is largely boosted after watermarking. Extensive experiments verify the effectiveness of watermarking, demonstrating the significance of the reprogramming property of deep models in OOD detection.

cs.LG↗

arXiv2022

Mix and Reason: Reasoning over Semantic Topology with Data Mixing for Domain Generalization

Domain generalization (DG) enables generalizing a learning machine from multiple seen source domains to an unseen target one. The general objective of DG methods is to learn semantic representations that are independent of domain labels, which is theoretically sound but empirically challenged due to the complex mixture of common and domain-specific factors. Although disentangling the representations into two disjoint parts has been gaining momentum in DG, the strong presumption over the data limits its efficacy in many real-world scenarios. In this paper, we propose Mix and Reason (\mire), a new DG framework that learns semantic representations via enforcing the structural invariance of semantic topology. \mire\ consists of two key components, namely, Category-aware Data Mixing (CDM) and Adaptive Semantic Topology Refinement (ASTR). CDM mixes two images from different domains in virtue of activation maps generated by two complementary classification losses, making the classifier focus on the representations of semantic objects. ASTR introduces relation graphs to represent semantic topology, which is progressively refined via the interactions between local feature aggregation and global cross-domain relational reasoning. Experiments on multiple DG benchmarks validate the effectiveness and robustness of the proposed \mire.

cs.CV↗

arXiv2022

Excitonic Condensate in Flat Valence and Conduction Bands of Opposite Chirality

Excitonic Bose-Einstein condensation (EBEC) has drawn increasing attention recently with the emergence of 2D materials. A general criterion for EBEC, as expected in an excitonic insulator (EI) state, is to have negative exciton formation energies in a semiconductor. Here, using exact diagonalization of multi-exciton Hamiltonian modelled in a diatomic Kagome lattice, we demonstrate that the negative exciton formation energies are only a prerequisite but insufficient condition for realizing an EI. By a comparative study between the cases of both a conduction and valence flat bands (FBs) versus that of a parabolic conduction band, we further show that the presence and increased FB contribution to exciton formation provide an attractive avenue to stabilize the EBEC, as confirmed by calculations and analyses of multi-exciton energies, wave functions and reduced density matrices. Our results warrant a similar many-exciton analysis for other known/new candidates of EIs, and demonstrate the FBs of opposite parity as a unique platform for studying exciton physics, paving the way to material realization of spinor BEC and spin-superfluidity.

cond-mat.str-el↗

arXiv2022

A Perceptual Quality Metric for Video Frame Interpolation

Research on video frame interpolation has made significant progress in recent years. However, existing methods mostly use off-the-shelf metrics to measure the quality of interpolation results with the exception of a few methods that employ user studies, which is time-consuming. As video frame interpolation results often exhibit unique artifacts, existing quality metrics sometimes are not consistent with human perception when measuring the interpolation results. Some recent deep learning-based perceptual quality metrics are shown more consistent with human judgments, but their performance on videos is compromised since they do not consider temporal information. In this paper, we present a dedicated perceptual quality metric for measuring video frame interpolation results. Our method learns perceptual features directly from videos instead of individual frames. It compares pyramid features extracted from video frames and employs Swin Transformer blocks-based spatio-temporal modules to extract spatio-temporal information. To train our metric, we collected a new video frame interpolation quality assessment dataset. Our experiments show that our dedicated quality metric outperforms state-of-the-art methods when measuring video frame interpolation results. Our code and model are made publicly available at \url{https://github.com/hqqxyy/VFIPS}.

cs.CV↗

arXiv2022

A Uniform Representation Learning Method for OCT-based Fingerprint Presentation Attack Detection and Reconstruction

The technology of optical coherence tomography (OCT) to fingerprint imaging opens up a new research potential for fingerprint recognition owing to its ability to capture depth information of the skin layers. Developing robust and high security Automated Fingerprint Recognition Systems (AFRSs) are possible if the depth information can be fully utilized. However, in existing studies, Presentation Attack Detection (PAD) and subsurface fingerprint reconstruction based on depth information are treated as two independent branches, resulting in high computation and complexity of AFRS building.Thus, this paper proposes a uniform representation model for OCT-based fingerprint PAD and subsurface fingerprint reconstruction. Firstly, we design a novel semantic segmentation network which only trained by real finger slices of OCT-based fingerprints to extract multiple subsurface structures from those slices (also known as B-scans). The latent codes derived from the network are directly used to effectively detect the PA since they contain abundant subsurface biological information, which is independent with PA materials and has strong robustness for unknown PAs. Meanwhile, the segmented subsurface structures are adopted to reconstruct multiple subsurface 2D fingerprints. Recognition can be easily achieved by using existing mature technologies based on traditional 2D fingerprints. Extensive experiments are carried on our own established database, which is the largest public OCT-based fingerprint database with 2449 volumes. In PAD task, our method can improve 0.33% Acc from the state-of-the-art method. For reconstruction performance, our method achieves the best performance with 0.834 mIOU and 0.937 PA. By comparing with the recognition performance on surface 2D fingerprints, the effectiveness of our proposed method on high quality subsurface fingerprint reconstruction is further proved.

cs.CV↗

arXiv2022

Two-Stage Submodular Optimization of Dynamic Thermal Rating for Risk Mitigation Considering Placement and Operation Schedule

Cascading failure causes a major risk to society currently. To effectively mitigate the risk, dynamic thermal rating (DTR) technique can be applied as a cost-effective strategy to exploit potential transmission capability. From the perspectives of service life and Braess paradox, it is important and challenging to jointly optimize the DTR placement and operation schedule for changing system state, which is a two-stage combinatorial problem with only discrete variables, suffering from no approximation guarantee and dimension curse only based on traditional models. Thus, the present work proposes a novel two-stage submodular optimization (TSSO) of DTR for risk mitigation considering placement and operation schedule. Specifically, it optimizes DTR placement with proper redundancy in first stage, and then determines the corresponding DTR operation for each system state in second stage. Under the condition of the Markov and submodular features in sub-function of risk mitigation, the submodularity of total objective function of TSSO can be proven for the first time. Based on this, a state-of-the-art efficient solving algorithm is developed that can provide a better approximation guarantee than previous studies by coordinating the separate curvature and error form. The performance of the proposed algorithms is verified by case results.

eess.SY↗

arXiv2022

Meta Discovery: Learning to Discover Novel Classes given Very Limited Data

In novel class discovery (NCD), we are given labeled data from seen classes and unlabeled data from unseen classes, and we train clustering models for the unseen classes. However, the implicit assumptions behind NCD are still unclear. In this paper, we demystify assumptions behind NCD and find that high-level semantic features should be shared among the seen and unseen classes. Based on this finding, NCD is theoretically solvable under certain assumptions and can be naturally linked to meta-learning that has exactly the same assumption as NCD. Thus, we can empirically solve the NCD problem by meta-learning algorithms after slight modifications. This meta-learning-based methodology significantly reduces the amount of unlabeled data needed for training and makes it more practical, as demonstrated in experiments. The use of very limited data is also justified by the application scenario of NCD: since it is unnatural to label only seen-class data, NCD is sampling instead of labeling in causality. Therefore, unseen-class data should be collected on the way of collecting seen-class data, which is why they are novel and first need to be clustered.

cs.LG↗

arXiv2022

TOHAN: A One-step Approach towards Few-shot Hypothesis Adaptation

In few-shot domain adaptation (FDA), classifiers for the target domain are trained with accessible labeled data in the source domain (SD) and few labeled data in the target domain (TD). However, data usually contain private information in the current era, e.g., data distributed on personal phones. Thus, the private information will be leaked if we directly access data in SD to train a target-domain classifier (required by FDA methods). In this paper, to thoroughly prevent the privacy leakage in SD, we consider a very challenging problem setting, where the classifier for the TD has to be trained using few labeled target data and a well-trained SD classifier, named few-shot hypothesis adaptation (FHA). In FHA, we cannot access data in SD, as a result, the private information in SD will be protected well. To this end, we propose a target orientated hypothesis adaptation network (TOHAN) to solve the FHA problem, where we generate highly-compatible unlabeled data (i.e., an intermediate domain) to help train a target-domain classifier. TOHAN maintains two deep networks simultaneously, where one focuses on learning an intermediate domain and the other takes care of the intermediate-to-target distributional adaptation and the target-risk minimization. Experimental results show that TOHAN outperforms competitive baselines significantly.

cs.LG↗

arXiv2022

Negative Interatomic Spring Constant Manifested by Topological Phonon Flat Band

Phonons as bosons are different from electrons as fermions. Unlike interatomic electron hopping that can be either positive or negative and further tuned by spin-orbit coupling, interatomic spring constant is positive, or the structure of atomic lattices would be dynamically unstable. Surprisingly, we found that topological phonon flat bands (FBs) can manifest either a positive or negative interatomic spring constant that couples the FB-modes of opposite chirality, as exemplified by first-principles calculations of a 2D material of Kagome-BN. To reveal its physical origin, we first establish a fundamental correspondence between a collective lattice-coupling (CLC) variable of two quasi-particle states (e.g., electronic states or phonon modes) of opposite parity in a periodic lattice with band topology. Topological semimetals arise with zero CLC at special k-points protected by symmetry; while positive and negative CLC at these k-points gives rise to normal and topological insulators, respectively. Then, we show topological FB has a special form of CLC that vanishes at all k-points as characterized by its real-space wave function, and multi-atom FB phonon mode can manifest effectively a negative interatomic spring constant. Our findings shed new light on our fundamental understanding of topology and provide a practical design principle for creating artificial bosonic topological states.

cond-mat.mtrl-sci↗