arXiv subjects

Feng Liu

Publications and source records attributed to Feng Liu.

At least 541 records · Page 30Linked to original sources

arXiv2021

Fast Monte Carlo Rendering via Multi-Resolution Sampling

Monte Carlo rendering algorithms are widely used to produce photorealistic computer graphics images. However, these algorithms need to sample a substantial amount of rays per pixel to enable proper global illumination and thus require an immense amount of computation. In this paper, we present a hybrid rendering method to speed up Monte Carlo rendering algorithms. Our method first generates two versions of a rendering: one at a low resolution with a high sample rate (LRHS) and the other at a high resolution with a low sample rate (HRLS). We then develop a deep convolutional neural network to fuse these two renderings into a high-quality image as if it were rendered at a high resolution with a high sample rate. Specifically, we formulate this fusion task as a super resolution problem that generates a high resolution rendering from a low resolution input (LRHS), assisted with the HRLS rendering. The HRLS rendering provides critical high frequency details which are difficult to recover from the LRHS for any super resolution methods. Our experiments show that our hybrid rendering algorithm is significantly faster than the state-of-the-art Monte Carlo denoising methods while rendering high-quality images when tested on both our own BCR dataset and the Gharbi dataset. \url{https://github.com/hqqxyy/msspl}

cs.CV↗

arXiv2021

Field theoretical approach to spin models

We developed a systematic non-perturbative method base on Dyson-Schwinger theory and the $Φ$-derivable theory for Ising model at broken phase. Based on these methods, we obtain critical temperature and spin spin correlation beyond mean field theory. The spectrum of Green function obtained from our methods become gapless at critical point, so the susceptibility become divergent at Tc. The critical temperature of Ising model obtained from this method is fairly good in comparison with other non-cluster methods. It is straightforward to extend this method to more complicate spin models for example with continue symmetry.

cond-mat.stat-mech↗

arXiv2021

Deep grey matter quantitative susceptibility mapping from small spatial coverages using deep learning

Introduction: Quantitative Susceptibility Mapping (QSM) is generally acquired with full brain coverage, even though many QSM brain-iron studies focus on the deep grey matter (DGM) region only. Reducing the spatial coverage to the DGM vicinity can substantially shorten the scan time or enhance the spatial resolution without increasing scan time; however, this may lead to significant DGM susceptibility underestimation. Method: A recently proposed deep learning-based QSM method, namely xQSM, is investigated to assess the accuracy of dipole inversion on reduced brain coverages. Pre-processed magnetic field maps are extended symmetrically from the centre of globus pallidus in the coronal plane to simulate QSM acquisitions of difference spatial coverages.Results: The proposed xQSM network led to the lowest DGM contrast lost with the smallest susceptibility variation range across all spatial coverages. For the digital brain phantom simulation, xQSM improved the DGM susceptibility underestimation more than 20% in small spatial coverages. For the in vivo acquisition, less than 5% DGM susceptibility error was achieved in 48 mm axial slabs using the xQSM network, while a minimum of 112 mm coverage was required for conventional methods. It is also shown that the background field removal process performed worse in reduced brain coverages, which further deteriorated the subsequent dipole inversion. Conclusion: The recently proposed deep learning-based xQSM method significantly improves the accuracy of DGM QSM from small spatial coverages as compared with conventional QSM algorithms, which can shorten DGM QSM acquisition time substantially.

q-bio.QM↗

arXiv2021

Beyond Max-Margin: Class Margin Equilibrium for Few-shot Object Detection

Few-shot object detection has made substantial progressby representing novel class objects using the feature representation learned upon a set of base class objects. However,an implicit contradiction between novel class classification and representation is unfortunately ignored. On the one hand, to achieve accurate novel class classification, the distributions of either two base classes must be far away fromeach other (max-margin). On the other hand, to precisely represent novel classes, the distributions of base classes should be close to each other to reduce the intra-class distance of novel classes (min-margin). In this paper, we propose a class margin equilibrium (CME) approach, with the aim to optimize both feature space partition and novel class reconstruction in a systematic way. CME first converts the few-shot detection problem to the few-shot classification problem by using a fully connected layer to decouple localization features. CME then reserves adequate margin space for novel classes by introducing simple-yet-effective class margin loss during feature learning. Finally, CME pursues margin equilibrium by disturbing the features of novel class instances in an adversarial min-max fashion. Experiments on Pascal VOC and MS-COCO datasets show that CME significantly improves upon two baseline detectors (up to $3\sim 5\%$ in average), achieving state-of-the-art performance. Code is available at https://github.com/Bohao-Lee/CME .

cs.CV↗

arXiv2021

SDNet: mutil-branch for single image deraining using swin

Rain streaks degrade the image quality and seriously affect the performance of subsequent computer vision tasks, such as autonomous driving, social security, etc. Therefore, removing rain streaks from a given rainy images is of great significance. Convolutional neural networks(CNN) have been widely used in image deraining tasks, however, the local computational characteristics of convolutional operations limit the development of image deraining tasks. Recently, the popular transformer has global computational features that can further facilitate the development of image deraining tasks. In this paper, we introduce Swin-transformer into the field of image deraining for the first time to study the performance and potential of Swin-transformer in the field of image deraining. Specifically, we improve the basic module of Swin-transformer and design a three-branch model to implement single-image rain removal. The former implements the basic rain pattern feature extraction, while the latter fuses different features to further extract and process the image features. In addition, we employ a jump connection to fuse deep features and shallow features. In terms of experiments, the existing public dataset suffers from image duplication and relatively homogeneous background. So we propose a new dataset Rain3000 to validate our model. Therefore, we propose a new dataset Rain3000 for validating our model. Experimental results on the publicly available datasets Rain100L, Rain100H and our dataset Rain3000 show that our proposed method has performance and inference speed advantages over the current mainstream single-image rain streaks removal models.The source code will be available at https://github.com/H-tfx/SDNet.

cs.CV↗

arXiv2021

Valley-dependent Corner States in Honeycomb Photonic Crystal without Inversion Symmetry

We study topological states of honeycomb photonic crystals in absence of inversion symmetry using plane wave expansion and finite element methods. The breaking of inversion symmetry in honeycomb lattice leads to contrasting topological valley indices, i.e., the valley-dependent Chern numbers in momentum space. We find that the topological corner states appear for 60$^\circ$ degree corners, but absent for other corners, which can be understood as the sign flip of valley Chern number at the corner. Our results provide an experimentally feasible platform for exploring valley-dependent higher-order topology in photonic systems.

physics.optics↗

arXiv2021

Flat-Bands-Enabled Triplet Excitonic Insulator in a Di-atomic Kagome Lattice

The excitonic insulator (EI) state is a strongly correlated many-body ground state, arising from an instability in the band structure towards exciton formation. We show that the flat valence and conduction bands of a semiconducting diatomic Kagome lattice, as exemplified in a superatomic graphene lattice, can possibly conspire to enable an interesting triplet EI state, based on density functional theory (DFT) calculations combined with many-body GW and Bethe-Salpeter Equation(BSE). Our results indicate that massive carriers in flat bands with highly localized electron and hole wavefunctions significantly reduce the screening and enhance the exchange interaction, leading to an unusually large triplet exciton binding energy (~1.1 eV) exceeding the GW band gap by ~0.2 eV and a large singlet-triplet splitting of ~0.4 eV. Our findings enrich once again the intriguing physics of flat bands and extend the scope of EI materials.

cond-mat.mtrl-sci↗

arXiv2021

Weyl nodal line induced pairing in Ising superconductor and high critical field

Superconducting and topological states are two quantum phenomena attracting much interest. Their coexistence may lead to topological superconductivity sought-after for Majorana-based quantum computing. However, there is no causal relationship between the two, since superconductivity is a many-body effect due to electron-electron interaction while topology is a single-particle manifestation of electron band structure. Here, we demonstrate a novel form of Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) pairing, induced by topological Weyl nodal lines in Ising Bardeen-Cooper-Schrieffer (IBCS) superconductors. Based on first-principles calculations and analyses, we predict that the nonmagnetic metals of MA$_2$Z$_4$ family, including $α_1$-TaSi$_2$P$_4$, $α_1$-TaSi$_2$N$_4$, $α_1$-NbSi$_2$P$_4$, $α_2$-TaGe$_2$P$_4$, and $α_2$-NbGe$_2$P$_4$ monolayers, are all superconductors. While the intrinsic IBCS paring arises in these non-centrosymmetric systems, the extrinsic FFLO pairing is revealed to be evoked by the Weyl nodal lines under magnetic field, facilitating the formation of Cooper pairs with nonzero momentum in their vicinity. Moreover, we show that the IBCS pairing alone will enhance the in-plane critical field $B_c$ to ~10-50 times of Pauli paramagnetic limit $B_p$, and additional FFLO pairing can further triple the $B_c/B_p$ ratio. It therefore affords an effective approach to enhance the robustness of superconductivity. Also, the topology induced superconductivity renders naturally the possible existence of topological superconducting state.

cond-mat.supr-con↗

arXiv2021

Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstruction

Inferring 3D structure of a generic object from a 2D image is a long-standing objective of computer vision. Conventional approaches either learn completely from CAD-generated synthetic data, which have difficulty in inference from real images, or generate 2.5D depth image via intrinsic decomposition, which is limited compared to the full 3D reconstruction. One fundamental challenge lies in how to leverage numerous real 2D images without any 3D ground truth. To address this issue, we take an alternative approach with semi-supervised learning. That is, for a 2D image of a generic object, we decompose it into latent representations of category, shape and albedo, lighting and camera projection matrix, decode the representations to segmented 3D shape and albedo respectively, and fuse these components to render an image well approximating the input image. Using a category-adaptive 3D joint occupancy field (JOF), we show that the complete shape and albedo modeling enables us to leverage real 2D images in both modeling and model fitting. The effectiveness of our approach is demonstrated through superior 3D reconstruction from a single image, being either synthetic or real, and shape segmentation.

cs.CV↗

arXiv2021

Deep Simultaneous Optimisation of Sampling and Reconstruction for Multi-contrast MRI

MRI images of the same subject in different contrasts contain shared information, such as the anatomical structure. Utilizing the redundant information amongst the contrasts to sub-sample and faithfully reconstruct multi-contrast images could greatly accelerate the imaging speed, improve image quality and shorten scanning protocols. We propose an algorithm that generates the optimised sampling pattern and reconstruction scheme of one contrast (e.g. T2-weighted image) when images with different contrast (e.g. T1-weighted image) have been acquired. The proposed algorithm achieves increased PSNR and SSIM with the resulting optimal sampling pattern compared to other acquisition patterns and single contrast methods.

cs.CV↗

arXiv2021

Tertiary Regulation of Cascaded Run-of-the-River Hydropower in the Islanded Renewable Power System Considering Multi-Timescale Dynamics

To enable power supply in rural areas and to exploit clean energy, fully renewable power systems consisting of cascaded run-of-the-river hydropower and volatile energies such as pv and wind are built around the world. In islanded operation mode, the primary and secondary frequency control, i.e., hydro governors and automatic generation control (AGC), are responsible for the frequency stability. However, due to limited water storage capacity of run-of-the-river hydropower and river dynamics constraints, without coordination between the cascaded plants, the traditional AGC with fixed participation factors cannot fully exploit the adjustability of cascaded hydropower. When imbalances between the volatile energy and load occur, load shedding can be inevitable. To address this issue, this paper proposes a coordinated tertiary control approach by jointly considering power system dynamics and the river dynamics that couples the cascaded hydropower plants. The timescales of the power system and river dynamics are very different. To unify the multi-timescale dynamics to establish a model predictive controller that coordinates the cascaded plants, the relation between AGC parameters and turbine discharge over a time interval is approximated by a data-based second-order polynomial surrogate model. The cascaded plants are coordinated by optimising AGC participation factors in a receding-horizon manner, and load shedding is minimised. Simulation of a real-life system with real-time pv data collected on site shows the proposed method significantly reduces load loss under pv volatility.

math.OC↗

arXiv2021

Accelerating Quantitative Susceptibility Mapping using Compressed Sensing and Deep Neural Network

Quantitative susceptibility mapping (QSM) is an MRI phase-based post-processing method that quantifies tissue magnetic susceptibility distributions. However, QSM acquisitions are relatively slow, even with parallel imaging. Incoherent undersampling and compressed sensing reconstruction techniques have been used to accelerate traditional magnitude-based MRI acquisitions; however, most do not recover the full phase signal due to its non-convex nature. In this study, a learning-based Deep Complex Residual Network (DCRNet) is proposed to recover both the magnitude and phase images from incoherently undersampled data, enabling high acceleration of QSM acquisition. Magnitude, phase, and QSM results from DCRNet were compared with two iterative and one deep learning methods on retrospectively undersampled acquisitions from six healthy volunteers, one intracranial hemorrhage and one multiple sclerosis patients, as well as one prospectively undersampled healthy subject using a 7T scanner. Peak signal to noise ratio (PSNR), structural similarity (SSIM) and region-of-interest susceptibility measurements are reported for numerical comparisons. The proposed DCRNet method substantially reduced artifacts and blurring compared to the other methods and resulted in the highest PSNR and SSIM on the magnitude, phase, local field, and susceptibility maps. It led to 4.0% to 8.8% accuracy improvements in deep grey matter susceptibility than some existing methods, when the acquisition was accelerated four times. The proposed DCRNet also dramatically shortened the reconstruction time by nearly 10 thousand times for each scan, from around 80 hours using conventional approaches to only 30 seconds.

eess.IV↗

arXiv2021

An Identity-based Batch Verification Scheme for VANETs Based on Ring Signature with Efficient Revocation

Vehicular ad-hoc networks (VANETs) are one of the most important components in Intelligent Transportation System (ITS), which aims to provide secure and efficient communication between vehicles. Safety-critical vehicular communication requires security, privacy, and auditability. To satisfy these requirements simultaneously, several conditional privacy-preserving authentication schemes are proposed by employing ring signatures. However, these methods have paid little attention to the issues like how to choose the valid ring members or how to set up a ring. In this paper, we introduce an efficient conditional privacy-preserving scheme which provides an appropriate approach establishing the list of ring members with efficient revocation. Moreover, our proposed scheme also provides batch verification to significantly reduce the computational cost. According to the analysis of security, our scheme is sufficiently resistant against several common attacks in VANETs. The performance results show that the proposed scheme is efficient and practical with both low computation and communication cost.

cs.CR↗

arXiv2021

Shape My Face: Registering 3D Face Scans by Surface-to-Surface Translation

Standard registration algorithms need to be independently applied to each surface to register, following careful pre-processing and hand-tuning. Recently, learning-based approaches have emerged that reduce the registration of new scans to running inference with a previously-trained model. In this paper, we cast the registration task as a surface-to-surface translation problem, and design a model to reliably capture the latent geometric information directly from raw 3D face scans. We introduce Shape-My-Face (SMF), a powerful encoder-decoder architecture based on an improved point cloud encoder, a novel visual attention mechanism, graph convolutional decoders with skip connections, and a specialized mouth model that we smoothly integrate with the mesh convolutions. Compared to the previous state-of-the-art learning algorithms for non-rigid registration of face scans, SMF only requires the raw data to be rigidly aligned (with scaling) with a pre-defined face template. Additionally, our model provides topologically-sound meshes with minimal supervision, offers faster training time, has orders of magnitude fewer trainable parameters, is more robust to noise, and can generalize to previously unseen datasets. We extensively evaluate the quality of our registrations on diverse data. We demonstrate the robustness and generalizability of our model with in-the-wild face scans across different modalities, sensor types, and resolutions. Finally, we show that, by learning to register scans, SMF produces a hybrid linear and non-linear morphable model. Manipulation of the latent space of SMF allows for shape generation, and morphing applications such as expression transfer in-the-wild. We train SMF on a dataset of human faces comprising 9 large-scale databases on commodity hardware.

cs.CV↗

arXiv2021

Universal Undersampled MRI Reconstruction

Deep neural networks have been extensively studied for undersampled MRI reconstruction. While achieving state-of-the-art performance, they are trained and deployed specifically for one anatomy with limited generalization ability to another anatomy. Rather than building multiple models, a universal model that reconstructs images across different anatomies is highly desirable for efficient deployment and better generalization. Simply mixing images from multiple anatomies for training a single network does not lead to an ideal universal model due to the statistical shift among datasets of various anatomies, the need to retrain from scratch on all datasets with the addition of a new dataset, and the difficulty in dealing with imbalanced sampling when the new dataset is further of a smaller size. In this paper, for the first time, we propose a framework to learn a universal deep neural network for undersampled MRI reconstruction. Specifically, anatomy-specific instance normalization is proposed to compensate for statistical shift and allow easy generalization to new datasets. Moreover, the universal model is trained by distilling knowledge from available independent models to further exploit representations across anatomies. Experimental results show the proposed universal model can reconstruct both brain and knee images with high image quality. Also, it is easy to adapt the trained model to new datasets of smaller size, i.e., abdomen, cardiac and prostate, with little effort and superior performance.

cs.CV↗

arXiv2021

Clarinet: A One-step Approach Towards Budget-friendly Unsupervised Domain Adaptation

In unsupervised domain adaptation (UDA), classifiers for the target domain are trained with massive true-label data from the source domain and unlabeled data from the target domain. However, it may be difficult to collect fully-true-label data in a source domain given a limited budget. To mitigate this problem, we consider a novel problem setting where the classifier for the target domain has to be trained with complementary-label data from the source domain and unlabeled data from the target domain named budget-friendly UDA (BFUDA). The key benefit is that it is much less costly to collect complementary-label source data (required by BFUDA) than collecting the true-label source data (required by ordinary UDA). To this end, the complementary label adversarial network (CLARINET) is proposed to solve the BFUDA problem. CLARINET maintains two deep networks simultaneously, where one focuses on classifying complementary-label source data and the other takes care of the source-to-target distributional adaptation. Experiments show that CLARINET significantly outperforms a series of competent baselines.

cs.LG↗

arXiv2021

Convergence Analysis of Dual Decomposition Algorithm in Distributed Optimization: Asynchrony and Inexactness

Dual decomposition is widely utilized in distributed optimization of multi-agent systems. In practice, the dual decomposition algorithm is desired to admit an asynchronous implementation due to imperfect communication, such as time delay and packet drop. In addition, computational errors also exist when individual agents solve their own subproblems. In this paper, we analyze the convergence of the dual decomposition algorithm in distributed optimization when both the asynchrony in communication and the inexactness in solving subproblems exist. We find that the interaction between asynchrony and inexactness slows down the convergence rate from $\mathcal{O} ( 1 / k )$ to $\mathcal{O} ( 1 / \sqrt{k} )$. Specifically, with a constant step size, the value of objective function converges to a neighborhood of the optimal value, and the solution converges to a neighborhood of the exact optimal solution. Moreover, the violation of the constraints diminishes in $\mathcal{O} ( 1 / \sqrt{k} )$. Our result generalizes and unifies the existing ones that only consider either asynchrony or inexactness. Finally, numerical simulations validate the theoretical results.

math.OC↗

arXiv2021

Butterfly: One-step Approach towards Wildly Unsupervised Domain Adaptation

In unsupervised domain adaptation (UDA), classifiers for the target domain (TD) are trained with clean labeled data from the source domain (SD) and unlabeled data from TD. However, in the wild, it is difficult to acquire a large amount of perfectly clean labeled data in SD given limited budget. Hence, we consider a new, more realistic and more challenging problem setting, where classifiers have to be trained with noisy labeled data from SD and unlabeled data from TD -- we name it wildly UDA (WUDA). We show that WUDA ruins all UDA methods if taking no care of label noise in SD, and to this end, we propose a Butterfly framework, a powerful and efficient solution to WUDA. Butterfly maintains four deep networks simultaneously, where two take care of all adaptations (i.e., noisy-to-clean, labeled-to-unlabeled, and SD-to-TD-distributional) and then the other two can focus on classification in TD. As a consequence, Butterfly possesses all the conceptually necessary components for solving WUDA. Experiments demonstrate that, under WUDA, Butterfly significantly outperforms existing baseline methods.

cs.LG↗