arXiv subjects

Feng Liu

Publications and source records attributed to Feng Liu.

At least 523 records · Page 29Linked to original sources

arXiv2021

Achieving an Accurate Random Process Model for PV Power using Cheap Data: Leveraging the SDE and Public Weather Reports

The stochastic differential equation (SDE)-based random process models of volatile renewable energy sources (RESs) jointly capture the evolving probability distribution and temporal correlation in continuous time. It has enabled recent studies to remarkably improve the performance of power system dynamic uncertainty quantification and optimization. However, considering the non-homogeneous random process nature of PV, there still remains a challenging question: how can a realistic and accurate SDE model for PV power be obtained that reflects its weather-dependent uncertainty in online operation, especially when high-resolution numerical weather prediction (NWP) is unavailable for many distributed plants? To fill this gap, this article finds that an accurate SDE model for PV power can be constructed by only using the cheap data from low-resolution public weather reports. Specifically, an hourly parameterized Jacobi diffusion process is constructed to recreate the temporal patterns of PV volatility during a day. Its parameters are mapped from the public weather report using an ensemble of extreme learning machines (ELMs) to reflect the varying weather conditions. The SDE model jointly captures intraday and intrahour volatility. Statistical examination based on real-world data collected in Macau shows the proposed approach outperforms a selection of state-of-the-art deep learning-based time-series forecast methods.

cs.LG↗

arXiv2021

Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Image

Inferring 3D locations and shapes of multiple objects from a single 2D image is a long-standing objective of computer vision. Most of the existing works either predict one of these 3D properties or focus on solving both for a single object. One fundamental challenge lies in how to learn an effective representation of the image that is well-suited for 3D detection and reconstruction. In this work, we propose to learn a regular grid of 3D voxel features from the input image which is aligned with 3D scene space via a 3D feature lifting operator. Based on the 3D voxel features, our novel CenterNet-3D detection head formulates the 3D detection as keypoint detection in the 3D space. Moreover, we devise an efficient coarse-to-fine reconstruction module, including coarse-level voxelization and a novel local PCA-SDF shape representation, which enables fine detail reconstruction and one order of magnitude faster inference than prior methods. With complementary supervision from both 3D detection and reconstruction, one enables the 3D voxel features to be geometry and context preserving, benefiting both tasks.The effectiveness of our approach is demonstrated through 3D detection and reconstruction in single object and multiple object scenarios.

cs.CV↗

arXiv2021

A cross-modal fusion network based on self-attention and residual structure for multimodal emotion recognition

The audio-video based multimodal emotion recognition has attracted a lot of attention due to its robust performance. Most of the existing methods focus on proposing different cross-modal fusion strategies. However, these strategies introduce redundancy in the features of different modalities without fully considering the complementary properties between modal information, and these approaches do not guarantee the non-loss of original semantic information during intra- and inter-modal interactions. In this paper, we propose a novel cross-modal fusion network based on self-attention and residual structure (CFN-SR) for multimodal emotion recognition. Firstly, we perform representation learning for audio and video modalities to obtain the semantic features of the two modalities by efficient ResNeXt and 1D CNN, respectively. Secondly, we feed the features of the two modalities into the cross-modal blocks separately to ensure efficient complementarity and completeness of information through the self-attention mechanism and residual structure. Finally, we obtain the output of emotions by splicing the obtained fused representation with the original representation. To verify the effectiveness of the proposed method, we conduct experiments on the RAVDESS dataset. The experimental results show that the proposed CFN-SR achieves the state-of-the-art and obtains 75.76% accuracy with 26.30M parameters. Our code is available at https://github.com/skeletonNN/CFN-SR.

cs.CV↗

arXiv2021

EvoGAN: An Evolutionary Computation Assisted GAN

The image synthesis technique is relatively well established which can generate facial images that are indistinguishable even by human beings. However, all of these approaches uses gradients to condition the output, resulting in the outputting the same image with the same input. Also, they can only generate images with basic expression or mimic an expression instead of generating compound expression. In real life, however, human expressions are of great diversity and complexity. In this paper, we propose an evolutionary algorithm (EA) assisted GAN, named EvoGAN, to generate various compound expressions with any accurate target compound expression. EvoGAN uses an EA to search target results in the data distribution learned by GAN. Specifically, we use the Facial Action Coding System (FACS) as the encoding of an EA and use a pre-trained GAN to generate human facial images, and then use a pre-trained classifier to recognize the expression composition of the synthesized images as the fitness function to guide the search of the EA. Combined random searching algorithm, various images with the target expression can be easily sythesized. Quantitative and Qualitative results are presented on several compound expressions, and the experimental results demonstrate the feasibility and the potential of EvoGAN.

cs.CV↗

arXiv2021

Approaching the Transient Stability Boundary of a Power System: Theory and Applications

Estimating the stability boundary is a fundamental and challenging problem in transient stability studies. It is known that a proper level set of a Lyapunov function or an energy function can provide an inner approximation of the stability boundary, and the estimation can be expanded by trajectory reversing methods. In this paper, we streamline the theoretical foundation of the expansion methodology, and generalize it by relaxing the request that the initial guess should be a subset of the stability region. We investigate topological characteristics of the expanded boundary, showing how an initial guess can approach the exact stability boundary locally or globally. We apply the theory to transient stability assessment, and propose expansion algorithms to improve the well-known Potential Energy Boundary Surface (PEBS) and Boundary of stability region based Controlling Unstable equilibrium point (BCU) methods. Case studies on the IEEE 39-bus system well verify our results and demonstrate that estimations of the stability boundary and the critical clearing time can be significantly improved with modest computational cost.

eess.SY↗

arXiv2021

An Improved Surrogate Method for Solving the Energy Storage Optimal Bidding Problem

Energy storage is expected to play an increasingly important role in mitigating variations that come along with the growing penetration of renewable energy. In this paper, we study the optimal bidding of an energy storage unit in a semi-centralized market. The energy storage unit offers its available storage capacity and maximum charging/discharging rate to the operator; then the operator clears the real-time market by minimizing the total cost. The energy storage unit is paid/charged at locational marginal price (LMP). The problem casts down to a bilevel optimization problem with a mixed-integer lower-level. An improved surrogate-based method with the combined spatial-temporal entropy term is developed to solve this problem. Numerical examples demonstrate the scalability, efficiency, and accuracy of the proposed method.

math.OC↗

arXiv2021

Augmented Synchronization of Power Systems

Power system transient stability has been translated into a Lyapunov stability problem of the post-disturbance equilibrium for decades. Despite substantial results, conventional theories suffer from the stringent requirement of knowing the post-disturbance equilibrium a priori. In contrast, the wisdom from practice, which certificates stability by only the observation of converging frequencies and voltages, seems to provide an equilibrium-independent approach. Here, we formulate the empirical wisdom by the concept of augmented synchronization and aim to bridge such a theory-practice gap. First, we derive conditions under which the convergence to augmented synchronization implies the convergence to the equilibrium set, laying the first theoretical foundation for the empirical wisdom. Then, we reveal from what initial values the power system can achieve augmented synchronization. Our results open the possibility of an equilibrium-independent power system stability analytic that re-defines the nominal motion as augmented synchronization rather than certain equilibrium. Single-machine examples and the IEEE 9-bus system well verify our results and illustrate promising implications.

eess.SY↗

arXiv2021

Manifold-preserved GANs

Generative Adversarial Networks (GANs) have been widely adopted in various fields. However, existing GANs generally are not able to preserve the manifold of data space, mainly due to the simple representation of discriminator for the real/generated data. To address such open challenges, this paper proposes Manifold-preserved GANs (MaF-GANs), which generalize Wasserstein GANs into high-dimensional form. Specifically, to improve the representation of data, the discriminator in MaF-GANs is designed to map data into a high-dimensional manifold. Furthermore, to stabilize the training of MaF-GANs, an operation with precise and universal solution for any K-Lipschitz continuity, called Topological Consistency is proposed. The effectiveness of the proposed method is justified by both theoretical analysis and empirical results. When adopting DCGAN as the backbone on CelebA (256*256), the proposed method achieved 12.43 FID, which outperforms the state-of-the-art model like Realness GAN (23.51 FID) by a large margin. Code will be made publicly available.

cs.CV↗

arXiv2021

Combustion Instability of a Multi-injector Rocket Engine Using the Flamelet Progress Variable Model

The combustion instability is investigated computationally for a multi-injector rocket engine using the flamelet progress variable (FPV) model. A C++ code is developed based on OpenFOAM 4.0 to apply the combustion model. Flamelet tables are generated for methane/oxygen combustion at the background pressure of $200$ bar using a 12-species chemical mechanism. A power law is determined for rescaling the reaction rate for the progress variable to address the pressure effect. The combustion is also simulated by the one-step-kinetics (OSK) method for comparison with the FPV approach. A study of combustion instability shows that a longitudinal mode of $1500$ Hz and a tangential standing wave of $2500$ Hz are dominant for both approaches. While the amplitude of the longitudinal mode remains almost the same for both approaches, the tangential standing wave achieves a larger amplitude in the FPV simulation. A preliminary study of the resonance in the injectors, which is driven by the longitudinal-mode oscillation in the combustion chamber, is also presented.

physics.flu-dyn↗

arXiv2021

Deep Learning-Aided Model Predictive Control of Wind Farms for AGC Considering the Dynamic Wake Effect

To provide automatic generation control (AGC) service, wind farms (WFs) are required to control their operation dynamically to track the time-varying power reference. Wake effects impose significant aerodynamic interactions among turbines, which remarkably influence the WF dynamic power production. The nonlinear and high-dimensional nature of dynamic wake model, however, brings extremely high computation complexity and obscure the design of WF controllers. This paper overcomes the control difficulty brought by the dynamic wake model by proposing a novel control-oriented reduced order WF model and a deep-learning-aided model predictive control (MPC) method. Leveraging recent advances in computational fluid dynamics (CFD) to provide high-fidelity data that simulates WF dynamic wake flows, two novel deep neural network (DNN) architectures are specially designed to learn a dynamic WF reduced-order model (ROM) that can capture the dominant flow dynamics. Then, a novel MPC framework is constructed that explicitly incorporates the obtained WF ROM to coordinate different turbines while considering dynamic wake interactions. The proposed WF ROM and the control method are evaluated in a widely-accepted high-dimensional dynamic WF simulator whose accuracy has been validated by realistic measurement data. A 9-turbine WF case and a larger 25-turbine WF case are studied. By reducing WF model states by many orders of magnitude, the computational burden of the control method is reduced greatly. Besides, through the proposed method, the range of AGC signals that can be tracked by the WF in the dynamic operation is extended compared with the existing greedy controller.

math.OC↗

arXiv2021

Group-wise Inhibition based Feature Regularization for Robust Classification

The convolutional neural network (CNN) is vulnerable to degraded images with even very small variations (e.g. corrupted and adversarial samples). One of the possible reasons is that CNN pays more attention to the most discriminative regions, but ignores the auxiliary features when learning, leading to the lack of feature diversity for final judgment. In our method, we propose to dynamically suppress significant activation values of CNN by group-wise inhibition, but not fixedly or randomly handle them when training. The feature maps with different activation distribution are then processed separately to take the feature independence into account. CNN is finally guided to learn richer discriminative features hierarchically for robust classification according to the proposed regularization. Our method is comprehensively evaluated under multiple settings, including classification against corruptions, adversarial attacks and low data regime. Extensive experimental results show that the proposed method can achieve significant improvements in terms of both robustness and generalization performances, when compared with the state-of-the-art methods. Code is available at https://github.com/LinusWu/TENET_Training.

cs.CV↗

arXiv2021

Escaping the Gradient Vanishing: Periodic Alternatives of Softmax in Attention Mechanism

Softmax is widely used in neural networks for multiclass classification, gate structure and attention mechanisms. The statistical assumption that the input is normal distributed supports the gradient stability of Softmax. However, when used in attention mechanisms such as transformers, since the correlation scores between embeddings are often not normally distributed, the gradient vanishing problem appears, and we prove this point through experimental confirmation. In this work, we suggest that replacing the exponential function by periodic functions, and we delve into some potential periodic alternatives of Softmax from the view of value and gradient. Through experiments on a simply designed demo referenced to LeViT, our method is proved to be able to alleviate the gradient problem and yield substantial improvements compared to Softmax and its variants. Further, we analyze the impact of pre-normalization for Softmax and our methods through mathematics and experiments. Lastly, we increase the depth of the demo and prove the applicability of our method in deep structures.

cs.CV↗

arXiv2021

Synchronization Instability of Inverter-Based Generation During Asymmetrical Grid Faults

The transient stability of traditional power systems is concerned with the ability of generators to stay synchronized with the positive-sequence voltage of the network, whether for symmetrical or asymmetrical faults. In contrast, both positive- and negative-sequence synchronizations should be of concern for inverter-based generation (IBG) under asymmetrical faults. This is because the latest grid codes stipulate that IBG should inject dual-sequence current when riding through asymmetrical faults. Currently, much less is known about the synchronization stability during asymmetrical faults. This significantly differs from the positive-sequence synchronization alone because the coupled dual-sequence synchronization is involved. This paper aims to fill this gap. Considering the sequence coupling under asymmetrical faults, the dual-sequence synchronization model of IBG is developed. Based on the model, the conditions that steady-state equilibrium points should follow are identified. The conditions throw light on the possible types of synchronization instability, including the positive-sequence dominated instability and the negative-sequence dominated one. For different types of instability, the dominant factors are analyzed quantitatively, which are reflected by the limit on the current injection amplitude. Exceeding the limit will lead to the loss of both positive- and negative-sequence synchronizations. The model and the analysis are verified by simulations and hardware-in-the-loop experiments.

eess.SY↗

arXiv2021

Screening 2D materials with topological flat bands

Topological flat band (TFB) has been proposed theoretically in various lattice models, to exhibit a rich spectrum of intriguing physical behaviors. However, the experimental demonstration of flat band (FB) properties has been severely hindered by the lack of materials realization. Here, by screening materials from a first-principles materials database, we identify a group of 2D materials with TFBs near the Fermi level, covering some simple line-graph and generalized line-graph FB lattice models. These include the Kagome sublattice of O in TiO2 yielding a spin-unpolarized TFB, and that of V in ferromagnetic V3F8 yielding a spin-polarized TFB. Monolayer Nb3TeCl7 and its counterparts from element substitution are found to be breathing-Kagome-lattice crystals. The family of monolayer III2VI3 compounds exhibit a TFB representing the coloring-triangle lattice model. ReF3, MnF3 and MnBr3 are all predicted to be diatomic-Kagome-lattice crystals, with TFB transitions induced by atomic substitution. Finally, HgF2, CdF2 and ZnF2 are discovered to host dual TFBs in the diamond-octagon lattice. Our findings pave the way to further experimental exploration of eluding FB materials and properties.

cond-mat.mtrl-sci↗

arXiv2021

Maximum Mean Discrepancy Test is Aware of Adversarial Attacks

The maximum mean discrepancy (MMD) test could in principle detect any distributional discrepancy between two datasets. However, it has been shown that the MMD test is unaware of adversarial attacks -- the MMD test failed to detect the discrepancy between natural and adversarial data. Given this phenomenon, we raise a question: are natural and adversarial data really from different distributions? The answer is affirmative -- the previous use of the MMD test on the purpose missed three key factors, and accordingly, we propose three components. Firstly, the Gaussian kernel has limited representation power, and we replace it with an effective deep kernel. Secondly, the test power of the MMD test was neglected, and we maximize it following asymptotic statistics. Finally, adversarial data may be non-independent, and we overcome this issue with the wild bootstrap. By taking care of the three factors, we verify that the MMD test is aware of adversarial attacks, which lights up a novel road for adversarial data detection based on two-sample tests.

cs.LG↗

arXiv2021

Local Reweighting for Adversarial Training

Instances-reweighted adversarial training (IRAT) can significantly boost the robustness of trained models, where data being less/more vulnerable to the given attack are assigned smaller/larger weights during training. However, when tested on attacks different from the given attack simulated in training, the robustness may drop significantly (e.g., even worse than no reweighting). In this paper, we study this problem and propose our solution--locally reweighted adversarial training (LRAT). The rationale behind IRAT is that we do not need to pay much attention to an instance that is already safe under the attack. We argue that the safeness should be attack-dependent, so that for the same instance, its weight can change given different attacks based on the same model. Thus, if the attack simulated in training is mis-specified, the weights of IRAT are misleading. To this end, LRAT pairs each instance with its adversarial variants and performs local reweighting inside each pair, while performing no global reweighting--the rationale is to fit the instance itself if it is immune to the attack, but not to skip the pair, in order to passively defend different attacks in future. Experiments show that LRAT works better than both IRAT (i.e., global reweighting) and the standard AT (i.e., no reweighting) when trained with an attack and tested on different attacks.

cs.LG↗

arXiv2021

Learning Bounds for Open-Set Learning

Traditional supervised learning aims to train a classifier in the closed-set world, where training and test samples share the same label space. In this paper, we target a more challenging and realistic setting: open-set learning (OSL), where there exist test samples from the classes that are unseen during training. Although researchers have designed many methods from the algorithmic perspectives, there are few methods that provide generalization guarantees on their ability to achieve consistent performance on different training samples drawn from the same distribution. Motivated by the transfer learning and probably approximate correct (PAC) theory, we make a bold attempt to study OSL by proving its generalization error-given training samples with size n, the estimation error will get close to order O_p(1/\sqrt{n}). This is the first study to provide a generalization bound for OSL, which we do by theoretically investigating the risk of the target classifier on unknown classes. According to our theory, a novel algorithm, called auxiliary open-set risk (AOSR) is proposed to address the OSL problem. Experiments verify the efficacy of AOSR. The code is available at github.com/Anjin-Liu/Openset_Learning_AOSR.

cs.LG↗

arXiv2021

Balancing Accuracy and Fairness for Interactive Recommendation with Reinforcement Learning

Fairness in recommendation has attracted increasing attention due to bias and discrimination possibly caused by traditional recommenders. In Interactive Recommender Systems (IRS), user preferences and the system's fairness status are constantly changing over time. Existing fairness-aware recommenders mainly consider fairness in static settings. Directly applying existing methods to IRS will result in poor recommendation. To resolve this problem, we propose a reinforcement learning based framework, FairRec, to dynamically maintain a long-term balance between accuracy and fairness in IRS. User preferences and the system's fairness status are jointly compressed into the state representation to generate recommendations. FairRec aims at maximizing our designed cumulative reward that combines accuracy and fairness. Extensive experiments validate that FairRec can improve fairness, while preserving good recommendation quality.

cs.IR↗