arXiv subjects

Peng Li

Publications and source records attributed to Peng Li.

At least 325 records · Page 18Linked to original sources

arXiv2023

AHPA: Adaptive Horizontal Pod Autoscaling Systems on Alibaba Cloud Container Service for Kubernetes

The existing resource allocation policy for application instances in Kubernetes cannot dynamically adjust according to the requirement of business, which would cause an enormous waste of resources during fluctuations. Moreover, the emergence of new cloud services puts higher resource management requirements. This paper discusses horizontal POD resources management in Alibaba Cloud Container Services with a newly deployed AI algorithm framework named AHPA -- the adaptive horizontal pod auto-scaling system. Based on a robust decomposition forecasting algorithm and performance training model, AHPA offers an optimal pod number adjustment plan that could reduce POD resources and maintain business stability. Since being deployed in April 2021, this system has expanded to multiple customer scenarios, including logistics, social networks, AI audio and video, e-commerce, etc. Compared with the previous algorithms, AHPA solves the elastic lag problem, increasing CPU usage by 10% and reducing resource cost by more than 20%. In addition, AHPA can automatically perform flexible planning according to the predicted business volume without manual intervention, significantly saving operation and maintenance costs.

cs.LG↗

arXiv2023

ARPES signature of the competition between magnetic order and Kondo effect in CeCoGe3

The competition between magnetic order and Kondo effect is essential for the rich physics of heavy fermion systems. Nevertheless, how such competition is manifested in the quasiparticle bands in a real periodic lattice remains elusive in spectroscopic experiments. Here we report a high-resolution photoemission study of the antiferromagnetic Kondo lattice system CeCoGe3 with a high TN1 of 21K. Our measurements reveal a weakly dispersive 4f band at the Fermi level near the Z point, arisingfrom moderate Kondo effect. The intensity of this heavy 4f band exhibits a logarithmic increase with lowering temperature and begins to deviate from this Kondo-like behavior below 25 K, just above TN1, and eventually ceases to grow below 12 K. Our work provides direct spectroscopic evidence for the competition between magnetic order and the Kondo effect in a Kondo lattice system with local-moment antiferromagnetism, indicating a distinct scenario for the microscopic coexistence and competition of these phenomena, which might be related to the real-space modulation.

cond-mat.str-el↗

arXiv2023

Dynamic MRI using Learned Transform-based Tensor Low-Rank Network (LT$^2$LR-Net)

While low-rank matrix prior has been exploited in dynamic MR image reconstruction and has obtained satisfying performance, tensor low-rank models have recently emerged as powerful alternative representations for three-dimensional dynamic MR datasets. In this paper, we introduce a novel deep unrolling network for dynamic MRI, namely the learned transform-based tensor low-rank network (LT$^2$LR-Net). First, we generalize the tensor singular value decomposition (t-SVD) into an arbitrary unitary transform-based version and subsequently propose the novel transformed tensor nuclear norm (TTNN). Then, we design a novel TTNN-based iterative optimization algorithm based on the alternating direction method of multipliers (ADMM) to exploit the tensor low-rank prior in the transformed domain. The corresponding iterative steps are unrolled into the proposed LT$^2$LR-Net, where the convolutional neural network (CNN) is incorporated to adaptively learn the transformation from the dynamic MR dataset for more robust and accurate tensor low-rank representations. Experimental results on the cardiac cine MR dataset demonstrate that the proposed framework can provide improved recovery results compared with the state-of-the-art methods.

eess.IV↗

arXiv2023

Restricted Orthogonal Gradient Projection for Continual Learning

Continual learning aims to avoid catastrophic forgetting and effectively leverage learned experiences to master new knowledge. Existing gradient projection approaches impose hard constraints on the optimization space for new tasks to minimize interference, which simultaneously hinders forward knowledge transfer. To address this issue, recent methods reuse frozen parameters with a growing network, resulting in high computational costs. Thus, it remains a challenge whether we can improve forward knowledge transfer for gradient projection approaches using a fixed network architecture. In this work, we propose the Restricted Orthogonal Gradient prOjection (ROGO) framework. The basic idea is to adopt a restricted orthogonal constraint allowing parameters optimized in the direction oblique to the whole frozen space to facilitate forward knowledge transfer while consolidating previous knowledge. Our framework requires neither data buffers nor extra parameters. Extensive experiments have demonstrated the superiority of our framework over several strong baselines. We also provide theoretical guarantees for our relaxing strategy.

cs.LG↗

arXiv2023

When to Trust Aggregated Gradients: Addressing Negative Client Sampling in Federated Learning

Federated Learning has become a widely-used framework which allows learning a global model on decentralized local datasets under the condition of protecting local data privacy. However, federated learning faces severe optimization difficulty when training samples are not independently and identically distributed (non-i.i.d.). In this paper, we point out that the client sampling practice plays a decisive role in the aforementioned optimization difficulty. We find that the negative client sampling will cause the merged data distribution of currently sampled clients heavily inconsistent with that of all available clients, and further make the aggregated gradient unreliable. To address this issue, we propose a novel learning rate adaptation mechanism to adaptively adjust the server learning rate for the aggregated gradient in each round, according to the consistency between the merged data distribution of currently sampled clients and that of all available clients. Specifically, we make theoretical deductions to find a meaningful and robust indicator that is positively related to the optimal server learning rate and can effectively reflect the merged data distribution of sampled clients, and we utilize it for the server learning rate adaptation. Extensive experiments on multiple image and text classification tasks validate the great effectiveness of our method.

cs.LG↗

arXiv2022

CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation

Existing reference-free metrics have obvious limitations for evaluating controlled text generation models. Unsupervised metrics can only provide a task-agnostic evaluation result which correlates weakly with human judgments, whereas supervised ones may overfit task-specific data with poor generalization ability to other datasets. In this paper, we propose an unsupervised reference-free metric called CTRLEval, which evaluates controlled text generation from different aspects by formulating each aspect into multiple text infilling tasks. On top of these tasks, the metric assembles the generation probabilities from a pre-trained language model without any model training. Experimental results show that our metric has higher correlations with human judgments than other baselines, while obtaining better generalization of evaluating generated texts from different models and with different qualities.

cs.CL↗

arXiv2022

Progressive failure simulation of composite materials using the anisotropic phase field method

An effective computational framework of an anisotropic phase field model is used to explore the effects of interface properties, effective critical energy release rates and hole shapes on the failure process of fibre-reinforced composites in this paper. In this framework, the phase field method is solved under the background of the finite element method, and the influence of strong and weak interfaces on the failure strength of composite materials is studied. The results show that when the material fails, the strong interface shows brittleness, and the weak interface shows toughness, which can improve the failure strength of the material. At the same time, the effective critical energy release rate is introduced in the calculation, which reduces the fracture toughness of the material, makes the prediction results more consistent with the experimental results, and improves the accuracy of the results. The effect of hole shapes on the failure of the composites is also explored, and the crack propagation of different hole shapes is captured, which shows that the bearing capacity of a plate with a hole is not only related to the shape of the hole but also related to the location of the hole concentrated stress and the number of locations where the hole bears the load. The bearing capacity of the material can be improved by changing the shape of the hole. These results reveal the influence of different factors on the failure of composites and lay a foundation for the effective design of composites.

cond-mat.mtrl-sci↗

arXiv2022

Bio-realistic and versatile artificial dendrites made of anti-ambipolar transistors

The understanding of neural networks as neuron-synapse binaries has been the foundation of neuroscience, and therefore, the emerging neuromorphic computing technology that takes inspiration from the brain. This dogma, however, has been increasingly challenged by recent neuroscience research in which the downplayed dendrites were found to be active, dynamically unique and computationally powerful. To date, research on artificial dendrites is scarce and the few existing devices are still far from versatile or (and) bio-realistic. A breakthrough is hampered by the limited available physical mechanisms in mainstream device architectures. Here, we experimentally demonstrate a bio-realistic and versatile artificial dendrite made of WSe2/MoS2 heterojunction-channel anti-ambipolar transistor, which can closely mimic the experimentally recorded non-monotonic dendritic Ca2+ action potential that underpins various sophisticated computations. Spiking neural network simulations reveal that the incorporation of this nonconventional but bio-realistic dendritic activation enhances the robustness and representational capability of the network in non-stationary environments. By further exploiting the memristive effect, dendritic anti-ambipolar transistor can naturally mimic Ca2+-mediated regulation of synaptic plasticity (meta-plasticity) at dendritic spine, an important homeostatic phenomenon due to dendritic modulation. The invention of dendritic anti-ambipolar transistor completes the family of neuromorphic transistors and represents a major advance in diversifying the functionality of transistors.

physics.app-ph↗

arXiv2022

Synaptic Dynamics Realize First-order Adaptive Learning and Weight Symmetry

Gradient-based first-order adaptive optimization methods such as the Adam optimizer are prevalent in training artificial networks, achieving the state-of-the-art results. This work attempts to answer the question whether it is viable for biological neural systems to adopt such optimization methods. To this end, we demonstrate a realization of the Adam optimizer using biologically-plausible mechanisms in synapses. The proposed learning rule has clear biological correspondence, runs continuously in time, and achieves performance to comparable Adam's. In addition, we present a new approach, inspired by the predisposition property of synapses observed in neuroscience, to circumvent the biological implausibility of the weight transport problem in backpropagation (BP). With only local information and no separate training phases, this method establishes and maintains weight symmetry in the forward and backward signaling paths, and is applicable to the proposed biologically plausible Adam learning rule. These mechanisms may shed light on the way in which biological synaptic dynamics facilitate learning.

cs.NE↗

arXiv2022

PanoFlow: Learning 360° Optical Flow for Surrounding Temporal Understanding

Optical flow estimation is a basic task in self-driving and robotics systems, which enables to temporally interpret traffic scenes. Autonomous vehicles clearly benefit from the ultra-wide Field of View (FoV) offered by 360° panoramic sensors. However, due to the unique imaging process of panoramic cameras, models designed for pinhole images do not directly generalize satisfactorily to 360° panoramic images. In this paper, we put forward a novel network framework--PanoFlow, to learn optical flow for panoramic images. To overcome the distortions introduced by equirectangular projection in panoramic transformation, we design a Flow Distortion Augmentation (FDA) method, which contains radial flow distortion (FDA-R) or equirectangular flow distortion (FDA-E). We further look into the definition and properties of cyclic optical flow for panoramic videos, and hereby propose a Cyclic Flow Estimation (CFE) method by leveraging the cyclicity of spherical images to infer 360° optical flow and converting large displacement to relatively small displacement. PanoFlow is applicable to any existing flow estimation method and benefits from the progress of narrow-FoV flow estimation. In addition, we create and release a synthetic panoramic dataset FlowScape based on CARLA to facilitate training and quantitative analysis. PanoFlow achieves state-of-the-art performance on the public OmniFlowNet and the established FlowScape benchmarks. Our proposed approach reduces the End-Point-Error (EPE) on FlowScape by 27.3%. On OmniFlowNet, PanoFlow achieves a 55.5% error reduction from the best published result. We also qualitatively validate our method via a collection vehicle and a public real-world OmniPhotos dataset, indicating strong potential and robustness for real-world navigation applications. Code and dataset are publicly available at https://github.com/MasterHow/PanoFlow.

cs.CV↗

arXiv2022

Exploring Universal Intrinsic Task Subspace via Prompt Tuning

Why can pre-trained language models (PLMs) learn universal representations and effectively adapt to broad NLP tasks differing a lot superficially? In this work, we empirically find evidence indicating that the adaptations of PLMs to various few-shot tasks can be reparameterized as optimizing only a few free parameters in a unified low-dimensional intrinsic task subspace, which may help us understand why PLMs could easily adapt to various NLP tasks with small-scale data. To find such a subspace and examine its universality, we propose an analysis pipeline called intrinsic prompt tuning (IPT). Specifically, we resort to the recent success of prompt tuning and decompose the soft prompts of multiple NLP tasks into the same low-dimensional nonlinear subspace, then we learn to adapt the PLM to unseen data or tasks by only tuning parameters in this subspace. In the experiments, we study diverse few-shot NLP tasks and surprisingly find that in a 250-dimensional subspace found with 100 tasks, by only tuning 250 free parameters, we can recover 97% and 83% of the full prompt tuning performance for 100 seen tasks (using different training data) and 20 unseen tasks, respectively, showing great generalization ability of the found intrinsic task subspace. Besides being an analysis tool, IPT could further help us improve the prompt tuning stability.

cs.CL↗

arXiv2022

Colossal Nernst power factor in topological semimetal NbSb$_2$

Today solid-state cooling technologies below liquid nitrogen boiling temperature (77 K), crucial to quantum information technology and probing quantum state of matter, are greatly limited due to the lack of good thermoelectric and/or thermomagnetic materials. Here, we report the discovery of colossal Nernst power factor of 3800$\times$10$^{-4}$ W m$^{-1}$ K$^{-2}$ under 5 T at 25 K and high Nernst figure-of-merit of 71$\times$10$^{-4}$ K$^{-1}$ under 5 T at 20 K in topological semimetal NbSb$_2$ single crystals. The observed high thermomagnetic performance is attributed to large Nernst thermopower and longitudinal electrical conductivity, and relatively low transverse thermal conductivity. The large and unsaturated Nernst thermopower is the result of the combination of highly desirable electronic structures of NbSb$_2$ having compensated high mobility electrons and holes near Fermi level and strong phonon-drag effect. This discovery opens an avenue for exploring material option for the solid-state heat pumping below liquid nitrogen temperature.

cond-mat.mtrl-sci↗

arXiv2022

Relief and Stimulus in A Cross-sector Multi-product Scarce Resource Supply Chain Network

In the era of a growing population, systemic changes to the world, and the rising risk of crises, humanity has been facing an unprecedented challenge of resource scarcity. Confronting and addressing the issues concerning the scarce resource's conservation, competition, and stimulation by grappling its characteristics and adopting viable policy instruments calls the decision-maker's attention with a paramount priority. In this paper, we develop the first general decentralized cross-sector supply chain network model that captures the unique features of scarce resources under a unifying fiscal policy scheme. We formulate the problem as a network equilibrium model with finite-dimensional variational inequality theories. We then characterize the network equilibrium with a set of classic theoretical properties, as well as with a set of properties that are novel to the network games application literature, namely, the lowest eigenvalue of the game Jacobian. Lastly, we provide a series of illustrative examples, including a medical glove supply network, to showcase how our model can be used to investigate the efficacy of the imposed policies in relieving supply chain distress and stimulating welfare. Our managerial insights inform and expand the political dialogues on fiscal policy design, public resource legislation, social welfare redistribution, and supply chain practice toward sustainability.

econ.TH↗

arXiv2022

MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction

The diverse relationships among real-world events, including coreference, temporal, causal, and subevent relations, are fundamental to understanding natural languages. However, two drawbacks of existing datasets limit event relation extraction (ERE) tasks: (1) Small scale. Due to the annotation complexity, the data scale of existing datasets is limited, which cannot well train and evaluate data-hungry models. (2) Absence of unified annotation. Different types of event relations naturally interact with each other, but existing datasets only cover limited relation types at once, which prevents models from taking full advantage of relation interactions. To address these issues, we construct a unified large-scale human-annotated ERE dataset MAVEN-ERE with improved annotation schemes. It contains 103,193 event coreference chains, 1,216,217 temporal relations, 57,992 causal relations, and 15,841 subevent relations, which is larger than existing datasets of all the ERE tasks by at least an order of magnitude. Experiments show that ERE on MAVEN-ERE is quite challenging, and considering relation interactions with joint learning can improve performances. The dataset and source codes can be obtained from https://github.com/THU-KEG/MAVEN-ERE.

cs.CL↗

arXiv2022

Quantum phase transition in two-dimensional NbN superconducting thin films

We systematically investigated the low-temperature transport properties of a series of NbN epitaxial films with thickness $t$ ranging from $\sim$2.0 to $\sim$4.0 nm. The films undergo a superconductor-insulator transition (SIT) with decreasing film thickness, and the critical sheet resistance for the SIT is close to the quantum resistance of Cooper pairs $h/4e^2$ (6.45 k$Ω$). Besides the Berezinski-Koterlitz-Thouless transition, a magnetic-field-driven SIT is observed in those two-dimensional (2D) superconducting films (2.6 nm $\lesssim t \lesssim 4.0$ nm). Interestingly, it is found that the low-temperature magnetoresistance isotherms do not cross at a single fixed point but at a well-distinguished region for these superconducting films. The dynamical critical exponent obtained by analyzing these magnetoresistance isotherms is divergent as the quantum critical point is being approached. The behavior of the dynamical critical exponent, originating from quenched disorder at ultralow temperatures, provides direct evidence for the occurrence of quantum Griffiths singularity in the quantum phase transition process of the films. The field-driven anomalous metal (quantum metal) state does not appear in these films. Our results suggest that the quantum Griffiths singularity not only occurs in the highly crystalline 2D superconductors with superconductor-metal transition but also in those with SIT.

cond-mat.supr-con↗

arXiv2022

GeoGCN: Geometric Dual-domain Graph Convolution Network for Point Cloud Denoising

We propose GeoGCN, a novel geometric dual-domain graph convolution network for point cloud denoising (PCD). Beyond the traditional wisdom of PCD, to fully exploit the geometric information of point clouds, we define two kinds of surface normals, one is called Real Normal (RN), and the other is Virtual Normal (VN). RN preserves the local details of noisy point clouds while VN avoids the global shape shrinkage during denoising. GeoGCN is a new PCD paradigm that, 1) first regresses point positions by spatialbased GCN with the help of VNs, 2) then estimates initial RNs by performing Principal Component Analysis on the regressed points, and 3) finally regresses fine RNs by normalbased GCN. Unlike existing PCD methods, GeoGCN not only exploits two kinds of geometry expertise (i.e., RN and VN) but also benefits from training data. Experiments validate that GeoGCN outperforms SOTAs in terms of both noise-robustness and local-and-global feature preservation.

cs.CV↗

arXiv2022

Tunable VUV Frequency Comb for $^{\mathrm{229m}}$Th Nuclear Spectroscopy

Laser spectroscopy of the $^{\mathrm{229m}}$Th nuclear clock transition is necessary for the future construction of a nuclear-based optical clock. Precision laser sources with broad spectral coverage in the vacuum ultraviolet are needed for this task. Here, we present a tunable vacuum-ultraviolet frequency comb based on cavity-enhanced seventh-harmonic generation. Its tunable spectrum covers the current uncertainty range of the $^{\mathrm{229m}}$Th nuclear clock transition.

physics.optics↗

arXiv2022

A Template-based Method for Constrained Neural Machine Translation

Machine translation systems are expected to cope with various types of constraints in many practical scenarios. While neural machine translation (NMT) has achieved strong performance in unconstrained cases, it is non-trivial to impose pre-specified constraints into the translation process of NMT models. Although many approaches have been proposed to address this issue, most existing methods can not satisfy the following three desiderata at the same time: (1) high translation quality, (2) high match accuracy, and (3) low latency. In this work, we propose a template-based method that can yield results with high translation quality and match accuracy and the inference speed of our method is comparable with unconstrained NMT models. Our basic idea is to rearrange the generation of constrained and unconstrained tokens through a template. Our method does not require any changes in the model architecture and the decoding algorithm. Experimental results show that the proposed template-based approach can outperform several representative baselines in both lexically and structurally constrained translation tasks.

cs.CL↗