arXiv subjects

Erping Li

Publications and source records attributed to Erping Li.

At least 19 recordsLinked to original sources

arXiv2025

Novel Physics-Aware Attention-Based Machine Learning Approach for Mutual Coupling Modeling

This article presents a physics-aware convolutional long short-term memory (PC-LSTM) network for efficient and accurate extraction of mutual impedance matrices in dipole antenna arrays. By reinterpreting the Green's function through a physics-aware neural network and embedding it into an adaptive loss function, the proposed machine learning-based approach achieves enhanced physical interpretability in mutual coupling modeling. Also, an attention mechanism is carefully designed to calibrate complex-valued features by fusing the real and imaginary parts of the Green's function matrix. These fused representations are then processed by a convolutional long short-term memory network, and the impedance matrix of the linear antenna array can be finally derived. Validation against five benchmarks underscores the efficacy of the proposed approach, demonstrating accurate impedance extraction with up to a 7x speedup compared to CST Microwave Studio, making it a fast alternative to full-wave simulations for mutual coupling characterization.

eess.SP↗

arXiv2025

Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement

Spiking Neural Networks (SNNs) have garnered considerable attention as a potential alternative to Artificial Neural Networks (ANNs). Recent studies have highlighted SNNs' potential on large-scale datasets. For SNN training, two main approaches exist: direct training and ANN-to-SNN (ANN2SNN) conversion. To fully leverage existing ANN models in guiding SNN learning, either direct ANN-to-SNN conversion or ANN-SNN distillation training can be employed. In this paper, we propose an ANN-SNN distillation framework from the ANN-to-SNN perspective, designed with a block-wise replacement strategy for ANN-guided learning. By generating intermediate hybrid models that progressively align SNN feature spaces to those of ANN through rate-based features, our framework naturally incorporates rate-based backpropagation as a training method. Our approach achieves results comparable to or better than state-of-the-art SNN distillation methods, showing both training and learning efficiency.

cs.LG↗

arXiv2025

Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deployment

Spiking Neural Networks (SNNs) are emerging as a brain-inspired alternative to traditional Artificial Neural Networks (ANNs), prized for their potential energy efficiency on neuromorphic hardware. Despite this, SNNs often suffer from accuracy degradation compared to ANNs and face deployment challenges due to fixed inference timesteps, which require retraining for adjustments, limiting operational flexibility. To address these issues, our work considers the spatio-temporal property inherent in SNNs, and proposes a novel distillation framework for deep SNNs that optimizes performance across full-range timesteps without specific retraining, enhancing both efficacy and deployment adaptability. We provide both theoretical analysis and empirical validations to illustrate that training guarantees the convergence of all implicit models across full-range timesteps. Experimental results on CIFAR-10, CIFAR-100, CIFAR10-DVS, and ImageNet demonstrate state-of-the-art performance among distillation-based SNNs training methods. Our code is available at https://github.com/Intelli-Chip-Lab/snn\_temporal\_decoupling\_distillation.

cs.LG↗

arXiv2024

Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation

Recent insights have revealed that rate-coding is a primary form of information representation captured by surrogate-gradient-based Backpropagation Through Time (BPTT) in training deep Spiking Neural Networks (SNNs). Motivated by these findings, we propose rate-based backpropagation, a training strategy specifically designed to exploit rate-based representations to reduce the complexity of BPTT. Our method minimizes reliance on detailed temporal derivatives by focusing on averaged dynamics, streamlining the computational graph to reduce memory and computational demands of SNNs training. We substantiate the rationality of the gradient approximation between BPTT and the proposed method through both theoretical analysis and empirical observations. Comprehensive experiments on CIFAR-10, CIFAR-100, ImageNet, and CIFAR10-DVS validate that our method achieves comparable performance to BPTT counterparts, and surpasses state-of-the-art efficient training techniques. By leveraging the inherent benefits of rate-coding, this work sets the stage for more scalable and efficient SNNs training within resource-constrained environments. Our code is available at https://github.com/Tab-ct/rate-based-backpropagation.

cs.LG↗

arXiv2024

On-Chip Vectorial Structured Light Manipulation via Inverse Design

On-chip structured light, with potentially infinite complexity, has emerged as a linchpin in the realm of integrated photonics. However, the realization of arbitrarily tailoring a multitude of light field dimensions in complex media remains a challenge1, Through associating physical light fields and mathematical function spaces by introducing a mapping operator, we proposed a data-driven inverse design method to precisely manipulate between any two structured light fields in the on-chip high-dimensional Hilbert space. To illustrate, light field conversion in on-chip topological photonics was achieved. High-performance topological coupling devices with minimal insertion loss and customizable topological routing devices were designed and realized. Our method provides a new paradigm to enable precise manipulation over the on-chip vectorial structured light and paves the way for the realization of complex photonic functions.

physics.optics↗

arXiv2024

Observation of scale-free localized states induced by non-Hermitian defects

Wave localization is a fundamental phenomenon that appears universally in both natural materials and artificial structures and plays a crucial role in understanding the various physical properties of a system. Usually, a localized state has an exponential profile with a localization length independent of the system size. Here, we experimentally demonstrate a new class of localized states called scale-free localized states, which has an unfixed localization length scaling linearly with the system size. Using circuit lattices, we observe that a non-Hermitian defect added to a Hermitian lattice induces an extensive number of states with scale-free localization. Furthermore, we demonstrate that, in a lattice with a parity-time-symmetric non-Hermitian defect, the scale-free localization emerges because of spontaneous parity-time symmetry breaking. Our results uncover a new type of localized states and extend the study of defect physics to the non-Hermitian regime.

cond-mat.mes-hall↗

arXiv2023

Go beyond End-to-End Training: Boosting Greedy Local Learning with Context Supply

Traditional end-to-end (E2E) training of deep networks necessitates storing intermediate activations for back-propagation, resulting in a large memory footprint on GPUs and restricted model parallelization. As an alternative, greedy local learning partitions the network into gradient-isolated modules and trains supervisely based on local preliminary losses, thereby providing asynchronous and parallel training methods that substantially reduce memory cost. However, empirical experiments reveal that as the number of segmentations of the gradient-isolated module increases, the performance of the local learning scheme degrades substantially, severely limiting its expansibility. To avoid this issue, we theoretically analyze the greedy local learning from the standpoint of information theory and propose a ContSup scheme, which incorporates context supply between isolated modules to compensate for information loss. Experiments on benchmark datasets (i.e. CIFAR, SVHN, STL-10) achieve SOTA results and indicate that our proposed method can significantly improve the performance of greedy local learning with minimal memory and computational overhead, allowing for the boost of the number of isolated modules. Our codes are available at https://github.com/Tab-ct/ContSup.

cs.LG↗

arXiv2022

STSC-SNN: Spatio-Temporal Synaptic Connection with Temporal Convolution and Attention for Spiking Neural Networks

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological plausibility. The potential to efficiently extract spatio-temporal features makes it suitable for processing the event streams. However, existing synaptic structures in SNNs are almost full-connections or spatial 2D convolution, neither of which can extract temporal dependencies adequately. In this work, we take inspiration from biological synapses and propose a spatio-temporal synaptic connection SNN (STSC-SNN) model, to enhance the spatio-temporal receptive fields of synaptic connections, thereby establishing temporal dependencies across layers. Concretely, we incorporate temporal convolution and attention mechanisms to implement synaptic filtering and gating functions. We show that endowing synaptic models with temporal dependencies can improve the performance of SNNs on classification tasks. In addition, we investigate the impact of performance vias varied spatial-temporal receptive fields and reevaluate the temporal modules in SNNs. Our approach is tested on neuromorphic datasets, including DVS128 Gesture (gesture recognition), N-MNIST, CIFAR10-DVS (image classification), and SHD (speech digit recognition). The results show that the proposed model outperforms the state-of-the-art accuracy on nearly all datasets.

cs.NE↗

arXiv2022

MAP-SNN: Mapping Spike Activities with Multiplicity, Adaptability, and Plasticity into Bio-Plausible Spiking Neural Networks

Spiking Neural Network (SNN) is considered more biologically realistic and power-efficient as it imitates the fundamental mechanism of the human brain. Recently, backpropagation (BP) based SNN learning algorithms that utilize deep learning frameworks have achieved good performance. However, bio-interpretability is partially neglected in those BP-based algorithms. Toward bio-plausible BP-based SNNs, we consider three properties in modeling spike activities: Multiplicity, Adaptability, and Plasticity (MAP). In terms of multiplicity, we propose a Multiple-Spike Pattern (MSP) with multiple spike transmission to strengthen model robustness in discrete time-iteration. To realize adaptability, we adopt Spike Frequency Adaption (SFA) under MSP to decrease spike activities for improved efficiency. For plasticity, we propose a trainable convolutional synapse that models spike response current to enhance the diversity of spiking neurons for temporal feature extraction. The proposed SNN model achieves competitive performances on neuromorphic datasets: N-MNIST and SHD. Furthermore, experimental results demonstrate that the proposed three aspects are significant to iterative robustness, spike efficiency, and temporal feature extraction capability of spike activities. In summary, this work proposes a feasible scheme for bio-inspired spike activities with MAP, offering a new neuromorphic perspective to embed biological characteristics into spiking neural networks.

cs.NE↗

arXiv2022

Stack operation of tensor networks

The tensor network, as a facterization of tensors, aims at performing the operations that are common for normal tensors, such as addition, contraction and stacking. However, due to its non-unique network structure, only the tensor network contraction is so far well defined. In this paper, we propose a mathematically rigorous definition for the tensor network stack approach, that compress a large amount of tensor networks into a single one without changing their structures and configurations. We illustrate the main ideas with the matrix product states based machine learning as an example. Our results are compared with the for loop and the efficient coding method on both CPU and GPU.

cs.LG↗

arXiv2022

SUTD-PRCM Dataset and Neural Architecture Search Approach for Complex Metasurface Design

Metasurfaces have received a lot of attentions recently due to their versatile capability in manipulating electromagnetic wave. Advanced designs to satisfy multiple objectives with non-linear constraints have motivated researchers in using machine learning (ML) techniques like deep learning (DL) for accelerated design of metasurfaces. For metasurfaces, it is difficult to make quantitative comparisons between different ML models without having a common and yet complex dataset used in many disciplines like image classification. Many studies were directed to a relatively constrained datasets that are limited to specified patterns or shapes in metasurfaces. In this paper, we present our SUTD polarized reflection of complex metasurfaces (SUTD-PRCM) dataset, which contains approximately 260,000 samples of complex metasurfaces created from electromagnetic simulation, and it has been used to benchmark our DL models. The metasurface patterns are divided into different classes to facilitate different degree of complexity, which involves identifying and exploiting the relationship between the patterns and the electromagnetic responses that can be compared in using different DL models. With the release of this SUTD-PRCM dataset, we hope that it will be useful for benchmarking existing or future DL models developed in the ML community. We also propose a classification problem that is less encountered and apply neural architecture search to have a preliminary understanding of potential modification to the neural architecture that will improve the prediction by DL models. Our finding shows that convolution stacking is not the dominant element of the neural architecture anymore, which implies that low-level features are preferred over the traditional deep hierarchical high-level features thus explains why deep convolutional neural network based models are not performing well in our dataset.

cs.LG↗

arXiv2021

Observation of topologically enabled complete polarization conversion

Exploiting topological ideas has been a major theme in modern photonics, which provides unprecedented opportunities to design photonic devices with robustness against defects and flaws. While most previous works in topological photonics have focused on band theory, recent theoretical advances extend the topological concepts to the analysis of scattering matrices and suggest a topological route to complete polarization conversion (CPC), a unique photonic phenomenon without an electronic counterpart. Here, we report on the experimental observation of the topological effect in reflection matrices of a photonic crystal slab, enabling CPC between two linear polarizations over a wide range of frequencies. Using angle-resolved reflection measurements, we observe CPC occurring at vortex singularities of reflection coefficients in momentum space, verifying the topological nature of CPC. In addition, the topological effect also guarantees the spin-preserved reflection of a circularly polarized wave. Remarkably, we experimentally establish a connection between two seemingly unrelated topological phenomena--CPC and bound states in the continuum (BICs): BICs lie on the critical coupling curves that define the condition for CPC. Our work paves the way to exploring the topological properties in scattering matrices for controlling light polarization and spin and creating robust photonic devices.

physics.class-ph↗

arXiv2021

Polarization-Orthogonal Nondegenerate Plasmonic Higher-Order Topological States

Photonic topological states, providing light-manipulation approaches in robust manners, have attracted intense attention. Connecting photonic topological states with far-field degrees of freedom(DoFs) has given rise to fruitful phenomena. Recently emerged higher-order topological insulators (HOTIs), hosting boundary states two or more dimensions lower than those of bulk, offer new paradigms to localize/transport light topologically in extended dimensionalities. However, photonic HOTIs have not been related to DoFs of radiation fields yet. Here, we report the observation of polarization-orthogonal second-order topological corner states at different frequencies on a designer-plasmonic Kagome metasurface in the far field.Such phenomenon stands on two mechanisms, i.e., projecting the far-field polarizations to the intrinsic parity DoFs of lattice modes and the parity splitting of the plasmonic corner states in spectra. We theoretically and numerically show that the parity splitting originates from the underlying inter-orbital coupling. Both near-field and far-field experiments verify the polarization-orthogonal nondegeneratesecond-order topological corner states. These results promise applications in robust optical single photon emitters and multiplexed photonic devices.

physics.optics↗

arXiv2021

High-Performance Permanent Magnet Array Design by a Fast Genetic Algorithm (GA)-based Optimization for Low-Field Portable MRI

A permanent magnet array (PMA) is a preferred source of magnetic field for body-part-dedicated low-field (<0.5 T) portable magnetic resonance imaging (MRI) because it has a small footprint, no power consumption, and no need for a cooling system. The current popular PMA is limited by the transversal field below 100 mT, where advanced technologies developed for the long-bore MRI systems (e.g., multi-channel techniques) cannot be applied. In this paper, a sparse high-performance PMA is proposed based on inward-outward ring pairs and using magnet blocks that can be bought off the shelf, targeting on portable head imaging. Through a fast genetic algorithm (GA)-based optimization, the proposed PMA has a longitudinal magnetic field with an average field strength of 111.40 mT and a monotonic field pattern with inhomogeneity of 10.57 mT (an RF bandwidth of <10%) within a Field of View (FoV) of 20 cm in diameter and 4.5 cm in length. The resulting field was validated using analytic calculations and numerical simulations. The encoding capability of the designed PMA was examined by checking the quality of the simulated reconstructed images. The proposed field outperforms a linear pattern for encoding. The PMA is 57.91 cm wide, 38 cm long, has a 5-gauss range of 87x87x104 cm^3, allowing an operation in a small space. It weights 126.08kg, comprising of a stationary main array that supplies a strong homogeneous field, and a light rotatable sub-gradient-array (5.12kg) that supplies a monotonic field for signal encoding. It has a magnetic field generation efficiency of 0.88mT/kg, the highest among sparse PMAs that offer a monotonic field pattern. The force experienced by each magnet was calculated to validate the feasibility of physical implementation. The proposed PMA can be a promising alternative to supply the main and gradient fields combined for dedicated portable MRI.

physics.med-ph↗

arXiv2020

Controlling asymmetric absorption of metasurfaces via non-Hermitian doping

Metasurfaces based on subwavelength resonators enable novel ways to manipulate the flow of light at optical interfaces. In pursuit of multifunctional or reconfigurable metadevices, efficient tuning of macroscopic performance with little structural/material variation remains a challenge. Here, we put forward the concept of non-Hermitian doping in metasurfaces, showing that an ordinary retroreflector can be switched to asymmetric one by introducing absorptive defects in local regions. The asymmetric absorption performance begins with zero at the Hermitian state, gradually increases under non-Hermitian doping, and reaches the maximum of unity at the exceptional point. This effect is experimentally demonstrated at microwave frequencies via the observation of asymmetric near-field distribution and far-field scattering properties and from a planar metasurface. Furthermore, while importing local gain constituents in conventional retroreflector, it can be tuned to an extremely asymmetric one-side amplifier, extending unidirectional amplification from one-dimensional waveguide to two-dimensional scattering systems. The proposed methodology provides an alternative pathway for engineering electromagnetic metadevices and systems with small perturbations. Introduction

physics.optics↗

arXiv2019

Higher-order photonic topological states in surface-wave photonic crystals

Photonic topological states have revolutionized our understanding on the propagation and scattering of light. Recent discovery of higher-order photonic topological insulators opens an emergent horizon for zero-dimensional topological corner states. However, the previous realizations of higher-order photonic topological insulators suffer from either a limited operational frequency range due to the lumped components involved or a bulky structure with a large footprint, which are unfavorable for future integrated photonics. To overcome these limitations, we hereby experimentally demonstrate a planar surface-wave photonic crystal realization of two-dimensional higher-order topological insulators. The surface-wave photonic crystals exhibit a very large bulk bandgap (a bandwidth of 28%) due to multiple Bragg scatterings and host one-dimensional gapped edge states described by massive Dirac equations. The topology of those higher-dimensional photonic bands leads to the emergence of zero-dimensional corner states, which provide a route toward robust cavity modes for scalable, integrated photonic chips and an interface for the control of light-matter interaction.

physics.app-ph↗

arXiv2018

Type-I hyperbolic metasurfaces for highly-squeezed designer polaritons with negative group velocity

Hyperbolic polaritons in van der Waals materials and metamaterial heterostructures provide unprecedented control over light-matter interaction at the extreme nanoscale. Here, we propose a concept of type-I hyperbolic metasurface supporting highly-squeezed magnetic designer polaritons, which act as magnetic analogues to hyperbolic polaritons in the hexagonal boron nitride (h-BN) in the first Reststrahlen band. Comparing with the natural h-BN, the size and spacing of the metasurface unit cell can be readily scaled up (or down), allowing for manipulating designer polaritons in frequency and in space at will. Experimental measurements display the cone-like hyperbolic dispersion in the momentum space, associating with an effective refractive index up to 60 and a group velocity down to 1/400 of the light speed in vacuum. By tailoring the proposed metasurface, we experimentally demonstrate an ultra-compact (with a footprint shrunken by 3600 times) integrated designer polariton circuit including high-transmission 90{\deg} sharp bending waveguides and waveguide splitters. The designed metasurface with a low profile, lightweight, and ease of access, can serve as an alternatively promising platform for emerging polaritonics, and may find many other potential applications, such as waveguiding, sensing, subdiffraction focusing/imaging, low-threshold Cherenkov radiation, strong magnetic transition enhancement, wireless energy transfer, and so forth.

cond-mat.mes-hall↗

arXiv2018

Experimental observation of superscattering

Superscattering, induced by degenerate resonances, breaks the fundamental single-channel limit of scattering cross section of subwavelength structures; in principle, an arbitrarily large total cross section can be achieved via superscattering. It thus provides a unique way to strengthen the light-matter interaction at the subwavelength scale, and has many potential applications in sensing, energy harvesting, bio-imaging (such as magnetic resonance imaging), communication and optoelectronics. However, the experimental demonstration of superscattering remains an open challenge due to its vulnerability to structural imperfections and intrinsic material losses. Here we report the first experimental evidence for superscattering, by demonstrating the superscattering simultaneously in two different frequency regimes through both the far-field and near-field measurements. The underlying mechanism for the observed superscattering is the degenerate resonances of confined surface waves, by utilizing a subwavelength metasurface-based multilayer structure. Our work paves the way towards practical applications based on superscattering.

physics.class-ph↗