arXiv subjects

Liang Feng

Publications and source records attributed to Liang Feng.

At least 55 records · Page 3Linked to original sources

arXiv2024

Learning to Transfer for Evolutionary Multitasking

Evolutionary multitasking (EMT) is an emerging approach for solving multitask optimization problems (MTOPs) and has garnered considerable research interest. The implicit EMT is a significant research branch that utilizes evolution operators to enable knowledge transfer (KT) between tasks. However, current approaches in implicit EMT face challenges in adaptability, due to the use of a limited number of evolution operators and insufficient utilization of evolutionary states for performing KT. This results in suboptimal exploitation of implicit KT's potential to tackle a variety of MTOPs. To overcome these limitations, we propose a novel Learning to Transfer (L2T) framework to automatically discover efficient KT policies for the MTOPs at hand. Our framework conceptualizes the KT process as a learning agent's sequence of strategic decisions within the EMT process. We propose an action formulation for deciding when and how to transfer, a state representation with informative features of evolution states, a reward formulation concerning convergence and transfer efficiency gain, and the environment for the agent to interact with MTOPs. We employ an actor-critic network structure for the agent and learn it via proximal policy optimization. This learned agent can be integrated with various evolutionary algorithms, enhancing their ability to address a range of new MTOPs. Comprehensive empirical studies on both synthetic and real-world MTOPs, encompassing diverse inter-task relationships, function classes, and task distributions are conducted to validate the proposed L2T framework. The results show a marked improvement in the adaptability and performance of implicit EMT when solving a wide spectrum of unseen MTOPs.

cs.NE↗

arXiv2024

Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap

Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and evolutionary algorithms (EAs), despite differing in objectives and methodologies, share a common pursuit of applicability in complex problems. Meanwhile, EA can provide an optimization framework for LLM's further enhancement under black-box settings, empowering LLM with flexible global search capacities. On the other hand, the abundant domain knowledge inherent in LLMs could enable EA to conduct more intelligent searches. Furthermore, the text processing and generative capabilities of LLMs would aid in deploying EAs across a wide range of tasks. Based on these complementary advantages, this paper provides a thorough review and a forward-looking roadmap, categorizing the reciprocal inspiration into two main avenues: LLM-enhanced EA and EA-enhanced LLM. Some integrated synergy methods are further introduced to exemplify the complementarity between LLMs and EAs in diverse scenarios, including code generation, software engineering, neural architecture search, and various generation tasks. As the first comprehensive review focused on the EA research in the era of LLMs, this paper provides a foundational stepping stone for understanding the collaborative potential of LLMs and EAs. The identified challenges and future directions offer guidance for researchers and practitioners to unlock the full potential of this innovative collaboration in propelling advancements in optimization and artificial intelligence. We have created a GitHub repository to index the relevant papers: https://github.com/wuxingyu-ai/LLM4EC.

cs.NE↗

arXiv2024

Accelerate Solving Expensive Scheduling by Leveraging Economical Auxiliary Tasks

To fully leverage the multi-task optimization paradigm for accelerating the solution of expensive scheduling problems, this study has effectively tackled three vital concerns. The primary issue is identifying auxiliary tasks that closely resemble the original expensive task. We suggested a sampling strategy based on job importance, creating a compact matrix by extracting crucial rows from the entire problem specification matrix of the expensive task. This matrix serves as an economical auxiliary task. Mathematically, we proved that this economical auxiliary task bears similarity to its corresponding expensive task. The subsequent concern revolves around making auxiliary tasks more cost-effective. We determined the sampling proportions for the entire problem specification matrix through factorial design experiments, resulting in a more compact auxiliary task. With a reduced search space and shorter function evaluation time, it can rapidly furnish high-quality transferable information for the primary task. The last aspect involves designing transferable deep information from auxiliary tasks. We regarded the job priorities in the (sub-) optimal solutions to the economical auxiliary task as transferable invariants. By adopting a partial solution patching strategy, we augmented specificity knowledge onto the common knowledge to adapt to the target expensive task. The strategies devised for constructing task pairs and facilitating knowledge transfer, when incorporated into various evolutionary multitasking algorithms, were utilized to address expensive instances of permutation flow shop scheduling. Extensive experiments and statistical comparisons have validated that, with the collaborative synergy of these strategies, the performance of evolutionary multitasking algorithms is significantly enhanced in handling expensive scheduling tasks.

math.OC↗

arXiv2024

How Multimodal Integration Boost the Performance of LLM for Optimization: Case Study on Capacitated Vehicle Routing Problems

Recently, large language models (LLMs) have notably positioned them as capable tools for addressing complex optimization challenges. Despite this recognition, a predominant limitation of existing LLM-based optimization methods is their struggle to capture the relationships among decision variables when relying exclusively on numerical text prompts, especially in high-dimensional problems. Keeping this in mind, we first propose to enhance the optimization performance using multimodal LLM capable of processing both textual and visual prompts for deeper insights of the processed optimization problem. This integration allows for a more comprehensive understanding of optimization problems, akin to human cognitive processes. We have developed a multimodal LLM-based optimization framework that simulates human problem-solving workflows, thereby offering a more nuanced and effective analysis. The efficacy of this method is evaluated through extensive empirical studies focused on a well-known combinatorial optimization problem, i.e., capacitated vehicle routing problem. The results are compared against those obtained from the LLM-based optimization algorithms that rely solely on textual prompts, demonstrating the significant advantages of our multimodal approach.

cs.AI↗

arXiv2024

Simple realization of a fragile topological lattice with quasi flat-bands in a microcavity array

Topological flat bands (TFBs) are increasingly recognized as an important paradigm to study topological effects in the context of strong correlation physics. As a representative example, recently it has been theoretically proposed that the topological non-triviality offers a unique contribution to flat-band superconductivity, which can potentially lead to a higher critical temperature of superconductivity phase transition. Nevertheless, the topological effects within flat bands in bosonic systems, specifically in the context of Bose-Einstein condensation (BEC), are less explored. It has been shown theoretically that non-trivial topological and geometric properties will also have a significant influence in bosonic condensates as well. However, potential experimental realizations have not been extensively studied yet. In this work, we introduce a simple photonic lattice from coupled Kagome and triangular lattices designed based on topological quantum chemistry theory, which supports topologically nontrivial quasi-flat bands. Besides band representation analysis, the non-triviality of these quasi-flat bands is also confirmed by Wilson loop spectra which exhibit winding features. We further discuss the corresponding experimental realization in a microcavity array for future study supporting the potential extension to condensed exciton-polaritons. Notably, we showed that the inevitable in-plane longitudinal-transverse polarization splitting in optical microcavities will not hinder the construction of topological quasi-flat bands. This work acts as an initial step to experimentally explore the physical consequence of non-trivial topology and quantum geometry in quasi-flat bands in bosonic systems, offering potential channels for its direct observation.

cond-mat.mes-hall↗

arXiv2024

Towards Multi-Objective High-Dimensional Feature Selection via Evolutionary Multitasking

Evolutionary Multitasking (EMT) paradigm, an emerging research topic in evolutionary computation, has been successfully applied in solving high-dimensional feature selection (FS) problems recently. However, existing EMT-based FS methods suffer from several limitations, such as a single mode of multitask generation, conducting the same generic evolutionary search for all tasks, relying on implicit transfer mechanisms through sole solution encodings, and employing single-objective transformation, which result in inadequate knowledge acquisition, exploitation, and transfer. To this end, this paper develops a novel EMT framework for multiobjective high-dimensional feature selection problems, namely MO-FSEMT. In particular, multiple auxiliary tasks are constructed by distinct formulation methods to provide diverse search spaces and information representations and then simultaneously addressed with the original task through a multi-slover-based multitask optimization scheme. Each task has an independent population with task-specific representations and is solved using separate evolutionary solvers with different biases and search preferences. A task-specific knowledge transfer mechanism is designed to leverage the advantage information of each task, enabling the discovery and effective transmission of high-quality solutions during the search process. Comprehensive experimental results demonstrate that our MO-FSEMT framework can achieve overall superior performance compared to the state-of-the-art FS methods on 26 datasets. Moreover, the ablation studies verify the contributions of different components of the proposed MO-FSEMT.

cs.NE↗

arXiv2023

Robust zero modes in non-Hermitian systems without global symmetries

We present an approach to achieve zero modes in lattice models that do not rely on any symmetry or topology of the bulk, which are robust against disorder in the bulk of any type and strength. Such symmetry-free zero modes (SFZMs) are formed by attaching a single site or small cluster with zero mode(s) to the bulk, which serves as the "nucleus" that expands to the entire lattice. We identify the requirements on the couplings between this boundary and the bulk, which reveals that this approach is intrinsically non-Hermitian. We then provide several examples with either an arbitrary or structured bulk, forming spectrally embedded zero modes in the bulk continuum, midgap zero modes, and even restoring the "zeroness" of coupling or disorder-shifted topological corner states. Focusing on viable realizations using photonic lattices, we show that the resulting SFZM can be observed as the single lasing mode when optical gain is applied to the boundary.

physics.optics↗

arXiv2023

A Scalable Test Problem Generator for Sequential Transfer Optimization

Sequential transfer optimization (STO), which aims to improve the optimization performance on a task of interest by exploiting the knowledge captured from several previously-solved optimization tasks stored in a database, has been gaining increasing research attention over the years. However, despite the remarkable advances in algorithm design, the development of a systematic benchmark suite for comprehensive comparisons of STO algorithms received far less attention. Existing test problems are either simply generated by assembling other benchmark functions or extended from specific practical problems with limited scalability. The relationships between the optimal solutions of the source and target tasks in these problems are also often manually configured, limiting their ability to model different similarity relationships presented in real-world problems. Consequently, the good performance achieved by an algorithm on these problems might be biased and hard to be generalized to other problems. In light of the above, in this study, we first introduce four concepts for characterizing STO problems and present an important problem feature, namely similarity distribution, which quantitatively delineates the relationship between the optima of the source and target tasks. Then, we present the general design guidelines of STO problems and a particular STO problem generator with good scalability. Specifically, the similarity distribution of a problem can be easily customized, enabling a continuous spectrum of representation of the diverse similarity relationships of real-world problems. Lastly, a benchmark suite with 12 STO problems featured by a variety of customized similarity relationships is developed using the proposed generator. The source code of the problem generator is available at https://github.com/XmingHsueh/STOP-G.

cs.NE↗

arXiv2023

Non-Hermitian gauged laser arrays with localized excitations: Anomalous threshold and generalized principle of selective pumping

We investigate non-Hermitian skin modes in laser arrays with spatially localized excitation. Intriguingly, we observe an unusual threshold behavior when selectively pumping either the head or the tail of these modes: both cases exhibit the same lasing threshold and hence defy the conventional principle of selective pumping, which aims to maximize the overlap between the pump profile and the target lasing mode. To shed light on this enigma, we reveal a previously overlooked phenomenon, i.e., energy exchange at non-Hermitian coupling junctions with the photonic environment, which does not occur with uniform gain or loss. Utilizing a transfer matrix approach, we elucidate the mechanism of this anomalous threshold behavior, which is determined by the specific physical realization of the non-Hermitian gauge field (i.e., using gain, loss, or their mixture). Finally, we derive a generalized principle of selective pumping in non-Hermitian arrays, which shows that the decisive spatial overlap is given by the tripartite product of the pump, the lasing mode, and its biorthogonal partner. Our study provides a glimpse into how the two forms of non-Hermiticity, i.e., asymmetric couplings and a complex onsite potential, interact synergetically in laser arrays, which may stimulate further explorations of their collective effects in photonics and related fields.

physics.optics↗

arXiv2023

Analysis of Dirac exceptional points and their isospectral Hermitian counterparts

Recently, a Dirac exceptional point (EP) was reported in a non-Hermitian system. Unlike a Dirac point in Hermitian systems, this Dirac EP has coalesced eigenstates in addition to the degenerate energy. Also different from a typical EP, the two energy levels connected at this Dirac EP remain real in its vicinity and display a linear instead of square root dispersion, forming a tilted Dirac cone in the hybrid space consisting of a momentum dimension and a synthetic dimension for the strength of non-Hermiticity. In this report, we first present simple three-band and two-band matrix models with a Dirac EP, where the linear dispersion of the tilted Dirac cone can be expressed analytically. Importantly, our analysis also reveals that there exist Hermitian and non-Hermitian systems that have the same (real-valued) energy spectrum in their entire parameter space, with the exception that one or more degeneracies in the former are replaced by Dirac EPs in the later. Finally, we show the existence of an imaginary Dirac cone with an EP at its center.

quant-ph↗

arXiv2023

Complex Berry phase and imperfect non-Hermitian phase transitions

In many classical and quantum systems described by an effective non-Hermitian Hamiltonian, spectral phase transitions, from an entirely real energy spectrum to a complex spectrum, can be observed as a non-Hermitian parameter in the system is increased above a critical value. A paradigmatic example is provided by systems possessing parity-time (PT) symmetry, where the energy spectrum remains entirely real in the unbroken PT phase while a transition to complex energies is observed in the unbroken PT phase. Such spectral phase transitions are universally sharp. However, when the system is slowly and periodically cycled, the phase transition can become smooth, i.e. imperfect, owing to the complex Berry phase associated to the cyclic adiabatic evolution of the system. This remarkable phenomenon is illustrated by considering the spectral phase transition of the Wannier-Stark ladders in a PT-symmetric class of two-band non-Hermitian lattices subjected to an external dc field, unraveling that a non-vanishing imaginary part of the Zak phase -- the Berry phase picked up by a Bloch eigenstate evolving across the entire Brillouin zone -- is responsible for imperfect spectral phase transitions

quant-ph↗

arXiv2022

Imaginary gauge transformation in momentum space and Dirac exceptional point

An imaginary gauge transformation is at the core of the non-Hermitian skin effect. Here we show that such a transformation can be performed in momentum space as well, which reveals that certain gain and loss modulated systems in their parity-time (PT) symmetric phases are equivalent to Hermitian systems with real potentials. Our analysis in momentum space also distinguishes two types of exceptional points (EPs) in the same system. Besides the conventional type that leads to a PT transition upon the continuous increase of gain and loss, we find real-valued energy bands connected at a Dirac EP in hybrid dimensions, consisting of a spatial dimension and a synthetic dimension for the gain and loss strength.

quant-ph↗

arXiv2022

The missing link between standing- and traveling-wave resonators

Optical resonators are structures that utilize wave interference and feedback to confine light in all three dimensions. Depending on the feedback mechanism, resonators can support either standing- or traveling-wave modes. Over the years, the distinction between these two different types of modes has become so prevalent that nowadays it is one of the main characteristics for classifying optical resonators. Here, we show that an intermediate link between these two rather different groups exists. In particular, we introduce a new class of photonic resonators that supports a hybrid optical mode, i.e. at one location along the resonator the electromagnetic fields associated with the mode feature a purely standing-wave pattern, while at a different location, the fields of the same mode represent a pure traveling wave. The proposed concept is general and can be implemented using chip-scale photonics as well as free-space optics. Moreover, it can be extended to other wave phenomena such as microwaves and acoustics.

physics.optics↗

arXiv2022

Balancing Exploration and Exploitation for Solving Large-scale Multiobjective Optimization via Attention Mechanism

Large-scale multiobjective optimization problems (LSMOPs) refer to optimization problems with multiple conflicting optimization objectives and hundreds or even thousands of decision variables. A key point in solving LSMOPs is how to balance exploration and exploitation so that the algorithm can search in a huge decision space efficiently. Large-scale multiobjective evolutionary algorithms consider the balance between exploration and exploitation from the individual's perspective. However, these algorithms ignore the significance of tackling this issue from the perspective of decision variables, which makes the algorithm lack the ability to search from different dimensions and limits the performance of the algorithm. In this paper, we propose a large-scale multiobjective optimization algorithm based on the attention mechanism, called (LMOAM). The attention mechanism will assign a unique weight to each decision variable, and LMOAM will use this weight to strike a balance between exploration and exploitation from the decision variable level. Nine different sets of LSMOP benchmarks are conducted to verify the algorithm proposed in this paper, and the experimental results validate the effectiveness of our design.

cs.NE↗

arXiv2021

Multi-Space Evolutionary Search for Large-Scale Optimization

In recent years, to improve the evolutionary algorithms used to solve optimization problems involving a large number of decision variables, many attempts have been made to simplify the problem solution space of a given problem for the evolutionary search. In the literature, the existing approaches can generally be categorized as decomposition-based methods and dimension-reduction-based methods. The former decomposes a large-scale problem into several smaller subproblems, while the latter transforms the original high-dimensional solution space into a low-dimensional space. However, it is worth noting that a given large-scale optimization problem may not always be decomposable, and it is also difficult to guarantee that the global optimum of the original problem is preserved in the reduced low-dimensional problem space. This paper thus proposes a new search paradigm, namely the multi-space evolutionary search, to enhance the existing evolutionary search methods for solving large-scale optimization problems. In contrast to existing approaches that perform an evolutionary search in a single search space, the proposed paradigm is designed to conduct a search in multiple solution spaces that are derived from the given problem, each possessing a unique landscape. The proposed paradigm makes no assumptions about the large-scale optimization problem of interest, such as that the problem is decomposable or that a certain relationship exists among the decision variables. To verify the efficacy of the proposed paradigm, comprehensive empirical studies in comparison to four state-of-the-art algorithms were conducted using the CEC2013 large-scale benchmark problems.

cs.NE↗

arXiv2021

MicroRec: Efficient Recommendation Inference by Hardware and Data Structure Solutions

Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The inference is also heavily constrained in terms of latency because producing a recommendation for a user must be done in about tens of milliseconds. In this paper, we propose MicroRec, a high-performance inference engine for recommendation systems. MicroRec accelerates recommendation inference by (1) redesigning the data structures involved in the embeddings to reduce the number of lookups needed and (2) taking advantage of the availability of High-Bandwidth Memory (HBM) in FPGA accelerators to tackle the latency by enabling parallel lookups. We have implemented the resulting design on an FPGA board including the embedding lookup step as well as the complete inference process. Compared to the optimized CPU baseline (16 vCPU, AVX2-enabled), MicroRec achieves 13.8~14.7x speedup on embedding lookup alone and 2.5$~5.4x speedup for the entire recommendation inference in terms of throughput. As for latency, CPU-based engines needs milliseconds for inferring a recommendation while MicroRec only takes microseconds, a significant advantage in real-time recommendation systems.

cs.AR↗

arXiv2020

Scalable Light-Weight Integration of FPGA Based Accelerators with Chip Multi-Processors

Modern multicore systems are migrating from homogeneous systems to heterogeneous systems with accelerator-based computing in order to overcome the barriers of performance and power walls. In this trend, FPGA-based accelerators are becoming increasingly attractive, due to their excellent flexibility and low design cost. In this paper, we propose the architectural support for efficient interfacing between FPGA-based multi-accelerators and chip-multiprocessors (CMPs) connected through the network-on-chip (NoC). Distributed packet receivers and hierarchical packet senders are designed to maintain scalability and reduce the critical path delay under a heavy task load. A dedicated accelerator chaining mechanism is also proposed to facilitate intra-FPGA data reuse among accelerators to circumvent prohibitive communication overhead between the FPGA and processors. In order to evaluate the proposed architecture, a complete system emulation with programmability support is performed using FPGA prototyping. Experimental results demonstrate that the proposed architecture has high-performance, and is light-weight and scalable in characteristics.

cs.AR↗

arXiv2020

FP-Stereo: Hardware-Efficient Stereo Vision for Embedded Applications

Fast and accurate depth estimation, or stereo matching, is essential in embedded stereo vision systems, requiring substantial design effort to achieve an appropriate balance among accuracy, speed and hardware cost. To reduce the design effort and achieve the right balance, we propose FP-Stereo for building high-performance stereo matching pipelines on FPGAs automatically. FP-Stereo consists of an open-source hardware-efficient library, allowing designers to obtain the desired implementation instantly. Diverse methods are supported in our library for each stage of the stereo matching pipeline and a series of techniques are developed to exploit the parallelism and reduce the resource overhead. To improve the usability, FP-Stereo can generate synthesizable C code of the FPGA accelerator with our optimized HLS templates automatically. To guide users for the right design choice meeting specific application requirements, detailed comparisons are performed on various configurations of our library to investigate the accuracy/speed/cost trade-off. Experimental results also show that FP-Stereo outperforms the state-of-the-art FPGA design from all aspects, including 6.08% lower error, 2x faster speed, 30% less resource usage and 40% less energy consumption. Compared to GPU designs, FP-Stereo achieves the same accuracy at a competitive speed while consuming much less energy.

cs.CV↗