arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2609.37473

KT-EGO: A Knowledge Transfer Assisted Efficient Global Optimization Algorithm for Solving High-Dimensional Expensive Black-Box Problems

Qineng Wang·Liming Song·Yun Chen·Guangjian Ma·Zhendong Guo·Jun Li
View original source ↗Read source document ↗Export metadata ↓

Abstract

Many engineering problems involve optimizing a high-dimensional expensive black-box (HEB) design space. To solve such problems efficiently, we propose a knowledge transfer assisted efficient global optimization (EGO) algorithm, labeled as KT-EGO, which extends the EGO algorithm for solving problems over higher dimensions (i.e., $d>20$). Specifically, the original design space is divided into several low-dimensional subset design spaces. More importantly, in order to extract information from the subset design spaces to accelerate the progress of full optimization, we propose a surrogate-based data fusion strategy in KT-EGO. And further, a searching strategy with an adaptive variable range is devised to enhance the exploitation of promising areas. To show the effectiveness of our proposed algorithm, it is compared against the state-of-the-art algorithms over 12 benchmark functions and a 28-dimensional engineering optimization for the design of compressor blade, which fully validates the effectiveness of the KT-EGO for solving HEB problems.

Explore related subjects

cs.CEcs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Qineng Wang, Liming Song, Yun Chen, Guangjian Ma, Zhendong Guo, Jun Li. 2026-09-28. KT-EGO: A Knowledge Transfer Assisted Efficient Global Optimization Algorithm for Solving High-Dimensional Expensive Black-Box Problems. https://doi.org/10.1080/0305215x.2022.2139374

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Trusting the Inverse: Reliability-Aware Mapping for Simulation-Based Microstructure Estimation in Diffusion MRI

Diffusion-weighted MRI can probe tissue microstructure non-invasively, however interpreting microstructural parameter estimates remains challenging due to the intrinsic ambiguity of the inverse problem. While simulation-based approaches can incorporate increasingly realistic tissue models, they still lack voxel-wise characterisation of the reliability and degeneracy of the inferred parameters. Here, we introduce a reliability framework for simulation-based microstructure estimation based on three complementary scores that identify distinct sources of unreliability in the estimation process: out-of-distribution signals, local signal mismatch, and parameter degeneracy. The framework was implemented using a Monte Carlo dictionary of 1,050 synthetic voxels generated from geometrically realistic substrates, with parameter ranges grounded in electron microscopy measurements of rat corpus callosum. The dictionary spans biologically plausible axon radii (0.25-0.85 $μ$m), microscopic angular spread (0-10$^\circ$), packing densities (60-92%), and intrinsic diffusivities (1.75-3.0 $μ$m$^2$/ms). On synthetic data, the resulting Reliability Index correlated with actual estimation error (Spearman $ρ= -0.742$) and distinguished between extrapolation, poor local interpolation, and parameter degeneracy. Applied to in vivo corpus callosum DW-MRI in rat (256 voxels, four animals) and human (MGH-USC HCP, 18,765 voxels, nine subjects), 91% and 73% of voxels respectively exceeded $R > 0.5$. These results demonstrate how reliability-aware analysis can support the interpretation and future development of simulation-based diffusion MRI microstructure models.

cs.CE↗
arXiv2026

ScentGen: Hierarchical Multimodal Olfactory Semantic Modeling for Molecular Odor Description Generation

In this paper, we introduce a molecular odor description generation task, which aims to generate natural language odor descriptions from molecular structures. Unlike conventional methods that describe molecular odor using discrete labels, this task generates expressive and human-interpretable sensory descriptions. To address this task, we propose a hierarchical multimodal olfactory semantic modeling framework, named ScentGen. ScentGen consists of three key components: an odor semantic planner, a semantic adapter, and a description generator. The odor semantic planner integrates complementary molecular information from 1D SMILES sequences, 2D molecular graphs, and 3D molecular conformations to learn discriminative and structured olfactory semantics. The semantic adapter further maps the learned olfactory representation into the hidden space of a large language model, transforming molecular odor semantics into language-compatible continuous prompts. Conditioned on these prompts, the description generator produces coherent odor descriptions that reflect plausible sensory characteristics of the input molecule. Considering the lack of molecular datasets with natural language odor descriptions, we further construct a molecular odor description dataset containing paired multimodal molecular representations and human-interpretable odor descriptions. Extensive experiments demonstrate that ScentGen generates coherent and expressive odor descriptions, providing a more flexible solution for molecular odor understanding beyond discrete odor label prediction.

cs.CE↗
arXiv2026

SymbolicLM: Training Language Models as Symbolic Regressors

Large Language Models (LLMs) have shown promising capabilities in scientific reasoning, yet scientific discovery ultimately requires deriving precise laws directly from observational data, known as Symbolic Regression (SR). This poses a challenge for LLMs due to the gap between probabilistic text generation and the exact structural requirements of SR. Existing approaches rely on complex external scaffolds, which are computationally expensive and separate symbolic reasoning from the model itself. To address this limitation, we propose to directly equip LLMs with symbolic regression capabilities through dedicated numerical-symbolic and physical supervision. We introduce PhysSymbArena, a large-scale benchmark containing over 160,000 equations and 1.8B tokens of numerical-symbolic data with physical descriptions, enabling systematic training and evaluation. Based on PhysSymbArena, we develop SymbolicLM, which enhances the symbolic regression ability of LLMs through mathematical and physical supervision. During inference, we further introduce SymbolicSGA, a refinement framework that leverages quantitative feedback to iteratively improve generated equations. Experiments on multiple symbolic regression benchmarks show that SymbolicLM substantially improves structural recovery while maintaining competitive numerical fitting performance. These results demonstrate that symbolic regression can be explicitly learned as an intrinsic capability of LLMs.

cs.CE↗