arXiv subjects

Lin Feng

Publications and source records attributed to Lin Feng.

At least 19 recordsLinked to original sources

arXiv2026

Environment-Aware Stable Neural Koopman Dynamics Learning for Input-Driven Systems under Environmental Constraints

Constructing predictive models of nonlinear dynamical systems from measurement data is a longstanding problem in systems identification and control. Although Neural ordinary differential equations~(Neural ODEs), Koopman operator approximations, and input-aware architectures have each moved the field forward, none simultaneously addresses environment-varying operating conditions, rigorous stability guarantees, and input-to-state stability (ISS) certification within a unified trainable framework. This paper introduces Environment-Aware Stable Neural Koopman Dynamics Learning (ESNKD), which integrates four components: (i)~a bundle-structured encoder that maps environmental observations to a geometrically regularized latent manifold, drawing on the fiber bundle framework; (ii)~an input-conditioned Neural ODE whose residual term handles arbitrary external signals, extending the input concomitant philosophy; (iii)~a contraction synthesis layer enforcing convergence via Persidskii-type tractable linear inequalities, analogous to the certification mechanism; and (iv)~a Koopman lifting stage with LMI-based ISS verification that follows the theoretical pipeline of. Theoretical guarantees cover solution existence and uniqueness, incremental exponential stability, ISS with explicit gain bounds, and robustness to environmental perturbation. Experiments on five benchmark systems, including two robotic manipulation platforms, show consistent improvements over five competitive baselines in both prediction accuracy and safety certification rates.

eess.SY↗

arXiv2026

Input-to-State Stable Bundle Koopman Neural ODEs for Learning Controlled Dynamics under Environmental Constraints

We propose ISS-BKNO, a unified framework that integrates Koopman operator identification, Neural ordinary differential equations (ODEs), fiber bundle geometry, and input-to-state stability (ISS) certification. Unlike prior approaches that address stability, extrinsic inputs, or environmental constraints in isolation, the proposed framework simultaneously learns controlled nonlinear dynamics while guaranteeing global convergence and a computable ISS gain. The architecture introduces a three-stage lifting pipeline: a bundle-aware encoder that separates environment-specific fibers, an environment-conditioned Koopman backbone whose matrix spectrum is constrained to lie in the left half-plane, and a residual neural ODE correction whose Jacobian satisfies a quadratic sector bound. Lyapunov-based ISS regularization turns the stability requirement into a differentiable penalty that is jointly optimized with the prediction objective. Theoretical results establish fiber invariance, ISS with an explicit gain formula, and an approximation error bound that scales with the EDMD residual. Experiments on a pendulum, cart-pole, a unicycle-based navigation task, and a Franka Emika manipulator demonstrate substantially improved prediction accuracy and robustness under matched disturbances compared with existing Neural ODE and Koopman baselines.

eess.SY↗

arXiv2026

Safe Data-Driven Control and Dynamical Learning via Constrained Neural Architectures and Koopman Operators

The deployment of learning-based models in safety-critical control systems demands mathematical guarantees that standard regression architectures cannot provide. This paper presents an integrated framework that bridges Neural Ordinary Differential Equations (Neural ODEs), measurement-induced geometric structures, and Koopman operator theory, with the explicit aim of producing data-driven models whose stability certificates are computable, not merely conjectured. Three complementary components are developed and analyzed. First, ControlSynth Neural ODEs enforce global convergence through tractable linear matrix inequalities (LMIs), enabling complex nonlinear dynamics to be captured without sacrificing boundedness guarantees. Second, the ICODE formulation incorporates extrinsic environmental inputs into the learned vector field, while measurement-induced bundle structures confine state trajectories to physically admissible manifolds. Third, a systematic ISS verification pipeline certifies the input-to-state stability of Koopman-identified models via a convex $L_2$-gain LMI, converting an otherwise intractable robustness question into a solvable semidefinite program. The certified model is embedded in an ICODE-MPPI controller, which uses continuous-time residual learning inside a stochastic sampling loop to deliver robust path tracking under parametric uncertainty and persistent disturbances. Numerical experiments on a vehicle path-tracking benchmark and a nonlinear mechanical oscillator demonstrate up to a 61\% reduction in tracking RMSE and a 54\% reduction in state estimation error relative to uncertified baselines, with near-zero LMI violation rates across all evaluated disturbance levels.

eess.SY↗

arXiv2025

A Generalized Energy-Based Adaptive Gradient Method for Optimization

Adaptive Gradient Descent with Energy (AEGD) is a variant of Gradient Descent (GD) designed to address step size sensitivity through an energy-based formulation. AEGD is notable for its unconditional energy stability, ensuring convergence in energy regardless of the initial step size. In this work, we propose the Generalized Energy-Based Adaptive Gradient (gAEGD) method, which extends AEGD by generalizing the energy function beyond the square root form to a broader class of functions. We prove that gAEGD retains the unconditional energy stability property, remains robust to step size selection, and exhibits a two-phase adaptive dynamic: the effective step size first adjusts adaptively, then stabilizes within a range that guarantees decay of the objective function values. We establish an optimal convergence rate of $O(1/k)$ for finding an $\epsilon$-stationary point, along with improved convergence rates for the objective gap under a local Kurdyka-{\L}ojasiewicz (KL) condition. Empirical results support the theoretical analysis and indicate that the generalized energy-based approach preforms effectively and reliably for a broad range of optimization problems.

math.OC↗

arXiv2025

Convolutional Feature Noise Reduction for 2D Cardiac MR Image Segmentation

Noise reduction constitutes a crucial operation within Digital Signal Processing. Regrettably, it frequently remains neglected when dealing with the processing of convolutional features in segmentation networks. This oversight could trigger the butterfly effect, impairing the subsequent outcomes within the entire feature system. To complete this void, we consider convolutional features following Gaussian distributions as feature signal matrices and then present a simple and effective feature filter in this study. The proposed filter is fundamentally a low-amplitude pass filter primarily aimed at minimizing noise in feature signal inputs and is named Convolutional Feature Filter (CFF). We conducted experiments on two established 2D segmentation networks and two public cardiac MR image datasets to validate the effectiveness of the CFF, and the experimental findings demonstrated a decrease in noise within the feature signal matrices. To enable a numerical observation and analysis of this reduction, we developed a binarization equation to calculate the information entropy of feature signals.

cs.CV↗

arXiv2024

Non-contact Dexterous Micromanipulation with Multiple Optoelectronic Robots

Micromanipulation systems leverage automation and robotic technologies to improve the precision, repeatability, and efficiency of various tasks at the microscale. However, current approaches are typically limited to specific objects or tasks, which necessitates the use of custom tools and specialized grasping methods. This paper proposes a novel non-contact micromanipulation method based on optoelectronic technologies. The proposed method utilizes repulsive dielectrophoretic forces generated in the optoelectronic field to drive a microrobot, enabling the microrobot to push the target object in a cluttered environment without physical contact. The non-contact feature can minimize the risks of potential damage, contamination, or adhesion while largely improving the flexibility of manipulation. The feature enables the use of a general tool for indirect object manipulation, eliminating the need for specialized tools. A series of simulation studies and real-world experiments -- including non-contact trajectory tracking, obstacle avoidance, and reciprocal avoidance between multiple microrobots -- are conducted to validate the performance of the proposed method. The proposed formulation provides a general and dexterous solution for a range of objects and tasks at the micro scale.

cs.RO↗

arXiv2024

GMSR:Gradient-Guided Mamba for Spectral Reconstruction from RGB Images

Mainstream approaches to spectral reconstruction (SR) primarily focus on designing Convolution- and Transformer-based architectures. However, CNN methods often face challenges in handling long-range dependencies, whereas Transformers are constrained by computational efficiency limitations. Recent breakthroughs in state-space model (e.g., Mamba) has attracted significant attention due to its near-linear computational efficiency and superior performance, prompting our investigation into its potential for SR problem. To this end, we propose the Gradient-guided Mamba for Spectral Reconstruction from RGB Images, dubbed GMSR-Net. GMSR-Net is a lightweight model characterized by a global receptive field and linear computational complexity. Its core comprises multiple stacked Gradient Mamba (GM) blocks, each featuring a tri-branch structure. In addition to benefiting from efficient global feature representation by Mamba block, we further innovatively introduce spatial gradient attention and spectral gradient attention to guide the reconstruction of spatial and spectral cues. GMSR-Net demonstrates a significant accuracy-efficiency trade-off, achieving state-of-the-art performance while markedly reducing the number of parameters and computational burdens. Compared to existing approaches, GMSR-Net slashes parameters and FLOPS by substantial margins of 10 times and 20 times, respectively. Code is available at https://github.com/wxy11-27/GMSR.

cs.CV↗

arXiv2024

Underwater Variable Zoom: Depth-Guided Perception Network for Underwater Image Enhancement

Underwater scenes intrinsically involve degradation problems owing to heterogeneous ocean elements. Prevailing underwater image enhancement (UIE) methods stick to straightforward feature modeling to learn the mapping function, which leads to limited vision gain as it lacks more explicit physical cues (e.g., depth). In this work, we investigate injecting the depth prior into the deep UIE model for more precise scene enhancement capability. To this end, we present a novel depth-guided perception UIE framework, dubbed underwater variable zoom (UVZ). Specifically, UVZ resorts to a two-stage pipeline. First, a depth estimation network is designed to generate critical depth maps, combined with an auxiliary supervision network introduced to suppress estimation differences during training. Second, UVZ parses near-far scenarios by harnessing the predicted depth maps, enabling local and non-local perceiving in different regions. Extensive experiments on five benchmark datasets demonstrate that UVZ achieves superior visual gain and delivers promising quantitative metrics. Besides, UVZ is confirmed to exhibit good generalization in some visual tasks, especially in unusual lighting conditions. The code, models and results are available at: https://github.com/WindySprint/UVZ.

cs.CV↗

arXiv2023

End-to-End Streaming Video Temporal Action Segmentation with Reinforce Learning

The streaming temporal action segmentation (STAS) task, a supplementary task of temporal action segmentation (TAS), has not received adequate attention in the field of video understanding. Existing TAS methods are constrained to offline scenarios due to their heavy reliance on multimodal features and complete contextual information. The STAS task requires the model to classify each frame of the entire untrimmed video sequence clip by clip in time, thereby extending the applicability of TAS methods to online scenarios. However, directly applying existing TAS methods to SATS tasks results in significantly poor segmentation outcomes. In this paper, we thoroughly analyze the fundamental differences between STAS tasks and TAS tasks, attributing the severe performance degradation when transferring models to model bias and optimization dilemmas. We introduce an end-to-end streaming video temporal action segmentation model with reinforcement learning (SVTAS-RL). The end-to-end modeling method mitigates the modeling bias introduced by the change in task nature and enhances the feasibility of online solutions. Reinforcement learning is utilized to alleviate the optimization dilemma. Through extensive experiments, the SVTAS-RL model significantly outperforms existing STAS models and achieves competitive performance to the state-of-the-art TAS model on multiple datasets under the same evaluation criteria, demonstrating notable advantages on the ultra-long video dataset EGTEA. Code is available at https://github.com/Thinksky5124/SVTAS.

cs.CV↗

arXiv2023

Vulnerable Smart Contract Function Locating Based on Multi-Relational Nested Graph Convolutional Network

The immutable and trustable characteristics of blockchain enable smart contracts to be applied in various fields. Unfortunately, smart contracts are subject to various vulnerabilities, which are frequently exploited by attackers, causing financial damage to users.In this paper, we study the problem of vulnerable smart contract function locating. We construct a novel Multi-Relational Nested contract Graph (MRNG) to better characterize the rich syntactic and semantic information in the smart contract code, including the relationships between data and instructions. An MRNG represents a smart contract, where each node represents a function in the smart contract and each edge describes the calling relationship between the functions. In addition, we create a Multi-Relational Function Graph (MRFG) for each function, which characterizes the corresponding function code. That is, each function is characterized as an MRFG, which corresponds to a node in the MRNG. Each MRFG uses different types of edges to represent the different control and data relationships between nodes within a function. We also propose a Multi-Relational Nested Graph Convolutional Network (MRN-GCN) to process the MRNG. MRN-GCN first extracts and aggregates features from each MRFG, using the edge-enhanced graph convolution network and self-attention mechanism. The extracted feature vector is then assigned to the corresponding node in the MRNG to obtain a new Featured Contract Graph (FCG) for the smart contract. Graph convolution is used to further extract features from the FCG. Finally, a feed forward network with a Sigmoid function is used to locate the vulnerable functions. Experimental results on the real-world smart contract datasets show that model MRN-GCN can effectively improve the accuracy, precision, recall and F1-score performance of vulnerable smart contract function locating.

cs.CR↗

arXiv2022

Artificial Intelligence Security Competition (AISC)

The security of artificial intelligence (AI) is an important research area towards safe, reliable, and trustworthy AI systems. To accelerate the research on AI security, the Artificial Intelligence Security Competition (AISC) was organized by the Zhongguancun Laboratory, China Industrial Control Systems Cyber Emergency Response Team, Institute for Artificial Intelligence, Tsinghua University, and RealAI as part of the Zhongguancun International Frontier Technology Innovation Competition (https://www.zgc-aisc.com/en). The competition consists of three tracks, including Deepfake Security Competition, Autonomous Driving Security Competition, and Face Recognition Security Competition. This report will introduce the competition rules of these three tracks and the solutions of top-ranking teams in each track.

cs.CR↗

arXiv2022

Streaming Video Temporal Action Segmentation In Real Time

Temporal action segmentation (TAS) is a critical step toward long-term video understanding. Recent studies follow a pattern that builds models based on features instead of raw video picture information. However, we claim those models are trained complicatedly and limit application scenarios. It is hard for them to segment human actions of video in real time because they must work after the full video features are extracted. As the real-time action segmentation task is different from TAS task, we define it as streaming video real-time temporal action segmentation (SVTAS) task. In this paper, we propose a real-time end-to-end multi-modality model for SVTAS task. More specifically, under the circumstances that we cannot get any future information, we segment the current human action of streaming video chunk in real time. Furthermore, the model we propose combines the last steaming video chunk feature extracted by language model with the current image feature extracted by image model to improve the quantity of real-time temporal action segmentation. To the best of our knowledge, it is the first multi-modality real-time temporal action segmentation model. Under the same evaluation criteria as full video temporal action segmentation, our model segments human action in real time with less than 40% of state-of-the-art model computation and achieves 90% of the accuracy of the full video state-of-the-art model.

cs.CV↗

arXiv2021

High-responsivity, High-detectivity Photomultiplication Organic Photodetector Realized by a Metal-Insulator-Semiconductor Tunneling Junction

Organic photodetectors (OPDs) possess bright prospects in applications of medical imaging and wearable electronics due to the advantages such as low cost, good biocompatibility, and good flexibility. Photomultiplication OPDs (PM-OPDs) enabled by the trap-assisted carrier tunneling injection effect exhibit external quantum efficiencies far greater than unity, thus the acquired responsivities are extremely high. However, the reported PM-OPDs with high responsivity performances are all accompanied by high dark currents due to the introduction of carrier traps, which inevitably results in inferior detectivities. In this work, we modify a P3HT:PCBM donor-rich PM-OPD by introducing an atomically thin Al2O3 interfacial layer through the ALD technique, obtaining a high responsivity of 8294 A/W and high detectivity of 6.76*10^14 Jones, simultaneously, both of which are among the highest reported for bulk heterojunction PM-OPDs. Ascribed to the introduction of the atomically thin Al2O3 layer, the metal-insulator-semiconductor (MIS) tunneling junction is formed, which brings forward a suppressed dark current along with an increased amounts of holes tunneling under forward bias. Meanwhile, the weak light detection limit of the modified PM-OPD within the linear response range reaches the level of nW/cm2. Based on the proposed PM-OPD, a proof-of-concept image sensor with 26*26 pixels is demonstrated, which can respond to both ultraviolet light and visible light. The PM-OPD based sensor arrays can find broad applications for medical imaging, wearable electronics, etc.

physics.app-ph↗

arXiv2021

A unified framework based on graph consensus term for multi-view learning

In recent years, multi-view learning technologies for various applications have attracted a surge of interest. Due to more compatible and complementary information from multiple views, existing multi-view methods could achieve more promising performance than conventional single-view methods in most situations. However, there are still no sufficient researches on the unified framework in existing multi-view works. Meanwhile, how to efficiently integrate multi-view information is still full of challenges. In this paper, we propose a novel multi-view learning framework, which aims to leverage most existing graph embedding works into a unified formula via introducing the graph consensus term. In particular, our method explores the graph structure in each view independently to preserve the diversity property of graph embedding methods. Meanwhile, we choose heterogeneous graphs to construct the graph consensus term to explore the correlations among multiple views jointly. To this end, the diversity and complementary information among different views could be simultaneously considered. Furthermore, the proposed framework is utilized to implement the multi-view extension of Locality Linear Embedding, named Multi-view Locality Linear Embedding (MvLLE), which could be efficiently solved by applying the alternating optimization strategy. Empirical validations conducted on six benchmark datasets can show the effectiveness of our proposed method.

cs.LG↗

arXiv2021

Deep graph convolution neural network with non-negative matrix factorization for community discovery

Community discovery is an important task for graph mining. Owing to the nonstructure, the high dimensionality, and the sparsity of graph data, it is not easy to obtain an appropriate community partition. In this paper, a deep graph convolution neural network with non-negative matrix factorization (DGCN-NMF) is proposed for community discovery. DGCN-NMF employs multiple graph convolution layers to obtain the low dimensional embedding. In each layer, the last output and the non-negative matrix factorization's results of the previous outputs are inputted into the current layer. The community partition of the inputted graph can be outputted by an end-to-end approach. The proposed algorithm and the comparison algorithms are conducted on the experimental data sets. The experimental results show that the proposed algorithm outperforms the comparison algorithms on the experimental data sets. The experimental results demonstrate that DGCN-NMF is an effective algorithm for community discovery.

cs.SI↗

arXiv2021

Self-Supervised Deep Graph Embedding with High-Order Information Fusion for Community Discovery

Deep graph embedding is an important approach for community discovery. Deep graph neural network with self-supervised mechanism can obtain the low-dimensional embedding vectors of nodes from unlabeled and unstructured graph data. The high-order information of graph can provide more abundant structure information for the representation learning of nodes. However, most self-supervised graph neural networks only use adjacency matrix as the input topology information of graph and cannot obtain too high-order information since the number of layers of graph neural network is fairly limited. If there are too many layers, the phenomenon of over smoothing will appear. Therefore how to obtain and fuse high-order information of graph by a shallow graph neural network is an important problem. In this paper, a deep graph embedding algorithm with self-supervised mechanism for community discovery is proposed. The proposed algorithm uses self-supervised mechanism and different high-order information of graph to train multiple deep graph convolution neural networks. The outputs of multiple graph convolution neural networks are fused to extract the representations of nodes which include the attribute and structure information of a graph. In addition, data augmentation and negative sampling are introduced into the training process to facilitate the improvement of embedding result. The proposed algorithm and the comparison algorithms are conducted on the five experimental data sets. The experimental results show that the proposed algorithm outperforms the comparison algorithms on the most experimental data sets. The experimental results demonstrate that the proposed algorithm is an effective algorithm for community discovery.

cs.SI↗

arXiv2021

Multimodal-Aware Weakly Supervised Metric Learning with Self-weighting Triplet Loss

In recent years, we have witnessed a surge of interests in learning a suitable distance metric from weakly supervised data. Most existing methods aim to pull all the similar samples closer while push the dissimilar ones as far as possible. However, when some classes of the dataset exhibit multimodal distribution, these goals conflict and thus can hardly be concurrently satisfied. Additionally, to ensure a valid metric, many methods require a repeated eigenvalue decomposition process, which is expensive and numerically unstable. Therefore, how to learn an appropriate distance metric from weakly supervised data remains an open but challenging problem. To address this issue, in this paper, we propose a novel weakly supervised metric learning algorithm, named MultimoDal Aware weakly supervised Metric Learning (MDaML). MDaML partitions the data space into several clusters and allocates the local cluster centers and weight for each sample. Then, combining it with the weighted triplet loss can further enhance the local separability, which encourages the local dissimilar samples to keep a large distance from the local similar samples. Meanwhile, MDaML casts the metric learning problem into an unconstrained optimization on the SPD manifold, which can be efficiently solved by Riemannian Conjugate Gradient Descent (RCGD). Extensive experiments conducted on 13 datasets validate the superiority of the proposed MDaML.

cs.LG↗

arXiv2020

Multi-view Low-rank Preserving Embedding: A Novel Method for Multi-view Representation

In recent years, we have witnessed a surge of interest in multi-view representation learning, which is concerned with the problem of learning representations of multi-view data. When facing multiple views that are highly related but sightly different from each other, most of existing multi-view methods might fail to fully integrate multi-view information. Besides, correlations between features from multiple views always vary seriously, which makes multi-view representation challenging. Therefore, how to learn appropriate embedding from multi-view information is still an open problem but challenging. To handle this issue, this paper proposes a novel multi-view learning method, named Multi-view Low-rank Preserving Embedding (MvLPE). It integrates different views into one centroid view by minimizing the disagreement term, based on distance or similarity matrix among instances, between the centroid view and each view meanwhile maintaining low-rank reconstruction relations among samples for each view, which could make more full use of compatible and complementary information from multi-view features. Unlike existing methods with additive parameters, the proposed method could automatically allocate a suitable weight for each view in multi-view information fusion. However, MvLPE couldn't be directly solved, which makes the proposed MvLPE difficult to obtain an analytic solution. To this end, we approximate this solution based on stationary hypothesis and normalization post-processing to efficiently obtain the optimal solution. Furthermore, an iterative alternating strategy is provided to solve this multi-view representation problem. The experiments on six benchmark datasets demonstrate that the proposed method outperforms its counterparts while achieving very competitive performance.

cs.LG↗