arXiv ScienceSearch

arXiv · 2506.07188

Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networks

Abstract

End-to-end neural networks have become a dominant paradigm in autonomous driving, where reliable deployment requires controllable post-training adaptation and improved transparency of model updates. In this paper, we propose Feature-level Reverse Propagation for Post-Training (FR-PT), a hierarchical framework that provides explicit intermediate supervision for upstream modules by reconstructing label-conditioned features backward through frozen downstream networks. For the first time, we formulate feature reconstruction via the Computation Consistency Principle (CCP) and Minimum Deviation Principle (MDP), and develop efficient operator-specific reverse computation algorithms with MDP-centered Tikhonov regularization to handle numerically unstable inverse problems. Specifically, FR-PT incorporates circular convolution theorem-based solvers for scalable convolutional reconstruction, nearest embedding for constructing continuous output targets from categorical labels, and iterative reverse propagation for composite residual and Transformer-style blocks. Extensive experiments on image classification and autonomous driving tasks demonstrate effective and stable adaptation across diverse architectures. Among 85 post-training settings, FR-PT achieves statistically significant improvements over task-level baselines in 63 cases, while the matched backpropagation reference outperforms reconstruction-supervised configurations in only 4 cases. Additional efficiency, conditioning, and favorable-condition analyses characterize the reliability and limitations of reconstructed targets, while feature-response analyses further demonstrate their diagnostic value. Code is available at https://github.com/Dingni2000/FR-PT .

Explore related subjects

Keep this discovery

BibTeXRIS

Ni Ding, Shuchang Wang, Lei He, Shengbo Eben Li, Keqiang Li. 2026-08-28. Hierarchical Feature-level Reverse Propagation for Post-Training Neural Networks. https://arxiv.org/abs/2506.07188

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related papers

Stochastic Optimization of Tree Tensor Networks

Tensor networks, originally developed for quantum many-body physics, are promising models for machine learning. We derive stochastic Riemannian optimizers for tree tensor networks (TTNs) on both their parameter and quotient manifolds, including adaptive and learning-rate-free schemes suitable for minibatch training. Using a hybrid CNN-TTN architecture, we evaluate the methods on Fashion-MNIST, CIFAR10, and Imagenette. The proposed optimizers achieve predictive performance comparable to unconstrained optimization while enabling numerically stable downstream compression.

math.OC

Can We Change the Stroke Size for Easier Diffusion?

Diffusion models can be challenged in the low signal-to-noise regime, where they have to make pixel-level predictions despite the presence of high noise. The geometric intuition is akin to using the finest stroke for oil painting throughout, which may be ineffective. We therefore study \emph{stroke-size control} as a controlled intervention that changes the roughness of the supervised target, predictions and perturbations across timesteps, in an attempt to ease the low signal-to-noise challenge via the prediction target simplification.

cs.CV

Texture Image Classification Using DWT AlexNet Feature Fusion and Deep Neural Networks

Texture image classification plays a significant role in computer vision applications, including industrial inspection, medical image analysis, remote sensing, and object recognition. Handcrafted features can capture local texture characteristics but may have limited capability to represent complex visual patterns. In contrast, deep learning models automatically learn discriminative representations but may not fully exploit the multiscale spatial-frequency information inherent in texture images. This paper proposes a hybrid feature fusion framework, termed DWT_AlexNet_DNN, which combines Discrete Wavelet Transform (DWT) features with deep features extracted using AlexNet for texture image classification.

cs.CV