arXiv ScienceSearch

arXiv subjects

Anis Hamadouche

Publications and source records attributed to Anis Hamadouche.

15 recordsLinked to original sources

Lyapunov-Guided Training for Hardware-Safe Neural Networks Under Fixed-Point Arithmetic

Low-precision neural networks are attractive for resource-constrained hardware, but fixed-point arithmetic introduces failure modes that are often hidden by idealised quantisation models. In particular, two's-complement overflow wrapping can corrupt hidden activations by changing both their magnitude and sign, leading to unstable numerical error propagation and severe accuracy degradation. This paper proposes a Lyapunov-stabilised quantisation framework for low-precision neural networks operating under hardware-style wrapping arithmetic. The hidden-state energy is monitored through a layerwise Lyapunov function, and a monotone projection is applied to enforce bounded and non-increasing state evolution across depth. The method is evaluated on MNIST using a compact patch-based transformer under post-training quantisation and quantisation-aware training with fixed-point bit-widths from 4 to 16 bits. Monte Carlo results show that unconstrained wrapped quantisation-aware training collapses to near-chance accuracy across 6-16 bits, with activation overflow rates exceeding 11%. In contrast, the proposed monotone Lyapunov projection suppresses activation overflow to below 0.012% and restores stable low-precision learning, achieving 86.55% accuracy at 12 bits. These results demonstrate that Lyapunov-based state control can act as a hardware-aware stabilisation mechanism for reliable fixed-point neural inference and training.

cs.LG

Empirical Minimal-Realisation Compression of Deep Neural Networks via Controllability-Observability Tests

Deep neural networks often contain substantial hidden-state redundancy, but most compression methods operate directly on weights, neurons, or quantised representations without explicitly characterising the dynamical role of internal states. This paper proposes a controllability-observability framework for empirical state-order reduction of deep neural networks. By viewing a trained network as a depth-indexed nonlinear dynamical system, we construct data-driven reachability, observability, and balanced Gramians from hidden-state snapshots and output Jacobians. The resulting A/B/C tests estimate layer-wise reachable, observable, and jointly reachable--observable ranks. These ranks are then used not only as diagnostic measures of hidden-state redundancy, but also as actual compressed layer widths for realised reduced networks. Experiments on MNIST and CIFAR-10 compare the proposed balanced realisation against projection-based reduction, unstructured pruning, structured pruning, low-rank SVD, dynamic INT8 quantisation, and linear baselines. On MNIST, a four-layer SiLU DNN is reduced from state order 1024 to 277, giving 72.95% state compression and 73.48% parameter compression, while maintaining 95.45% accuracy compared with 96.60% for the full model. On CIFAR-10, a larger SiLU DNN is reduced from state order 4608 to 1339, giving 70.94% state compression and 83.09% parameter compression, while preserving accuracy from 54.45% to 54.44% and reducing CUDA inference latency by approximately 3X. The results show that balanced reachable-observable ranks provide a principled empirical minimal-realisation criterion for designing compact neural architectures with little or no loss in accuracy.

cs.LG

Stochastic Delayed Dynamics of Rumor Propagation with Awareness and Fact-Checking

This paper presents a stochastic delayed differential model for rumor propagation during infodemic that incorporates human behavioral response, public skepticism and fact-checking mechanisms. A discrete time delay is introduced to model natural lags in information processing and institutional response. Additionally, we adopt additive stochastic perturbations to model random fluctuations in social interaction and exposure. We present a rigorous stability analysis of the proposed rumor transmission model and derive convergence guarantees under reproduction number conditions. We also validate the model by numerical simulations and analyze the outbreak severity and quantify uncertainty under variable information processing delays. The results highlight the importance of timely awareness and fact-checking interventions for mitigating misinformation spread during pandemics

eess.SY

Leveraging Kernel Symmetry for Joint Compression and Error Mitigation in Edge Model Transfer

This paper investigates communication-efficient neural network transmission by exploiting structured symmetry constraints in convolutional kernels. Instead of transmitting all model parameters, we propose a degrees-of-freedom (DoF) based codec that sends only the unique coefficients implied by a chosen symmetry group, enabling deterministic reconstruction of the full weight tensor at the receiver. The proposed framework is evaluated under quantization and noisy channel conditions across multiple symmetry patterns, signal-to-noise ratios, and bit-widths. To improve robustness against transmission impairments, a projection step is further applied at the receiver to enforce consistency with the symmetry-invariant subspace, effectively denoising corrupted parameters. Experimental results on MNIST and CIFAR-10 using a DeepCNN architecture demonstrate that DoF-based transmission achieves substantial bandwidth reduction while preserving significantly higher accuracy than pruning-based baselines, which often suffer catastrophic degradation. Among the tested symmetries, \textit{central-skew symmetry} consistently provides the best accuracy-compression tradeoff, confirming that structured redundancy can be leveraged for reliable and efficient neural model delivery over constrained links.

eess.SP

Audio-Visual Speech Enhancement: Architectural Design and Deployment Strategies

Real-time audio-visual speech enhancement (AVSE) is a key enabler for immersive and interactive multimedia services, yet its performance is tightly constrained by network latency, uplink capacity, and computational delay. This paper presents the design, deployment, and evaluation of a complete cloud-edge-assisted AVSE system operating over a public 5G edge network. The system integrates CNN-based acoustic enhancement and OpenCV-based facial feature extraction with an LSTM fusion network to preserve temporal coherence, and is deployed on a Vodafone-compatible AWS Wavelength edge cloud. Through extensive stress testing, we analyze end-to-end performance under varying network load and adaptive multimedia profiles. Results show that compute placement at the network edge is critical for meeting real-time coherence constraints, and that uplink capacity is often the dominant bottleneck for interactive AVSE services. Only 5G and wired Ethernet consistently satisfied the required communication delay bound for uncompressed audio-video chunks, while aggressive compression reduced payload sizes by up to 80% with negligible perceptual degradation, enabling robust operation under constrained conditions. We further demonstrate a fundamental trade-off between processing latency and enhancement quality, where reduced model complexity lowers delay but degrades reconstruction performance in low-SNR scenarios. Our findings indicate that public 5G edge environments can sustain real-time, interactive AVSE workloads when network and compute resources are carefully orchestrated, although performance margins remain tighter than in dedicated infrastructures. The architectural insights derived from this study provide practical guidelines for the design of delay-sensitive multimedia and perceptual enhancement services on emerging 5G edge-cloud platforms.

cs.SD

Antenna Health-Aware Selective Beamforming for Hardware-Constrained DFRC Systems I

This paper addresses the optimization challenges in dual-functional radar-communication (DFRC) systems with a focus on array selection and beamforming in dynamic and heterogeneous operational contexts. We propose a novel array selection criterion that integrates antenna health information into the optimization process, distinguishing our approach from traditional methods. Our methodology employs gradient dual ascent and dual proximal-gradient ascent for tackling the constrained non-convex and non-smooth nature of sparse array selection problems. A key feature of our strategy is the implementation of proportional fairness among communication users, which aligns with system resource limitations while meeting the minimum rate requirements for all users. This facet of our method not only enhances system efficiency and responsiveness but also ensures a fair distribution of resources. Through extensive simulations, the efficacy of the proposed solutions in optimizing DFRC system performance is validated, illustrating their applicability in integrated sensing and communication (ISAC) scenarios. Our findings contribute to the evolving field of DFRC systems, offering new perspectives and solutions for the challenges in array selection and beamforming optimisation.

eess.SP

Antenna Health-Aware Selective Beamforming for Hardware-Constrained DFRC Systems II

This study introduces an innovative beamforming design approach that incorporates the reliability of antenna array elements into the optimization process, termed "antenna health-aware selective beamforming". This method strategically focuses transmission power on more reliable antenna elements, thus enhancing system resilience and operational integrity. By integrating antenna health information and individual power constraints, our research leverages advanced optimization techniques such as the Group Proximal-Gradient Dual Ascent (GPGDA) to efficiently address nonconvex challenges in sparse array selection. Applying the proposed technique to a Dual-Functional Radar-Communication (DFRC) system, our findings highlight that increasing the sparsity promotion weight ($\rho_s$) generally boosts spectral efficiency and communication data rate, achieving perfect system reliability at higher $\rho_s$ values but also revealing a performance threshold beyond which further sparsity is detrimental. This underscores the importance of balanced sparsity in beamforming for optimizing performance, particularly in critical communication and defense applications where uninterrupted operation is crucial. Additionally, our analysis of the time complexity and power consumption associated with GPGDA underscores the need for optimizing computational resources in practical implementations.

eess.SP

Efficient Dual-Blind Deconvolution for Joint Radar-Communication Systems Using ADMM: Enhancing Channel Estimation and Signal Recovery in 5G mmWave Networks

This paper introduces a novel framework for jointly estimating unknown radar channels and transmit signals in millimeter-wave (mmWave) Joint Radar-Communication (JRC) systems, a problem often referred to as dual-blind deconvolution. The proposed method employs the Alternating Direction Method of Multipliers (ADMM) to iteratively refine the radar channel G (or H) and the transmitted signal X under convex constraints, incorporating both smooth and non-smooth penalty terms via proximal operators. By enforcing a bounded perturbation model for the radar channel and a strict transmit power budget, the algorithm aligns well with practical hardware limits. Extensive simulations demonstrate that the proposed approach reliably addresses the dual-blind deconvolution challenge, resulting in effective radar channel estimation and robust communication performance. Notably, the framework's iterative structure readily accommodates hardware considerations and different system configurations, making it well-suited for emerging mmWave JRC scenarios. Its adaptability and computational efficiency highlight the potential for wider adoption in next-generation wireless networks, where radar detection and communications increasingly share bandwidth and hardware resources.

eess.SP

Context-Enhanced CSI Tracking Using Koopman-Inspired Dual Autoencoders in Dynamic Wireless Environments

This paper introduces a novel framework for tracking and predicting Channel State Information (CSI) by leveraging Physics-Informed Autoencoders (PIAE) integrated with a learned Koopman operator. The proposed approach models CSI as a nonlinear dynamical system governed by both intrinsic channel behavior and exogenous contextual factors such as position, temperature, and atmospheric conditions. The architecture comprises dual autoencoders-one dedicated to CSI and another to contextual inputs-linked via a shared latent state space, within which the Koopman operator captures the linear temporal evolution of CSI dynamics. This coupling enables accurate, data-driven forecasting of CSI trajectories while maintaining interpretability through a structured, physics-consistent representation. The framework supports real-time updates to the Channel Knowledge Map (CKM), enhancing the adaptability and reliability of communication systems in complex and time-varying environments. By unifying Koopman theory with learned latent representations, the proposed method provides a scalable and privacy-preserving solution for next-generation wireless networks. Empirical results demonstrate its effectiveness in delivering high-fidelity CSI predictions under diverse channel conditions.

eess.SP

Trade-offs in Reliability and Performance Using Selective Beamforming for Ultra-Massive MIMO

This paper addresses the optimization challenges in Ultra-Massive MIMO communication systems, focusing on array selection and beamforming in dynamic and diverse operational contexts. We introduce a novel array selection criterion that incorporates antenna health information into the optimization process, distinguishing our approach from traditional methods. Our methodology employs dual proximal-gradient ascent to effectively tackle the constrained non-convex and non-smooth nature of sparse array selection problems. A central feature of our strategy is the implementation of proportional fairness among communication users, aligning with system resource limitations while ensuring minimum rate requirements for all users. This approach not only enhances system efficiency and responsiveness but also ensures equitable resource distribution. Extensive simulations validate the effectiveness of the proposed solutions in optimizing Ultra-Massive MIMO system performance, demonstrating their applicability in complex communication scenarios. Our findings reveal key trade-offs influenced by the sparsity promotion weight (\(\gamma\)). As \(\gamma\) increases, spectral efficiency (SE) and communication rate (Ri) decrease, while beamforming matrix density (BMD) reduces and antenna reliability (RL) significantly improves. These results highlight the critical balance between performance and reliability, essential for the practical deployment of Ultra-Massive MIMO systems. This work advances the field by providing innovative solutions and new insights into array selection and beamforming optimization, setting a foundation for future research in Ultra-Massive MIMO communication systems.

eess.SP

Reconfigurable FPGA-Based Solvers For Sparse Satellite Control

This paper introduces a novel reconfigurable and power-efficient FPGA (Field-Programmable Gate Array) implementation of an operator splitting algorithm for Non-Terrestial Network's (NTN) relay satellites model predictive orientation control (MPC). Our approach ensures system stability and introduces an innovative reconfigurable bit-width FPGA-based optimization solver. To demonstrate its efficacy, we employ a real FPGA-In-the-Loop hardware setup to control simulated satellite dynamics. Furthermore, we conduct an in-depth comparative analysis, examining various fixed-point configurations to evaluate the combined system's closed-loop performance and power efficiency, providing a holistic understanding of the proposed implementation's advantages.

eess.SP

Improved Convergence Bounds For Operator Splitting Algorithms With Rare Extreme Errors

In this paper, we improve upon our previous work[24,22] and establish convergence bounds on the objective function values of approximate proximal-gradient descent (AxPGD), approximate accelerated proximal-gradient descent (AxAPGD) and approximate proximal ADMM (AxWLM-ADMM) schemes. We consider approximation errors that manifest rare extreme events and we propagate their effects through iterations. We establish probabilistic asymptotic and non-asymptotic convergence bounds as functions of the range (upper/lower bounds) and variance of approximation errors. We use the derived bound to assess AxPGD in a sparse model predictive control of a spacecraft system and compare its accuracy with previously derived bounds.

math.OC

A Low-Power Hardware-Friendly Optimisation Algorithm With Absolute Numerical Stability and Convergence Guarantees

We propose Dual-Feedback Generalized Proximal Gradient Descent (DFGPGD) as a new, hardware-friendly, operator splitting algorithm. We then establish convergence guarantees under approximate computational errors and we derive theoretical criteria for the numerical stability of DFGPGD based on absolute stability of dynamical systems. We also propose a new generalized proximal ADMM that can be used to instantiate most of existing proximal-based composite optimization solvers. We implement DFGPGD and ADMM on FPGA ZCU106 board and compare them in light of FPGA's timing as well as resource utilization and power efficiency. We also perform a full-stack, application-to-hardware, comparison between approximate versions of DFGPGD and ADMM based on dynamic power/error rate trade-off, which is a new hardware-application combined metric.

math.OC

Probabilistic Verification of Approximate Algorithms with Unstructured Errors: Application to Fully Inexact Generalized ADMM

We analyse the convergence of an approximate, fully inexact, ADMM algorithm under additive, deterministic and probabilistic error models. We consider the generalized ADMM scheme that is derived from generalized Lagrangian penalty with additive (smoothing) adaptive-metric quadratic proximal perturbations. We derive explicit deterministic and probabilistic convergence upper bounds for the lower-C2 nonconvex case as well as the convex case under the Lipschitz continuity condition. We also present more practical conditions on the proximal errors under which convergence of the approximate ADMM to a suboptimal solution is guaranteed with high probability. We consider statistically and dynamically-unstructured conditional mean independent bounded error sequences. We validate our results using both simulated and practical software and algorithmic computational perturbations. We apply the proposed algorithm to a synthetic LASSO and robust regression with k-support norm regularization problems and test our proposed bounds under different computational noise levels. Compared to classical convergence results, the adaptive probabilistic bounds are more accurate in predicting the distance from the optimal set and parasitic residual error under different sources of inaccuracies.

math.OC

Sharper Bounds for Proximal Gradient Algorithms with Errors

We analyse the convergence of the proximal gradient algorithm for convex composite problems in the presence of gradient and proximal computational inaccuracies. We derive new tighter deterministic and probabilistic bounds that we use to verify a simulated (MPC) and a synthetic (LASSO) optimization problems solved on a reduced-precision machine in combination with an inaccurate proximal operator. We also show how the probabilistic bounds are more robust for algorithm verification and more accurate for application performance guarantees. Under some statistical assumptions, we also prove that some cumulative error terms follow a martingale property. And conforming to observations, e.g., in \cite{schmidt2011convergence}, we also show how the acceleration of the algorithm amplifies the gradient and proximal computational errors.

math.OC