arXiv ScienceSearch

arXiv subjects

Mohamed Akrout

Publications and source records attributed to Mohamed Akrout.

At least 19 recordsLinked to original sources

Finite-SNR Closed Form for the Square Marčenko-Pastur MIMO Capacity

For the canonical independent and identically distributed (IID) single-user multiple-input multiple-output (MIMO) channel with full channel state information at the transmitter (CSIT), the asymptotic capacity per receive antenna is a waterfilling integral over the Marčenko-Pastur law, whose shape depends only on the ratio of transmit to receive antennas. Closed forms are known for every ratio other than the square one, and there only above a finite signal-to-noise ratio (SNR). The square ratio behaves differently because the Marčenko-Pastur support reaches the origin. The waterfilling cutoff then stays strictly inside the support at every finite SNR, and the water level has been available only numerically. This letter closes that gap with a classical trigonometric parametrization of the square law, which removes the edge singularity and replaces the moving cutoff by a single angle. Both the SNR and the capacity become explicit functions of that angle, so the capacity curve is traced by sweeping the angle rather than by solving a scalar constraint at each operating point. The same parametrization delivers the low-SNR behavior in closed form, where the slope of capacity in SNR equals the upper edge of the limiting spectrum.

cs.IT

Bulbul: A Dataset for Dialectal Arabic Speech Recognition

Arabic automatic speech recognition (ASR) faces unique challenges due to diglossia, extensive regional dialect variation, and limited speech resources. Existing speech datasets often focus on single dialects or large-scale broadcast/web data, leading to trade-offs between linguistic diversity and annotation quality. We present BULBUL, a multi-dialect Arabic ASR dataset collected from 275 speakers in 11 Arab countries. BULBUL includes structured dialect and sub-dialect coverage, as well as recordings of classical Arabic and modern standard Arabic spoken by participants in their native dialectal accents to support accent-aware modeling. The quality of the recordings was ensured through a two-level human verification process. We further benchmark a range of recent ASR systems, establishing strong baselines for modern dialectal and accented Arabic ASR.

cs.CL

Enforcing LLM Safety through DMD-based Classification of Prompt-Response Embedding Dynamics

Large Language Models (LLMs) are increasingly deployed in high-stakes applications, yet their tendency to generate toxic, harmful, or policy-violating content poses significant risks. Detecting these unsafe outputs efficiently in a black-box manner remains an open challenge. In this paper, we extend a recently proposed dynamical systems framework designed for hallucination detection to LLM safety classification. By projecting both prompts and responses into high-dimensional embedding spaces and fitting separate Koopman-based predictive models for safe and unsafe regimes, we classify new outputs using a new differential residual score that compares prediction errors of the safe and unsafe regimes. A key contribution is the incorporation of the prompt and response embedding dynamics, yielding fitted Koopman operators that capture crucial interaction patterns. We evaluate our black-box method across three safety benchmarks using three embedding models. Our results show that incorporating prompt embeddings yields consistent improvements, particularly for interaction-dependent violations when paired with causal decoders (e.g., in Llama-3), while response-only violations benefit more from dense semantic embedding representations. These findings opens the door for using dynamical systems to analyze AI systems rather than the dominant paradigm of using AI to model dynamical systems.

cs.AI

Optimality of Bang-Bang Switching for Breaking the Chu Limit via Time-Modulated Matching

This paper shows that surpassing the Chu limit on $Q$-factors via time-modulated matching requires non-smooth switching strategies. We derive a nonlinear differential condition to show that differentiable modulation functions are sub-optimal, then show that the optimal switching trajectory for maximizing the violation of the Chu limit is a piecewise-constant (Bang-Bang) profile. Finally, we establish an upper-bound connecting the antenna size, switching speed, and bit error rate, which reveals that switching time becomes longer as antennas become electrically smaller.

cs.IT

Guarantees on Dynamical System Distinguishability for LLM Token Generation

Recent work has shown that classifying large language models (LLMs)' responses can be distinguished by modeling token embeddings as trajectories of a black-box dynamical system (DS) and comparing prediction residuals of two DSs. Despite the empirical success of this dynamical approach, a theoretical understanding of why it works, how well it scales as a function of the token sequence, and when it transfers across embedding models remains lacking. We address these questions by formalizing the classification task as a binary hypothesis test between two stochastic linear DSs. We show that the total variation distance between the stationary marginal distributions of the two DSs can be arbitrarily small even when the dynamics differ substantially, which provides a fundamental accuracy floor for any classifier that ignores token dynamics. We then show that the misclassification probability of DS-based classification decays exponentially in the sequence length $L$, with the decay governed by a dynamical discriminability quantity $δ^2$ that captures the spectral distance between the two DSs. We also characterize cross-embedding generalization by introducing an approximate intertwining condition between embedding models and establishing a lower bound on the transferable discriminability in terms of the intertwining map's smallest singular value. Together, these results explain the empirical performance of DS-based classification and motivate further investigation into using DS theory to analyze AI systems, in contrast to the more common approach of using AI to model dynamical systems.

cs.LG

Information Rates of Approximate Message Passing for Bandlimited Direct-Detection Channels

The capacity of bandlimited direct-detection channels is challenging to compute or approach due to the receiver non-linearity. A generalized vector approximate message passing (GVAMP) detector is designed to achieve high rates at a reasonable level of complexity. The rates increase by using multi-level coding and successive interference cancellation. The methods are applied to fiber-optic channels with intersymbol interference caused by spectrally efficient pulse shapes, chromatic dispersion, and receiver sampling at twice the baud rate. Bipolar modulation operates within 0.26 bits per channel use (bpcu) of the real-alphabet coherent capacity for optically amplified links, reducing the best-known theoretical gap of 1 bpcu. Remarkably, bipolar modulation achieves 6 dB and 3 dB of power gain over unipolar modulation with and without optical amplification, respectively. Simulations with polar-coded modulation confirm the gains. The GVAMP complexity, measured in multiplications per information bit (mpib), is proportional to the number of iterations and to the logarithm of the block length, and is substantially lower than that of other equalizers. For example, a system with 64-ary bipolar modulation and a root-raised cosine pulse with a 1% roll-off factor was simulated over 4 km of optically amplified standard single-mode fiber in the C-band. The GVAMP receiver requires 93 mpib to achieve 5 bpcu at 300 gigabaud.

cs.IT

Time-varying Wireless Channel Tracking with Online Parameter Learning via the Birth-Death-Drift Model

Accurate massive MIMO channel state information (CSI) acquisition with low pilot overhead is critical in dynamic propagation environments. Exploiting temporal correlation is key to reducing pilot overhead, yet most existing methods often rely on impractical assumptions. The approximate message passing with side information (AMP-SI) algorithm, built upon a birth-death-drift (BDD) model, represents a significant step in this direction. However, its practical deployment is hindered by three major limitations: reliance on i.i.d. Gaussian sensing matrices, need for perfect BDD parameter knowledge, and a statistically approximate treatment of temporal information. To address these limitations, we introduce BDD-VAMP-EM, a fully automated algorithm that relies on the BDD model, vector AMP (VAMP), and expectation-maximization (EM) in a unified framework. Simulations show that BDD-VAMP-EM consistently outperforms existing benchmarks, particularly under model parameter mismatch, confirming its practical viability.

cs.IT

Low-Cost Black-Box Detection of LLM Hallucinations via Dynamical System Prediction

Large Language Models (LLMs) frequently generate plausible but non-factual content, a phenomenon known as hallucination. While existing detection methods typically rely on computationally expensive sampling-based consistency checks or external knowledge retrieval, we propose a new method that treats the LLM as a black-box dynamical system. By projecting LLM responses into a high-dimensional manifold via an embedding model, we characterize the resulting vector sequences as observable realizations of the model's latent state-space dynamics. Leveraging Koopman operator theory, we fit the transition operators for both factual and hallucinated regimes and define a differential residual score based on their respective prediction errors. To accommodate varying user requirements and domain-specific sensitivities, we introduce a preference-aware calibration mechanism that optimizes the classification threshold based on a small set of demonstrations. This approach enables low-cost hallucination detection in a single-sample pass, avoiding the need for secondary sampling or external grounding. Extensive testing across three data benchmarks demonstrates that our method achieves state-of-the-art performance with reduced resource overhead.

cs.LG

Signal Processing Foundations of Reconfigurable Antennas in the Tri-Hybrid MIMO Architecture

To enable larger apertures in multipleinput multipleoutput MIMO systems the trihybrid MIMO architecture offers a promising lowcost and lowpower solution by introducing reconfigurable antennas as a third layer of precoding on top of conventional digital and analog processing In this paper we develop a unified signal processing framework for trihybrid MIMO that explicitly captures the electromagnetic EM characteristics of diverse reconfigurable antenna technologies We first propose a generic inputoutput model that incorporates the reconfigurable antenna layer into an effective channel representation revealing a fundamental coupling between the channel precoder and radiated power Building on this model we formulate a general optimization problem that jointly accounts for digital analog and antennadomain precoding under hardware and power constraints We then instantiate this framework across seven representative reconfigurable antenna architectures including parasitic arrays dynamic metasurface antennas fluidpixel antennas polarizationreconfigurable antennas stacked intelligent metasurfaces pinching antenna systems and nonradiating wires To systematically compare these heterogeneous architectures we introduce a new metric the reconfigurability efficiency factor REF which quantifies the performance gains achievable through antenna reconfiguration under realistic constraints Numerical results demonstrate the tradeoffs among aperture size power consumption hardware complexity and spectral efficiency Our results establish that EMlevel reconfiguration reshapes the signal processing design space highlighting the need for new architectures and algorithms that jointly optimize across digital analog and electromagnetic domains This work reveals that electromagnetic reconfiguration couples the channel and precoder

eess.SP

Power Amplifier-aware Power Allocation for Noise-limited and Distortion-limited Regimes

The conventional power allocation strategy via water-filling relies on the premise that the power amplifier (PA) operates sufficiently below saturation such that a linear RF chain model holds. This work integrates the PA nonlinearity directly into the power allocation formulation, thereby removing the linearity assumption altogether and enabling operation in regimes where distortion noise is non-negligible. Leveraging the Bussgang theorem, we establish a statistical linearization of the PA's hard-limiting model to characterize the trade-off between signal gain and power-dependent distortion. We propose a projected gradient descent algorithm that optimizes power allocation while identifying an optimal spatial back-off strategy. We also derive a closed-form thermal noise variance threshold that separates the noise-limited and distortion-limited operating regimes as a function of the distortion noise variance and the channel Frobenius norm. Numerical simulations validate that our amplifier-aware strategy provides significant capacity gains in the saturation regime compared to standard water-filling.

cs.IT

Uncertainty Quantification in Data-Driven Dynamical Models via Inverse Problem Solving

Data-driven model identification strategies can be used to obtain phenomenological models that capture the temporal evolution of observable data. While it is usually straightforward to obtain such a model from time series data, for instance with least-squares fitting, it is generally difficult to quantify the uncertainty associated with the prediction of the temporal evolution of the observables. This paper considers a general framework for uncertainty quantification in data-driven dynamical models by framing prediction error through the lens of inverse problem theory. Building on Koopman-inspired model identification strategies that are suited for nonlinear dynamical models, we consider a prediction as an approximate measurement from which the original input state can be faithfully recovered, and define the prediction error as the MSE of solving the inverse problem that would yield this prediction. We demonstrate the efficacy of this approach on both numerical models and experimental data showing that it provides a robust uncertainty measure of model performance.

math.DS

Guided Wireless Technology for Near-Field Communication

Guided wireless technology is an innovative approach that combines the strengths of guided waves and wireless communication. In traditional wireless systems, signals propagate through the air, where they are vulnerable to interference, attenuation, and jamming. Guided communication, in contrast, confines signals within a physical medium, significantly reducing interference and supporting higher data rates over longer distances. Guided wireless technology harnesses these benefits by creating guided wireless channels and offering a controlled pathway for electromagnetic waves. This work harnesses these benefits by focusing on the modeling of near-field communication through long connected arrays deployed in linear-cell environments. We derive a circuit model for long array as an infinitely long dipole with multiple periodic feed points before approximating it with a finite array through open circuiting. Through our simulations, we show how the standing wave phenomenon is confirmed by the oscillations in spectral efficiency. We also demonstrate the capability of the LMMSE transmit beamformer in mitigating interference and minimizing the mean square error by adaptively allocating more power to the user experiencing the most severe channel attenuation, resulting in a more balanced variation of achievable rates across users.

cs.IT

The Tri-Hybrid MIMO Architecture

We present an evolution of multiple-input multiple-output (MIMO) wireless communications known as the tri-hybrid MIMO architecture. In this framework, the traditional operations of linear precoding at the transmitter are distributed across digital beamforming, analog beamforming, and reconfigurable antennas. Compared with the hybrid MIMO architecture, which combines digital and analog beamforming, the tri-hybrid approach introduces a third layer of electromagnetic beamforming through antenna reconfigurability. This added layer offers a pathway to scale MIMO spatial dimensions, important for 6G systems operating in centimeter-wave bands, where the tension between larger bandwidths and infrastructure reuse necessitates ultra-large antenna arrays. We introduce the key features of the tri-hybrid architecture by (i)~reviewing the benefits and challenges of communicating with reconfigurable antennas, (ii)~examining tradeoffs between spectral and energy efficiency enabled by reconfigurability, and (iii)~exploring configuration challenges across the three layers. Overall, the tri-hybrid MIMO architecture offers a new approach for integrating emerging antenna technologies in the MIMO precoding framework.

cs.IT

Unlabeled Compressed Sensing from Multiple Measurement Vectors

This paper introduces an algorithmic solution to a broader class of unlabeled sensing problems with multiple measurement vectors (MMV). The goal is to recover an unknown structured signal matrix, $\mathbf{X}$, from its noisy linear observation matrix, $\mathbf{Y}$, whose rows are further randomly shuffled by an unknown permutation matrix $\mathbf{U}$. A new Bayes-optimal unlabeled compressed sensing (UCS) recovery algorithm is developed from the bilinear approximate message passing (Bi-VAMP) framework using non-separable and coupled priors on the rows and columns of the permutation matrix $\mathbf{U}$. In particular, standard unlabeled sensing is a special case of the proposed framework, and UCS further generalizes it by neither assuming a partially shuffled signal matrix $\mathbf{X}$ nor a small-sized permutation matrix $\mathbf{U}$. For the sake of theoretical performance prediction, we also conduct a state evolution (SE) analysis of the proposed algorithm and show its consistency with the asymptotic empirical mean-squared error (MSE). Numerical results demonstrate the effectiveness of the proposed UCS algorithm and its advantage over state-of-the-art baseline approaches in various applications. We also numerically examine the phase transition diagrams of UCS, thereby characterizing the detectability region as a function of the signal-to-noise ratio (SNR).

cs.IT

Next-slot OFDM-CSI Prediction: Multi-head Self-attention or State Space Model?

The ongoing fifth-generation (5G) standardization is exploring the use of deep learning (DL) methods to enhance the new radio (NR) interface. Both in academia and industry, researchers are investigating the performance and complexity of multiple DL architecture candidates for specific one-sided and two-sided use cases such as channel state estimation (CSI) feedback, CSI prediction, beam management, and positioning. In this paper, we set focus on the CSI prediction task and study the performance and generalization of the two main DL layers that are being extensively benchmarked within the DL community, namely, multi-head self-attention (MSA) and state-space model (SSM). We train and evaluate MSA and SSM layers to predict the next slot for uplink and downlink communication scenarios over urban microcell (UMi) and urban macrocell (UMa) OFDM 5G channel models. Our numerical results demonstrate that SSMs exhibit better prediction and generalization capabilities than MSAs only for SISO cases. For MIMO scenarios, however, the MSA layer outperforms the SSM one. While both layers represent potential DL architectures for future DL-enabled 5G use cases, the overall investigation of this paper favors MSAs over SSMs.

cs.IT

Vector Approximate Message Passing With Arbitrary I.I.D. Noise Priors

Approximate message passing (AMP) algorithms are devised under the Gaussianity assumption of the measurement noise vector. In this work, we relax this assumption within the vector AMP (VAMP) framework to arbitrary independent and identically distributed (i.i.d.) noise priors. We do so by rederiving the linear minimum mean square error (LMMSE) to accommodate both the noise and signal estimations within the message passing steps of VAMP. Numerical results demonstrate how our proposed algorithm handles non-Gaussian noise models as compared to VAMP. This extension to general noise priors enables the use of AMP algorithms in a wider range of engineering applications where non-Gaussian noise models are more appropriate.

cs.IT

Representations Matter: Embedding Modes of Large Language Models using Dynamic Mode Decomposition

Existing large language models (LLMs) are known for generating "hallucinated" content, namely a fabricated text of plausibly looking, yet unfounded, facts. To identify when these hallucination scenarios occur, we examine the properties of the generated text in the embedding space. Specifically, we draw inspiration from the dynamic mode decomposition (DMD) tool in analyzing the pattern evolution of text embeddings across sentences. We empirically demonstrate how the spectrum of sentence embeddings over paragraphs is constantly low-rank for the generated text, unlike that of the ground-truth text. Importantly, we find that evaluation cases having LLM hallucinations correspond to ground-truth embedding patterns with a higher number of modes being poorly approximated by the few modes associated with LLM embedding patterns. In analogy to near-field electromagnetic evanescent waves, the embedding DMD eigenmodes of the generated text with hallucinations vanishes quickly across sentences as opposed to those of the ground-truth text. This suggests that the hallucinations result from both the generation techniques and the underlying representation.

cs.CL

From Multilayer Perceptron to GPT: A Reflection on Deep Learning Research for Wireless Physical Layer

Most research studies on deep learning (DL) applied to the physical layer of wireless communication do not put forward the critical role of the accuracy-generalization trade-off in developing and evaluating practical algorithms. To highlight the disadvantage of this common practice, we revisit a data decoding example from one of the first papers introducing DL-based end-to-end wireless communication systems to the research community and promoting the use of artificial intelligence (AI)/DL for the wireless physical layer. We then put forward two key trade-offs in designing DL models for communication, namely, accuracy versus generalization and compression versus latency. We discuss their relevance in the context of wireless communications use cases using emerging DL models including large language models (LLMs). Finally, we summarize our proposed evaluation guidelines to enhance the research impact of DL on wireless communications. These guidelines are an attempt to reconcile the empirical nature of DL research with the rigorous requirement metrics of wireless communications systems.

cs.IT