arXiv subjects

Maximilian H. V. Tillmann

Publications and source records attributed to Maximilian H. V. Tillmann.

5 recordsLinked to original sources

arXiv2026

Cooperative Multi-Task Semantic Communication for Joint Classification and Regression Tasks

Multi-Task semantic communication (SemCom) prioritizes simultaneous execution of multiple tasks over bit-accurate reconstruction in future intelligent networks. In our prior work [1], we introduced the cooperative multi-task SemCom (CMT-SemCom) framework, in which the semantic encoder is divided into a common unit (CU) and multiple specific units (SUs) to facilitate cooperative multi-task processing. However, CMT-SemCom has been evaluated on homogeneous classification tasks on simplistic datasets, limiting its applicability to real-world perception systems. In this paper, we extend our CMT-SemCom to jointly handle heterogeneous classification and regression tasks on the complex Cityscapes dataset. We adopt the information maximization (InfoMax) principle so that it accommodates mixed discrete and continuous semantic variables. In particular, we benchmark the proposed framework against independent single-task training, a conventional task-agnostic digital transmission, and single-encoder multi-decoder SemCom. Additionally, we investigate the impact of CU capacity on joint task performance, providing design insights. Extensive evaluations demonstrate that CMT-SemCom significantly outperforms the benchmarks.

eess.SP↗

arXiv2026

Semantic Joint Source Channel Coding for Distributed Subsurface Imaging in Multi-Agent Systems

Multi-agent systems (MASs) are a promising solution for autonomous exploration tasks in hazardous or remote environments. In such settings, communication among agents is essential to ensure collaborative task execution, yet conventional approaches treat exploration and communication as decoupled subsystems. This work presents an approach that tightly integrates semantic communication into the MAS exploration process, adapting the communication system to the exploration methodology to improve overall task performance. Specifically, we investigate the application of semantic joint source-channel coding (JSCC) with over-the-air computation (AirComp) for distributed function computation for the application of cooperative subsurface imaging using the adapt-then-combine full waveform inversion (ATC-FWI) algorithm. Our results demonstrate that semantic JSCC significantly outperforms classical digital communication and conventional JSCC approaches, especially in high-connectivity networks. Furthermore, incorporating side information at the receiving agent enhances communication efficiency and imaging accuracy, a feature previously unexplored in MAS-based exploration. We validate our approach through a use case inspired by subsurface anomaly detection, showing measurable improvements in imaging performance per agent. This work underscores the potential of semantic communication in distributed multi-agent exploration to improve overall exploration accuracy and efficiency.

eess.SP↗

arXiv2026

Semantic-Aware Task Clustering for Constructive and Cooperative Multi-Tasking

Cooperative multi-task semantic communication (CMT-SemCom) improves task execution performance by leveraging shared representations. However, as we demonstrated in [1], cooperative multi-tasking can be either constructive or destructive, depending on the semantic relationships among tasks. To ensure constructive cooperation, we propose a semantic-aware task clustering method for CMT-SemCom. We have formulated a sequential multi-stage optimization problem in which semantically aligned tasks are clustered once after a short initial training phase, and then end-to-end (E2E) joint training is conducted exclusively within the discovered groups. Specifically, the problem decomposes into two stages: (i) a semantic clustering problem leveraging hierarchical density-based spatial clustering, and (ii) an intra-cluster E2E CMT-SemCom learning problem. Simulation results demonstrate that the proposed framework effectively mitigates destructive cooperation and negative transfer, yielding accuracy gains compared to unclustered multi-tasking and individual training baselines.

cs.LG↗

arXiv2026

Semantic Communication for Task Execution and Data Reconstruction in Multi-View Scenarios

Semantic communication has gained significant attention with the advances in machine learning. Most semantic communication works focus on either task execution or data reconstruction, with some recent works combining the two. In this work, we propose a semantic communication system for concurrent task execution and data reconstruction for a multi-view scenario, which we formulate as the maximization of mutual information. To investigate the trade-off between the two objectives, we formulate a joint objective as a convex combination of task execution and data reconstruction. We show that under specific assumptions, the \ac{SSIM} loss can be obtained from the mutual information maximization objective for data reconstruction, which takes human visual perception into account. Furthermore, for constant resource use, we show that by increasing the weight of the reconstruction objective up to a certain point, the task execution performance can be kept nearly constant, while the data reconstruction can be significantly improved.

eess.SP↗

arXiv2025

Cooperative and Collaborative Multi-Task Semantic Communication for Distributed Sources

In this paper, we explore a multi-task semantic communication (SemCom) system for distributed sources, extending the existing focus on collaborative single-task execution. We build on the cooperative multi-task processing introduced in [1], which divides the encoder into a common unit (CU) and multiple specific units (SUs). While earlier studies in multi-task SemCom focused on full observation settings, our research explores a more realistic case where only distributed partial observations are available, such as in a production line monitored by multiple sensing nodes. To address this, we propose an SemCom system that supports multi-task processing through cooperation on the transmitter side via split structure and collaboration on the receiver side. We have used an information-theoretic perspective with variational approximations for our end-to-end data-driven approach. Simulation results demonstrate that the proposed cooperative and collaborative multi-task (CCMT) SemCom system significantly improves task execution accuracy, particularly in complex datasets, if the noise introduced from the communication channel is not limiting the task performance too much. Our findings contribute to a more general SemCom framework capable of handling distributed sources and multiple tasks simultaneously, advancing the applicability of SemCom systems in real-world scenarios.

eess.SP↗