arXiv subjects

Shiqi Wu

Publications and source records attributed to Shiqi Wu.

3 recordsLinked to original sources

arXiv2026

A Feature-Rich Embedded NIDS with eBPF/XDP: Detector and Architecture Trade-offs

Distributed Denial-of-Service (DDoS) attacks remain a serious threat to transport networks, with recent attack volumes exceeding 30 Tbps, and the telecommunications industry being the main target. Recent work has yet to study the impact of the hosting software architecture on network monitoring solutions, or to assess recent algorithms for improving attack detection. This paper presents a Network Intrusion Detection System (NIDS) for DDoS detection in transport networks, developed in collaboration with Ericsson. Building on a statistical baseline, we improve detection effectiveness with an Isolation Forest trained on a wider set of flow features, extracted by GoFlowMeter, our open-source Go implementation of CICFlowMeter, and we integrate eBPF/XDP so that the NIDS filters real traffic at the kernel level. We further compare three deployments, monolithic, Kafka-based, and gRPC-based microservices, on a Raspberry Pi 5 testbed replaying the CIC-DDoS2019 dataset as real network traffic. Detection quality is governed mainly by the choice of detector rather than by the transport: the Isolation Forest raises recall and F1 score (0.965 live in the monolithic variant) over the baseline by flagging low-volume attack windows that the baseline misses. The transport is not neutral, however: gRPC reaches almost the same accuracy as the monolithic variant while adding less than 2 milliseconds of transport time per window, whereas the asynchronous Kafka pipeline trails by roughly nine percentage points and adds about 27 milliseconds. These findings clarify the trade-off between detection quality and architectural overhead when deploying a NIDS on resource-constrained hardware.

cs.CR↗

arXiv2024

Non-intrusive model combination for learning dynamical systems

In data-driven modelling of complex dynamic processes, it is often desirable to combine different classes of models to enhance performance. Examples include coupled models of different fidelities, or hybrid models based on physical knowledge and data-driven strategies. A key limitation of the broad adoption of model combination in applications is intrusiveness: training combined models typically requires significant modifications to the learning algorithm implementations, which may often be already well-developed and optimized for individual model spaces. In this work, we propose an iterative, non-intrusive methodology to combine two model spaces to learn dynamics from data. We show that this can be understood, at least in the linear setting, as finding the optimal solution in the direct sum of the two hypothesis spaces, while leveraging only the projection operators in each individual space. Hence, the proposed algorithm can be viewed as iterative projections, for which we can obtain estimates on its convergence properties. To highlight the extensive applicability of our framework, we conduct numerical experiments in various problem settings, with particular emphasis on various hybrid models based on the Koopman operator approach.

math.DS↗

arXiv2022

Fast sequence to graph alignment using the graph wavefront algorithm

Motivation: A pan-genome graph represents a collection of genomes and encodes sequence variations between them. It is a powerful data structure for studying multiple similar genomes. Sequence-to-graph alignment is an essential step for the construction and the analysis of pan-genome graphs. However, existing algorithms incur runtime proportional to the product of sequence length and graph size, making them inefficient for aligning long sequences against large graphs. Results: We propose the graph wavefront alignment algorithm (Gwfa), a new method for aligning a sequence to a sequence graph. Although the worst-case time complexity of Gwfa is the same as the existing algorithms, it is designed to run faster for closely matching sequences, and its runtime in practice often increases only moderately with the edit distance of the optimal alignment. On four real datasets, Gwfa is up to four orders of magnitude faster than other exact sequence-to-graph alignment algorithms. We also propose a graph pruning heuristic on top of Gwfa, which can achieve an additional $\sim$10-fold speedup on large graphs. Availability: Gwfa code is accessible at https://github.com/lh3/gwfa.

q-bio.GN↗