arXiv subjects

Liang Song

Publications and source records attributed to Liang Song.

At least 19 recordsLinked to original sources

arXiv2026

Networked AI: Architecture, Theory, and Applications

Recent advances in Artificial Intelligence (AI), particularly large-scale deep learning, have been driven by monolithic or offline training on massive curated datasets. While successful, these approaches face structural limitations: escalating data and computational demands, limited online adaptability, and a lack of system-level intelligence in open, non-stationary environments. This paper presents Networked AI - a networked intelligent system composed of interacting, heterogeneous, and continuously evolving AI agents. We establish a hierarchical layered architecture comprising an Agent Layer for heterogeneous capability construction, an Interaction Layer for signal-processing-guided online data extraction, and a Regulation Layer for stability-constrained collective evolution. Foundations in data science, signal processing, and system control are hereby synthesized into a unified theoretical framework of Networked AI, providing superior data efficiency, intelligence efficiency, interpretability, and scalability. Theoretical and experimental analysis demonstrates that Networked AI can approach near-linear scaling in resource demand, in contrast to the exponential increase in standalone end-to-end systems. It provides not only online adaptation to out-of-distribution environmental novelties, but also the autonomous evolution towards application-specific intelligence. Application frontiers are discussed for IoT spaces, embodied, spatial, and industrial intelligences, as well as the cellular infrastructure and beyond. Key open challenges are identified towards realizing locally autonomous, collectively intelligent, continuously evolving, globally regulated Networked AI.

cs.AI↗

arXiv2026

OEL-AD: An Online Evolutive Learning Framework for Cross-Region Adaptive Autonomous Driving

Autonomous driving models have achieved great progress in recent years, yet most existing approaches remain static, following a train-then-deploy paradigm that lacks the ability to adjust internal parameters when encountering new environments. This limitation is particularly critical in cross-region scenarios, which are common in real-world deployments in autonomous driving where differences in road layouts, traffic patterns, and environmental conditions introduce distribution shifts. In this paper, we argue for a paradigm shift towards Online Evolutive Learning (OEL), a learning paradigm designed to enable adaptive, online model optimization through the interaction and coordination of intelligent components in dynamic environments. We introduce OEL-AD, a novel framework that instantiates this paradigm for autonomous driving. Specifically, OEL-AD leverages trajectory uncertainty from the planning module to determine whether adaptive updates are necessary. When triggered, the framework uses discrepancies between predicted agent behaviors and subsequent observations as a self-supervised learning signal to refine perception and prediction modules, thereby indirectly improving planning accuracy and safety. Experiments on the nuScenes dataset with a cross-region split between Singapore and Boston demonstrate that OEL-AD consistently improves perception and prediction performance. This enhancement in perception and prediction consequently results in improved planning capabilities, thereby confirming the promise of online evolutive learning as a fundamental approach for building adaptive and robust autonomous driving systems.

cs.RO↗

arXiv2026

The Hardy spaces $\mathcal{H}^{p}_{FIO}(\mathbb{R}^{n})$ for Fourier integral operators for $p<1$

We introduce the Hardy spaces $\mathcal{H}^{p}_{FIO}(\mathbb{R}^{n})$ for Fourier integral operators for $0<p<1$, thereby extending earlier constructions for $1\leq p\leq \infty$. We then establish various properties of these spaces, including their behavior under complex interpolation and duality, and their invariance under Fourier integral operators. We also obtain Sobolev embeddings, equivalent characterizations, and a molecular decomposition. These spaces are used in the companion article arXiv:2502.02511 to determine the sharp $\mathcal{H}^{1}(\mathbb{R}^{n})$ and $\mathrm{bmo}(\mathbb{R}^{n})$ regularity of wave equations with rough coefficients.

math.AP↗

arXiv2026

Does Unlearning Survive Collaboration? Robust Unlearning for Shared-Model LLM Teams

LLM unlearning is essential for removing sensitive or unwanted knowledge while preserving useful capabilities. As LLM teams are increasingly used to solve complex problems, forgetting must remain effective during collaboration. Despite advances in forgetting effectiveness, efficiency, and robustness to relearning, team deployment remains underexplored. We find that collaboration weakens forgetting: final-answer evaluations miss recoverable evidence in team messages, including complementary clues supporting joint recovery. We establish theoretically and confirm empirically that controlling final answers or individual messages does not ensure low recovery from their combination. To address this challenge, we propose Aggregation-Conditioned Unlearning (ACU). ACU trains a shared model using reconstruction feedback from individual and pooled messages, prioritizes views with higher recovery risk, and uses replacement-based credit assignment while protecting direct and collaborative utility. TOFU evaluates trajectory-level recovery, while WMDP-bio tests native forgetting and retained utility. On TOFU, ACU lowers full-trajectory recovery from 41.8% to 19.3% in ROUGE-L recall and factual recovery from 34.2% to 18.7% versus output-supervised training, with comparable retained-task performance. These results demonstrate that ACU curbs information leakage in LLM teams and generalizes across team sizes and readers.

cs.CL↗

arXiv2026

Marginal Response Surface Elicitation for Zero-Label Tabular Learning

Tabular learning uses structured data to predict target outcomes. Traditionally, this process has relied on labeled data. However, large language models (LLMs) can be used to elicit domain priors based on the task description and feature semantics, thereby enabling predictions without labeled data. We propose Marginal Response Surface Elicitation (MARS), a method that transforms feature-level LLM priors into a reusable, zero-shot tabular classifier. To construct this classifier, MARS selects representative values for each feature from unlabeled data and prompts the LLM to provide corresponding class support scores and feature weights. It then aggregates multiple responses using the median to construct feature response functions, and makes predictions through their weighted sum without further LLM queries. Across eight tabular benchmark tasks, MARS achieves the highest average AUC and AP, outperforming direct prompting by 1.97 and 6.21 percentage points respectively, while substantially reducing end-to-end costs. Evaluations with LLMs of different sizes further demonstrate its predictive advantage over direct prompting.

cs.CL↗

arXiv2026

Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection

The performance ceiling of an LLM team is constrained not only by individual model capabilities, but also by inter-member error resonance and predictive differences. Although heterogeneous teaming is often observed to be effective in practice, existing approaches lack complementarity metrics that are computable, interpretable, and optimizable, leaving team composition to rely on heuristics. We propose a heterogeneity-driven team selection framework that performs offline profiling to characterize individual capability along with two complementary signals: one captures decorrelation in error patterns to reduce co-failures, while the other measures divergence in predictive behavior to capture strategy diversity. We formulate team selection as a standardized quality--complementarity combinatorial objective and apply an efficient greedy search to select a small team from a candidate pool. Experiments across multiple benchmarks demonstrate that our framework consistently outperforms quality-only baselines under controlled candidate pools and team sizes, establishing reusable selection principles for multi-LLM systems.

cs.CL↗

arXiv2026

Fefferman--Stein type inequalities via area and maximal functions for Schrödinger operators with applications

In this paper, we establish a Fefferman--Stein inequality in terms of area function and non-tangential maximal function associated with the Schrödinger operator $\mathcal{L} = -Δ+ V$ on stratified Lie groups $\mathcal G$, where $Δ$ denotes the sub-Laplacian on $\mathcal G$ and $V$ is a nonnegative locally integrable function. As an application, we extend this inequality to the tensor product $\mathcal G_1 \times \mathcal G_2$ of two stratified Lie groups and develop atomic decompositions associated with the Schrödinger operator for functions in the Orlicz space $L\log^{+}L(\mathcal G_1 \times \mathcal G_2).$ Using these atomic decompositions, we further prove weak-type endpoint estimates for the area integral operator and the Riesz transforms associated with the Schrödinger operator on $L\log^{+}L(\mathcal G_1 \times \mathcal G_2),$ thereby extending the celebrated result of R.\,Fefferman and E.M.\,Stein \cite{FSt1982} to the setting of singular integrals with non-smooth kernels.

math.AP↗

arXiv2026

Littlewood--Paley operators and semigroup maximal operators on CMO spaces associated to Schödinger operators

Let $L=-Δ+V$ be a Schrödinger operator on $\mathbb{R}^n$, where $Δ$ is the Laplacian and $V$ satisfies the reverse Hölder inequality ${\rm RH}_q$ for some $q>n/2$. In this paper, we study the behavior of the Littlewood--Paley operators $s_L$ and $S_L$, as well as the semigroup maximal operator $T^*_L$, on the space ${\rm CMO}_L(\mathbb{R}^n)$ associated with the Schrödinger operator $L$. It is known from previous work that these operators are bounded on ${\rm BMO}_L(\mathbb{R}^n)$. Our main result shows that they are, in fact, mappings from ${\rm CMO}_L(\mathbb{R}^n)$ into itself. To prove this, we develop several equivalent characterizations of ${\rm CMO}_L(\mathbb{R}^n)$ and employ a refined decomposition that partitions the parameter interval at $r_Bρ(x_B)$, instead of the customary $r_B^2$ or $ρ(x_B)^2$. The new strategy allows us to overcome a key technical obstacle that arises when applying existing methods to the ${\rm CMO}_L$ setting.

math.AP↗

arXiv2026

Embodied Multimedia: A Tutorial

Traditional multimedia technology has been built around optimizing content delivery for human observers, from perceptually driven compression standards to human-centric quality metrics. With the rapid rise of embodied intelligence, autonomous agents must perceive, reason, and act within the physical world in real time, exposing fundamental mismatches between conventional multimedia infrastructure and the demands of embodied tasks. In this regard, this tutorial paper formally introduces Embodied Multimedia as a cross-disciplinary research paradigm that treats multimodal data as the perceptual and communicative substrate spanning the full perception-decision-action loop. To be specific, we present a four-layer unified architecture comprising Data, Communication, Cognitive, and Evaluation layers, and provide a structured review of key enabling technologies within each layer. Furthermore, we identify five frontier application directions where Embodied Multimedia is positioned to serve a foundational role: multimedia communication, physical intelligence, embodied anomaly perception, the metaverse and interactive multimedia, and AI-driven art creation. Open technical challenges and future research directions are discussed to guide the community in this emerging field.

cs.MM↗

arXiv2026

Robust Embodied Perception in Dynamic Environments via Disentangled Weight Fusion

Embodied perception systems face severe challenges of dynamic environment distribution drift when they continuously interact in open physical spaces. However, the existing domain incremental awareness methods often rely on the domain id obtained in advance during the testing phase, which limits their practicability in unknown interaction scenarios. At the same time, the model often overfits to the context-specific perceptual noise, which leads to insufficient generalization ability and catastrophic forgetting. To address these limitations, we propose a domain-id and exemplar-free incremental learning framework for embodied multimedia systems, which aims to achieve robust continuous environment adaptation. This method designs a disentangled representation mechanism to remove non-essential environmental style interference, and guide the model to focus on extracting semantic intrinsic features shared across scenes, thereby eliminating perceptual uncertainty and improving generalization. We further use the weight fusion strategy to dynamically integrate the old and new environment knowledge in the parameter space, so as to ensure that the model adapts to the new distribution without storing historical data and maximally retains the discrimination ability of the old environment. Extensive experiments on multiple standard benchmark datasets show that the proposed method significantly reduces catastrophic forgetting in a completely exemplar-free and domain-id free setting, and its accuracy is better than the existing state-of-the-art methods.

cs.CV↗

arXiv2026

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation

Recent advances in collaborative knowledge distillation have demonstrated cutting-edge performance for resource-constrained distributed multimedia learning scenarios. However, achieving such competitiveness requires addressing a fundamental mismatch: high-dimensional teacher knowledge complexity versus heterogeneous client learning capacities, which currently prohibits deployment in edge-based visual analytics systems. Drawing inspiration from curriculum learning principles, we introduce Federated Adaptive Progressive Distillation (FAPD), a consensus-driven framework that orchestrates adaptive knowledge transfer. FAPD hierarchically decomposes teacher features via PCA-based structuring, extracting principal components ordered by variance contribution to establish a natural visual knowledge hierarchy. Clients progressively receive knowledge of increasing complexity through dimension-adaptive projection matrices. Meanwhile, the server monitors network-wide learning stability by tracking global accuracy fluctuations across a temporal consensus window, advancing curriculum dimensionality only when collective consensus emerges. Consequently, FAPD provably adapts knowledge transfer pace while achieving superior convergence over fixed-complexity approaches. Extensive experiments on three datasets validate FAPD's effectiveness: it attains 3.64% accuracy improvement over FedAvg on CIFAR-10, demonstrates 2x faster convergence, and maintains robust performance under extreme data heterogeneity (α=0.1), outperforming baselines by over 4.5%.

cs.LG↗

arXiv2026

Spherical maximal functions and Hardy spaces for Fourier integral operators

We use the Hardy spaces for Fourier integral operators to obtain bounds for spherical maximal functions in $L^{p}(\mathbb{R}^{n})$, $n\geq2$, where the radii of the spheres are restricted to a compact interval in $(0,\infty)$. These bounds extend to general hypersurfaces with non-vanishing Gaussian curvature, to the complex spherical means, and to geodesic spheres on compact manifolds. We also obtain improved maximal function bounds and pointwise convergence statements for wave equations, both on $\mathbb{R}^{n}$ and on compact manifolds. The maximal function bounds are essentially sharp for all $p\in[1,2]\cup [\frac{2(n+1)}{n-1},\infty)$, for each such hypersurface, every complex spherical mean, and on every manifold.

math.CA↗

arXiv2025

SplatBright: Generalizable Low-Light Scene Reconstruction from Sparse Views via Physically-Guided Gaussian Enhancement

Low-light 3D reconstruction from sparse views remains challenging due to exposure imbalance and degraded color fidelity. While existing methods struggle with view inconsistency and require per-scene training, we propose SplatBright, which is, to our knowledge, the first generalizable 3D Gaussian framework for joint low-light enhancement and reconstruction from sparse sRGB inputs. Our key idea is to integrate physically guided illumination modeling with geometry-appearance decoupling for consistent low-light reconstruction. Specifically, we adopt a dual-branch predictor that provides stable geometric initialization of 3D Gaussian parameters. On the appearance side, illumination consistency leverages frequency priors to enable controllable and cross-view coherent lighting, while an appearance refinement module further separates illumination, material, and view-dependent cues to recover fine texture. To tackle the lack of large-scale geometrically consistent paired data, we synthesize dark views via a physics-based camera model for training. Extensive experiments on public and self-collected datasets demonstrate that SplatBright achieves superior novel view synthesis, cross-view consistency, and better generalization to unseen low-light scenes compared with both 2D and 3D methods.

cs.CV↗

arXiv2025

Microclimatic variation in tropical canopies: A glimpse into the processes of community assembly in epiphytic bryophyte communities

Epiphytic communities offer an original framework to disentangle the contributions of environmental filters, biotic interactions and dispersal limitations to community structure at fine spatial scales. We determine here whether variations in light, microclimatic conditions and host tree size affect the variation in species composition and phylogenetic structure of epiphytic bryophyte communities, and hence, assess the contribution of environmental filtering, phylogenetic constraints and competition to community assembly.A canopy crane giving access to 1.1 ha of tropical rainforest in Yunnan (China) was employed to record hourly light and microclimatic conditions from 54 dataloggers and epiphytic bryophyte communities from 408 plots. Generalized Dissimilarity Modelling was implemented to analyse the relationship between taxonomic and phylogenetic turnover among epiphytic communities, host-tree characteristics and microclimatic variation.Within-tree vertical turnover of bryophyte communities was significantly about 30% higher than horizontal turnover among-trees. Thus, the sharp vertical variations in microclimatic conditions from tree base to canopy are more important than differences in age, reflecting the likelihood of colonization, area, and habitat conditions between young and old trees, in shaping the composition of epiphytic bryophyte communities.

q-bio.PE↗

arXiv2025

Global solutions to 3D quadratic nonlinear Schrödinger-type equation

We consider the Cauchy problem to the 3D fractional Schrödinger equation with quadratic interaction of $u\bar u$ type. We prove the global existence of solutions and scattering properties for small initial data. For the proof, one novelty is that we combine the normal form methods and the space-time resonance methods. Using the normal form transform enables us more flexibilities in designing the resolution spaces so that we can control various interactions. It is also convenient for the final data problem.

math.AP↗

arXiv2025

CalFuse: Multi-Modal Continual Learning via Feature Calibration and Parameter Fusion

With the proliferation of multi-modal data in large-scale visual recognition systems, enabling models to continuously acquire knowledge from evolving data streams while preserving prior information has become increasingly critical. Class-Continual Learning (CCL) addresses this challenge by incrementally incorporating new class knowledge without revisiting historical data, making it essential for real-world big data applications. While traditional CCL methods rely solely on visual features, recent advances in Vision-Language Models (VLMs) such as CLIP demonstrate significant potential for CCL by leveraging pre-trained multi-modal knowledge. However, existing approaches face challenges in mitigating catastrophic forgetting while maintaining the cross-modal generalization capabilities of VLMs. To address these limitations, we propose CalFuse, a framework that synergizes feature Calibration with parameter Fusion to enable effective multi-modal knowledge integration in continual learning scenarios. CalFuse introduces a dynamic feature calibration mechanism that adaptively balances original CLIP visual representations with task-specific features, preserving the model's intrinsic cross-modal generalization while adapting to new classes. Concurrently, a QR decomposition-based parameter fusion strategy progressively integrates newly acquired knowledge with historical task parameters, maintaining equilibrium between learning new class representations and retaining prior knowledge across sequential tasks. Extensive experiments on benchmark datasets validate the effectiveness of our approach in large-scale multi-modal continual learning settings, demonstrating superior performance over state-of-the-art methods in both average accuracy and final task retention.

cs.CV↗

arXiv2025

Extracting and Combining Abilities For Building Multi-lingual Ability-enhanced Large Language Models

Multi-lingual ability transfer has become increasingly important for the broad application of large language models (LLMs). Existing work highly relies on training with the multi-lingual ability-related data, which may not be available for low-resource languages. To solve it, we propose a Multi-lingual Abilities Extraction and Combination approach, named as MAEC. Our key idea is to decompose and extract language-agnostic ability-related weights from LLMs, and combine them across different languages by simple addition and subtraction operations without training. Specifically, our MAEC consists of the extraction and combination stages. In the extraction stage, we firstly locate key neurons that are highly related to specific abilities, and then employ them to extract the transferable ability-related weights. In the combination stage, we further select the ability-related tensors that mitigate the linguistic effects, and design a combining strategy based on them and the language-specific weights, to build the multi-lingual ability-enhanced LLM. To assess the effectiveness of our approach, we conduct extensive experiments on LLaMA-3 8B on mathematical and scientific tasks in both high-resource and low-resource lingual scenarios. Experiment results have shown that MAEC can effectively and efficiently extract and combine the advanced abilities, achieving comparable performance with PaLM. Resources are available at https://github.com/RUCAIBox/MAET.

cs.CL↗

arXiv2025

MMOC: Self-Supervised EEG Emotion Recognition Framework with Multi-Model Online Collaboration

Electroencephalography (EEG) emotion recognition plays a crucial role in human-computer interaction, particularly in healthcare and neuroscience. While supervised learning has been widely used, its reliance on manual annotations introduces high costs and potential bias. Self-supervised learning (SSL) offers a promising alternative by generating labels through pretext tasks. However, high inter-subject variability in EEG signals leads to significant data drift, limiting self-supervised models' generalization across unseen subjects. Traditional domain adaptation (DA) methods require access to target-domain data during training. Although domain generalization (DG) avoids this constraint, it often falls short in handling complex data drift due to limited coverage of possible target distributions. To tackle these challenges, we propose MMOC, a self-supervised framework with multi-model online collaboration (MMOC), to achieve online adaptation to unseen data. MMOC trains multiple base models using diverse strategies rooted in reconstruction and contrastive learning, enabling each model to develop distinct generalization capabilities. During inference, MMOC dynamically activates the most suitable model for each test sample via a loss-based routing mechanism that evaluates both contrastive and reconstruction losses. This dual consideration allows for a comprehensive measurement of data drift at both structural and semantic levels. Experimental results on the SEED and Dreamer datasets show that MMOC achieves state-of-the-art performance: 85.39% on SEED, and 68.77% and 69.37% on Dreamer arousal and valence dimensions, respectively. MMOC effectively mitigates inter-subject data drift, offering a practical solution for real-world EEG emotion recognition.

eess.SP↗