arXiv ScienceSearch

arXiv subjects

Wenbo Cheng

Publications and source records attributed to Wenbo Cheng.

3 recordsLinked to original sources

Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding

Recent multimodal large language models mainly process audio as monaural signals, thereby discarding the spatial cues contained in spatial audio for sound localization, spatial relation reasoning, and spatial scene understanding. We propose Spatial-Omni, a lightweight method that implements SO-Encoder to inject First-Order Ambisonics (FOA) spatial audio into existing Omni LLMs as an independent modality, without modifying their original audio encoders. SO-Encoder provides spatial tokens with limited additional context cost and improves spatial audio understanding through efficient staged training. To support training and evaluation, we construct SO-Dataset, SO-QA, and SO-Bench from open-source data, real recordings, and simulations, containing 400K FOA spatial audio clips and 2.1M spatial question answering pairs. SO-Bench covers 16 spatial audio understanding subtasks, including basic detection and location estimation, spatial relation understanding, and complex spatial reasoning. Experiments show that Spatial-Omni outperforms existing open-source Large Audio-Language Models (LALMs) and Omni LLM models on spatial audio understanding tasks while retaining a reasonable level of general audio understanding. Code and data are available at https://github.com/dieKarotte/Spatial-Omni.

eess.AS

From Cheap to Pro: A Learning-based Adaptive Camera Parameter Network for Professional-Style Imaging

Consumer-grade camera systems often struggle to maintain stable image quality under complex illumination conditions such as low light, high dynamic range, and backlighting, as well as spatial color temperature variation. These issues lead to underexposure, color casts, and tonal inconsistency, which degrade the performance of downstream vision tasks. To address this, we propose ACamera-Net, a lightweight and scene-adaptive camera parameter adjustment network that directly predicts optimal exposure and white balance from RAW inputs. The framework consists of two modules: ACamera-Exposure, which estimates ISO to alleviate underexposure and contrast loss, and ACamera-Color, which predicts correlated color temperature and gain factors for improved color consistency. Optimized for real-time inference on edge devices, ACamera-Net can be seamlessly integrated into imaging pipelines. Trained on diverse real-world data with annotated references, the model generalizes well across lighting conditions. Extensive experiments demonstrate that ACamera-Net consistently enhances image quality and stabilizes perception outputs, outperforming conventional auto modes and lightweight baselines without relying on additional image enhancement modules.

cs.CV

Danlu Tongdu tablets treat lumbar spinal stenosis through reducing reactive oxygen species and apoptosis by regulating CDK2/CDK4/CDKN1A expression

Lumbar spinal stenosis (LSS) is caused by the compression of the nerve root or cauda equina nerve by stenosis of the lumbar spinal canal or intervertebral foramen, and is manifested as chronic low back and leg pain. Danlu Tongdu (DLTD) tablets can relieve chronic pain caused by LSS, but the molecular mechanism remains largely unknown. In this study, the potential molecular mechanism of DLTD tablets in the treatment of LSS was firstly predicted by network pharmacology method. Results showed that DLTD functions in regulating anti-oxidative, apoptosis, and inflammation signaling pathways. Furthermore, the flow cytometry results showed that DLTD tablets efficiently reduced ROS content and inhibited rat neural stem cell apoptosis induced by hydrogen peroxide. DLTD also inhibited the mitochondrial membrane potential damage induced by hydrogen peroxide. Elisa analysis showed that DLTD induced cell cycle related protein, CDK2 and CDK4 and reduced CDKN1A protein expression level. Taken together, our study provided new insights of DLTD in treating LSS through reducing ROS content, decreasing apoptosis by inhibiting CDKN1A and promoting CDK2 and CDK4 expression levels.

q-bio.QM