arXiv subjects

Ming Sun

Publications and source records attributed to Ming Sun.

At least 73 records · Page 4Linked to original sources

arXiv2025

Historically Relevant Event Structuring for Temporal Knowledge Graph Reasoning

Temporal Knowledge Graph (TKG) reasoning focuses on predicting events through historical information within snapshots distributed on a timeline. Existing studies mainly concentrate on two perspectives of leveraging the history of TKGs, including capturing evolution of each recent snapshot or correlations among global historical facts. Despite the achieved significant accomplishments, these models still fall short of I) investigating the impact of multi-granular interactions across recent snapshots, and II) harnessing the expressive semantics of significant links accorded with queries throughout the entire history, particularly events exerting a profound impact on the future. These inadequacies restrict representation ability to reflect historical dependencies and future trends thoroughly. To overcome these drawbacks, we propose an innovative TKG reasoning approach towards \textbf{His}torically \textbf{R}elevant \textbf{E}vents \textbf{S}tructuring (HisRES). Concretely, HisRES comprises two distinctive modules excelling in structuring historically relevant events within TKGs, including a multi-granularity evolutionary encoder that captures structural and temporal dependencies of the most recent snapshots, and a global relevance encoder that concentrates on crucial correlations among events relevant to queries from the entire history. Furthermore, HisRES incorporates a self-gating mechanism for adaptively merging multi-granularity recent and historically relevant structuring representations. Extensive experiments on four event-based benchmarks demonstrate the state-of-the-art performance of HisRES and indicate the superiority and effectiveness of structuring historical relevance for TKG reasoning.

cs.LG↗

arXiv2025

NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Study

In this work, we build the first benchmark dataset for short-form UGC Image Super-resolution in the wild, termed KwaiSR, intending to advance the research on developing image super-resolution algorithms for short-form UGC platforms. This dataset is collected from the Kwai Platform, which is composed of two parts, i.e., synthetic and wild parts. Among them, the synthetic dataset, including 1,900 image pairs, is produced by simulating the degradation following the distribution of real-world low-quality short-form UGC images, aiming to provide the ground truth for training and objective comparison in the validation/testing. The wild dataset contains low-quality images collected directly from the Kwai Platform, which are filtered using the quality assessment method KVQ from the Kwai Platform. As a result, the KwaiSR dataset contains 1800 synthetic image pairs and 1900 wild images, which are divided into training, validation, and testing parts with a ratio of 8:1:1. Based on the KwaiSR dataset, we organize the NTIRE 2025 challenge on a second short-form UGC Video quality assessment and enhancement, which attracts lots of researchers to develop the algorithm for it. The results of this competition have revealed that our KwaiSR dataset is pretty challenging for existing Image SR methods, which is expected to lead to a new direction in the image super-resolution field. The dataset can be found from https://lixinustc.github.io/NTIRE2025-KVQE-KwaSR-KVQ.github.io/.

cs.CV↗

arXiv2025

The RESOLVE and ECO G3 Initiative: Drivers of HI Content and X-ray Emission in Galaxy Groups

Adding to the RESOLVE and ECO Gas in Galaxy Groups (G3) initiative, we examine possible drivers of group-integrated HI-to-halo mass ratios ($M_{\rm HI,grp}/M_{\rm halo}$) and group X-ray emission, including group halo mass ($M_{\rm halo}$), virialization as probed by crossing time ($t_{\rm cross}$), presence of active galactic nuclei (AGN), and group-integrated fractional stellar mass growth rate (FSMGR$_{\rm grp}$). G3 groups span $M_{\rm halo}=10^{11-14.5}\,M_\odot$ with comprehensive HI and AGN information, which we combine with X-ray stacking of ROSAT All-Sky data. We detect hot gas emission exceeding AGN and X-ray binary backgrounds confidently for $M_{\rm halo}=10^{12.6-14}\,M_\odot$ and unambiguously for $M_{\rm halo}>10^{14}\,M_\odot$, reflecting an inverse dependence of $M_{\rm\,HI,grp}/M_{\rm halo}$ and hot gas emission on halo mass. At fixed halo mass, $M_{\rm\,HI,grp}/M_{\rm halo}$ transitions to greater spread below $t_{\rm cross}\sim2$ Gyr. Dividing groups across this transition, lower-$t_{\rm cross}$ groups show elevated X-ray emission compared to higher-$t_{\rm cross}$ groups for $M_{\rm halo}>10^{13.3}\,M_\odot$, but this trend reverses for $M_{\rm halo}=10^{12.6-13.3}\,M_\odot$. Additionally, AGN-hosting halos below $M_{\rm halo}\sim10^{12.1}\,M_\odot$ exhibit a broad, $\sim$0.25 dex deep valley in $M_{\rm HI,grp}/M_{\rm halo}$ compared to non-AGN-hosting halos with correspondingly reduced FSMGR$_{\rm grp}$. When diluted by non-AGN-hosting halos, this valley becomes shallower and narrower, falling roughly between $M_{\rm halo}=10^{11.5}\,M_\odot$ and $M_{\rm halo}=10^{12.1}\,M_\odot$ in the overall $M_{\rm\,HI,grp}/M_{\rm\,halo}$ vs. $M_{\rm halo}$ relation. We may also detect a second, less easily interpreted valley at $M_{\rm halo}\sim10^{13}\,M_\odot$. Neither valley matches theoretical predictions of a deeper valley at or above $M_{\rm halo}=10^{12.1}\,M_\odot$.

astro-ph.GA↗

arXiv2025

NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: Methods and Results

This paper presents a review for the NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement. The challenge comprises two tracks: (i) Efficient Video Quality Assessment (KVQ), and (ii) Diffusion-based Image Super-Resolution (KwaiSR). Track 1 aims to advance the development of lightweight and efficient video quality assessment (VQA) models, with an emphasis on eliminating reliance on model ensembles, redundant weights, and other computationally expensive components in the previous IQA/VQA competitions. Track 2 introduces a new short-form UGC dataset tailored for single image super-resolution, i.e., the KwaiSR dataset. It consists of 1,800 synthetically generated S-UGC image pairs and 1,900 real-world S-UGC images, which are split into training, validation, and test sets using a ratio of 8:1:1. The primary objective of the challenge is to drive research that benefits the user experience of short-form UGC platforms such as Kwai and TikTok. This challenge attracted 266 participants and received 18 valid final submissions with corresponding fact sheets, significantly contributing to the progress of short-form UGC VQA and image superresolution. The project is publicly available at https://github.com/lixinustc/KVQE- ChallengeCVPR-NTIRE2025.

eess.IV↗

arXiv2025

KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perception

Video Quality Assessment (VQA), which intends to predict the perceptual quality of videos, has attracted increasing attention. Due to factors like motion blur or specific distortions, the quality of different regions in a video varies. Recognizing the region-wise local quality within a video is beneficial for assessing global quality and can guide us in adopting fine-grained enhancement or transcoding strategies. Due to the heavy cost of annotating region-wise quality, the lack of ground truth constraints from relevant datasets further complicates the utilization of local perception. Inspired by the Human Visual System (HVS) that links global quality to the local texture of different regions and their visual saliency, we propose a Kaleidoscope Video Quality Assessment (KVQ) framework, which aims to effectively assess both saliency and local texture, thereby facilitating the assessment of global quality. Our framework extracts visual saliency and allocates attention using Fusion-Window Attention (FWA) while incorporating a Local Perception Constraint (LPC) to mitigate the reliance of regional texture perception on neighboring areas. KVQ obtains significant improvements across multiple scenarios on five VQA benchmarks compared to SOTA methods. Furthermore, to assess local perception, we establish a new Local Perception Visual Quality (LPVQ) dataset with region-wise annotations. Experimental results demonstrate the capability of KVQ in perceiving local distortions. KVQ models and the LPVQ dataset will be available at https://github.com/qyp2000/KVQ.

cs.CV↗

arXiv2025

Visual Autoregressive Modeling for Image Super-Resolution

Image Super-Resolution (ISR) has seen significant progress with the introduction of remarkable generative models. However, challenges such as the trade-off issues between fidelity and realism, as well as computational complexity, have also posed limitations on their application. Building upon the tremendous success of autoregressive models in the language domain, we propose \textbf{VARSR}, a novel visual autoregressive modeling for ISR framework with the form of next-scale prediction. To effectively integrate and preserve semantic information in low-resolution images, we propose using prefix tokens to incorporate the condition. Scale-aligned Rotary Positional Encodings are introduced to capture spatial structures and the diffusion refiner is utilized for modeling quantization residual loss to achieve pixel-level fidelity. Image-based Classifier-free Guidance is proposed to guide the generation of more realistic images. Furthermore, we collect large-scale data and design a training process to obtain robust generative priors. Quantitative and qualitative results show that VARSR is capable of generating high-fidelity and high-realism images with more efficiency than diffusion-based methods. Our codes will be released at https://github.com/qyp2000/VARSR.

cs.CV↗

arXiv2025

MeerKAT discovery of GHz radio emission extending from Abell 3017 toward Abell 3016

Context: The clusters Abell 3017 and Abell 3016 are located within a large-scale filament. A prominent X-ray bridge has been detected connecting the two clusters and a potential galaxy group between them. Aims: The aim of this work is to investigate the existence of a radio bridge in the filament between Abell 3017 and Abell 3016, to explore other diffuse radio structures within this system, and to investigate the origins of these diffuse radio emission. Methods: We analyzed MeerKAT L-band data to study the morphology and spectra of the diffuse radio structures in Abell 3016-Abell 3017. X-ray imaging and spectral analysis were carried out with archival Chandra and XMM-Newton data. Additionally, correlations between radio ($I_R$) and X-ray surface brightness ($I_X$) were generated to explore the connections between thermal and non-thermal components in the diffuse radio emission. Results: We detected a faint radio bridge with an average surface brightness of $\sim 0.1~μ\rm Jy~arcsec^{-2}$ at 1280 MHz using MeerKAT. It connects Abell 3017 with a potential galaxy group and extends towards Abell 3016, aligning with the X-ray bridge. A high X-ray temperature of $7.09 \pm 0.54$ keV detected in the bridge region suggests an interaction between Abell 3017 and the group. In Abell 3017, we identified two distinct components of diffuse radio emission: a radio mini-halo and an outer radio halo with a northern extension (N-extension hereafter). The radio surface brightness profile of Abell 3017 shows a steep inner component consistent with other mini-halos, and a faint outer component likely linked to an infalling subcluster. The $I_{\rm R}-I_{\rm X}$ diagram indicates superlinear and sublinear correlations for the mini-halo and N-extension, respectively.

astro-ph.CO↗

arXiv2025

Effective Integration of KAN for Keyword Spotting

Keyword spotting (KWS) is an important speech processing component for smart devices with voice assistance capability. In this paper, we investigate if Kolmogorov-Arnold Networks (KAN) can be used to enhance the performance of KWS. We explore various approaches to integrate KAN for a model architecture based on 1D Convolutional Neural Networks (CNN). We find that KAN is effective at modeling high-level features in lower-dimensional spaces, resulting in improved KWS performance when integrated appropriately. The findings shed light on understanding KAN for speech processing tasks and on other modalities for future researchers.

eess.AS↗

arXiv2024

Plug-and-Play Tri-Branch Invertible Block for Image Rescaling

High-resolution (HR) images are commonly downscaled to low-resolution (LR) to reduce bandwidth, followed by upscaling to restore their original details. Recent advancements in image rescaling algorithms have employed invertible neural networks (INNs) to create a unified framework for downscaling and upscaling, ensuring a one-to-one mapping between LR and HR images. Traditional methods, utilizing dual-branch based vanilla invertible blocks, process high-frequency and low-frequency information separately, often relying on specific distributions to model high-frequency components. However, processing the low-frequency component directly in the RGB domain introduces channel redundancy, limiting the efficiency of image reconstruction. To address these challenges, we propose a plug-and-play tri-branch invertible block (T-InvBlocks) that decomposes the low-frequency branch into luminance (Y) and chrominance (CbCr) components, reducing redundancy and enhancing feature processing. Additionally, we adopt an all-zero mapping strategy for high-frequency components during upscaling, focusing essential rescaling information within the LR image. Our T-InvBlocks can be seamlessly integrated into existing rescaling models, improving performance in both general rescaling tasks and scenarios involving lossy compression. Extensive experiments confirm that our method advances the state of the art in HR image reconstruction.

eess.IV↗

arXiv2024

MASV: Speaker Verification with Global and Local Context Mamba

Deep learning models like Convolutional Neural Networks and transformers have shown impressive capabilities in speech verification, gaining considerable attention in the research community. However, CNN-based approaches struggle with modeling long-sequence audio effectively, resulting in suboptimal verification performance. On the other hand, transformer-based methods are often hindered by high computational demands, limiting their practicality. This paper presents the MASV model, a novel architecture that integrates the Mamba module into the ECAPA-TDNN framework. By introducing the Local Context Bidirectional Mamba and Tri-Mamba block, the model effectively captures both global and local context within audio sequences. Experimental results demonstrate that the MASV model substantially enhances verification performance, surpassing existing models in both accuracy and efficiency.

eess.AS↗

arXiv2024

Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning

Existing keyword spotting (KWS) systems primarily rely on predefined keyword phrases. However, the ability to recognize customized keywords is crucial for tailoring interactions with intelligent devices. In this paper, we present a novel Query-by-Example (QbyE) KWS system that employs spectral-temporal graph attentive pooling and multi-task learning. This framework aims to effectively learn speaker-invariant and linguistic-informative embeddings for QbyE KWS tasks. Within this framework, we investigate three distinct network architectures for encoder modeling: LiCoNet, Conformer and ECAPA_TDNN. The experimental results on a substantial internal dataset of $629$ speakers have demonstrated the effectiveness of the proposed QbyE framework in maximizing the potential of simpler models such as LiCoNet. Particularly, LiCoNet, which is 13x more efficient, achieves comparable performance to the computationally intensive Conformer model (1.98% vs. 1.63\% FRR at 0.3 FAs/Hr).

cs.CL↗

arXiv2024

CPGA: Coding Priors-Guided Aggregation Network for Compressed Video Quality Enhancement

Recently, numerous approaches have achieved notable success in compressed video quality enhancement (VQE). However, these methods usually ignore the utilization of valuable coding priors inherently embedded in compressed videos, such as motion vectors and residual frames, which carry abundant temporal and spatial information. To remedy this problem, we propose the Coding Priors-Guided Aggregation (CPGA) network to utilize temporal and spatial information from coding priors. The CPGA mainly consists of an inter-frame temporal aggregation (ITA) module and a multi-scale non-local aggregation (MNA) module. Specifically, the ITA module aggregates temporal information from consecutive frames and coding priors, while the MNA module globally captures spatial information guided by residual frames. In addition, to facilitate research in VQE task, we newly construct the Video Coding Priors (VCP) dataset, comprising 300 videos with various coding priors extracted from corresponding bitstreams. It remedies the shortage of previous datasets on the lack of coding information. Experimental results demonstrate the superiority of our method compared to existing state-of-the-art methods. The code and dataset will be released at https://github.com/VQE-CPGA/CPGA.git .

eess.IV↗

arXiv2024

Can AGN activity be enhanced by ram pressure stripping? -- X-ray perspective

Ram pressure stripping (RPS) is an important process that plays a significant role in shaping the evolution of cluster galaxies and their surrounding environment. Despite its recognized significance, the potential connection between RPS and AGN activity in cluster galaxies remains poorly understood. Recent claims, based on optical emission line diagnostics, have suggested such a connection. Here, we investigate this relationship from an X-ray perspective using a sample of galaxies undergoing RPS in four nearby galaxy clusters - A1656, A1367, A426, and A3627. This study is the first to test such a connection from an X-ray standpoint. Our analysis reveals no signs of enhanced X-ray AGN activity in our sample, with most RPS galaxies ($\sim$ $90\%$) showing X-ray luminosities below $10^{41}$ erg s$^{-1}$ in their central point sources. Moreover, there is no noticeable difference in X-ray AGN activity among RPS galaxies compared to a control sample of non-RPS galaxies, as demonstrated by similar X-ray luminosities observed in their central point sources. While the most luminous X-ray AGN in our sample is found in ESO 137-002, a galaxy undergoing RPS in A3627, there is no evidence for a widespread enhancement of X-ray AGN activity due to RPS. Given the limited sample size of our study, this could also indicate that either the X-ray AGN enhancement from RPS is at most weak, or the timescale for the X-ray AGN enhancement is short. This emphasizes the need for further investigations with larger X-ray samples to better understand the impact of RPS on AGN activity in cluster galaxies.

astro-ph.GA↗

arXiv2024

OAPT: Offset-Aware Partition Transformer for Double JPEG Artifacts Removal

Deep learning-based methods have shown remarkable performance in single JPEG artifacts removal task. However, existing methods tend to degrade on double JPEG images, which are prevalent in real-world scenarios. To address this issue, we propose Offset-Aware Partition Transformer for double JPEG artifacts removal, termed as OAPT. We conduct an analysis of double JPEG compression that results in up to four patterns within each 8x8 block and design our model to cluster the similar patterns to remedy the difficulty of restoration. Our OAPT consists of two components: compression offset predictor and image reconstructor. Specifically, the predictor estimates pixel offsets between the first and second compression, which are then utilized to divide different patterns. The reconstructor is mainly based on several Hybrid Partition Attention Blocks (HPAB), combining vanilla window-based self-attention and sparse attention for clustered pattern features. Extensive experiments demonstrate that OAPT outperforms the state-of-the-art method by more than 0.16dB in double JPEG image restoration task. Moreover, without increasing any computation cost, the pattern clustering module in HPAB can serve as a plugin to enhance other transformer-based image restoration methods. The code will be available at https://github.com/QMoQ/OAPT.git .

eess.IV↗

arXiv2024

Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spotting

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness under different acoustic environments. In this paper, we explore how to effectively apply adversarial examples to improve KWS robustness. We propose datasource-aware disentangled learning with adversarial examples to reduce the mismatch between the original and adversarial data as well as the mismatch across original training datasources. The KWS model architecture is based on depth-wise separable convolution and a simple attention module. Experimental results demonstrate that the proposed learning strategy improves false reject rate by $40.31%$ at $1%$ false accept rate on the internal dataset, compared to the strongest baseline without using adversarial examples. Our best-performing system achieves $98.06%$ accuracy on the Google Speech Commands V1 dataset.

cs.SD↗

arXiv2024

A Partition-and-Merge Algorithm for Solving the Steiner Tree Problem in Large Graphs

The Steiner tree problem aims to determine a minimum edge-weighted tree that spans a given set of terminal vertices from a given graph. In the past decade, a considerable number of algorithms have been developed to solve this computationally challenging problem. However, existing algorithms typically encounter difficulties for solving large instances, i.e., graphs with a high number of vertices and terminals. In this paper, we present a novel partition-and-merge algorithm to effectively solve this problem in large graphs. The algorithm breaks the input network into small subgraphs and then merges the subgraphs in a bottom-up manner. In the merging procedure, partial Steiner trees in the subgraphs are also created and optimized by efficient local optimization. When the merging procedure ends, the algorithm terminates and reports the final solution for the input graph. We evaluated the algorithm on a wide range of benchmark instances, showing that the algorithm outperforms the best-known algorithms on large instances and competes favorably with them on small or medium-sized instances.

cs.DS↗

arXiv2024

MakeupAttack: Feature Space Black-box Backdoor Attack on Face Recognition via Makeup Transfer

Backdoor attacks pose a significant threat to the training process of deep neural networks (DNNs). As a widely-used DNN-based application in real-world scenarios, face recognition systems once implanted into the backdoor, may cause serious consequences. Backdoor research on face recognition is still in its early stages, and the existing backdoor triggers are relatively simple and visible. Furthermore, due to the perceptibility, diversity, and similarity of facial datasets, many state-of-the-art backdoor attacks lose effectiveness on face recognition tasks. In this work, we propose a novel feature space backdoor attack against face recognition via makeup transfer, dubbed MakeupAttack. In contrast to many feature space attacks that demand full access to target models, our method only requires model queries, adhering to black-box attack principles. In our attack, we design an iterative training paradigm to learn the subtle features of the proposed makeup-style trigger. Additionally, MakeupAttack promotes trigger diversity using the adaptive selection method, dispersing the feature distribution of malicious samples to bypass existing defense methods. Extensive experiments were conducted on two widely-used facial datasets targeting multiple models. The results demonstrate that our proposed attack method can bypass existing state-of-the-art defenses while maintaining effectiveness, robustness, naturalness, and stealthiness, without compromising model performance.

cs.CV↗

arXiv2024

Long working distance portable smartphone microscopy for metallic mesh defect detection

Metallic mesh is a transparent electromagnetic shielding film with a fine metal line structure. However, it can develop defects that affect the optoelectronic performance whether in the production preparation or in actual use. The development of in-situ non-destructive testing (NDT) devices for metallic mesh requires long working distances, reflective optical path design, and miniaturization. To address the limitations of existing smartphone microscopes, which feature short working distances and inadequate transmission imaging for industrial in-situ inspection, we propose a novel long-working distance reflective smartphone microscopy system (LD-RSM). LD-RSM builds a 4f optical imaging system with external optical components and a smartphone, utilizing a beam splitter to achieve reflective imaging with the illumination system and imaging system on the same side of the sample. It achieves an optical resolution of 4.92$μ$m and a working distance of up to 22.23 mm. Additionally, we introduce a dual prior weighted Robust Principal Component Analysis (DW-RPCA) for defect detection. This approach leverages spectral filter fusion and Hough transform to model different defect types, enhancing the accuracy and efficiency of defect identification. Coupled with an optimized threshold segmentation algorithm, DW-RPCA method achieves a pixel-level accuracy of 84.8%. Our work showcases strong potential for growth in the field of in-situ on-line inspection of industrial products.

cs.CV↗