arXiv subjects

Xuyang Liu

Publications and source records attributed to Xuyang Liu.

54 records · Page 3Linked to original sources

arXiv2025

Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models

With the advent of large vision-language models (LVLMs) demonstrating increasingly human-like abilities, a pivotal question emerges: do different LVLMs interpret multimodal sarcasm differently, and can a single model grasp sarcasm from multiple perspectives like humans? To explore this, we introduce an analytical framework using systematically designed prompts on existing multimodal sarcasm datasets. Evaluating 12 state-of-the-art LVLMs over 2,409 samples, we examine interpretive variations within and across models, focusing on confidence levels, alignment with dataset labels, and recognition of ambiguous "neutral" cases. We further validate our findings on a diverse 100-sample mini-benchmark, incorporating multiple datasets, expanded prompt variants, and representative commercial LVLMs. Our findings reveal notable discrepancies -- across LVLMs and within the same model under varied prompts. While classification-oriented prompts yield higher internal consistency, models diverge markedly when tasked with interpretive reasoning. These results challenge binary labeling paradigms by highlighting sarcasm's subjectivity. We advocate moving beyond rigid annotation schemes toward multi-perspective, uncertainty-aware modeling, offering deeper insights into multimodal sarcasm comprehension. Our code and data are available at: https://github.com/CoderChen01/LVLMSarcasmAnalysis

cs.CL↗

arXiv2025

GUI-G$^2$: Gaussian Reward Modeling for GUI Grounding

Graphical User Interface (GUI) grounding maps natural language instructions to precise interface locations for autonomous interaction. Current reinforcement learning approaches use binary rewards that treat elements as hit-or-miss targets, creating sparse signals that ignore the continuous nature of spatial interactions. Motivated by human clicking behavior that naturally forms Gaussian distributions centered on target elements, we introduce GUI Gaussian Grounding Rewards (GUI-G$^2$), a principled reward framework that models GUI elements as continuous Gaussian distributions across the interface plane. GUI-G$^2$ incorporates two synergistic mechanisms: Gaussian point rewards model precise localization through exponentially decaying distributions centered on element centroids, while coverage rewards assess spatial alignment by measuring the overlap between predicted Gaussian distributions and target regions. To handle diverse element scales, we develop an adaptive variance mechanism that calibrates reward distributions based on element dimensions. This framework transforms GUI grounding from sparse binary classification to dense continuous optimization, where Gaussian distributions generate rich gradient signals that guide models toward optimal interaction positions. Extensive experiments across ScreenSpot, ScreenSpot-v2, and ScreenSpot-Pro benchmarks demonstrate that GUI-G$^2$, substantially outperforms state-of-the-art method UI-TARS-72B, with the most significant improvement of 24.7% on ScreenSpot-Pro. Our analysis reveals that continuous modeling provides superior robustness to interface variations and enhanced generalization to unseen layouts, establishing a new paradigm for spatial reasoning in GUI interaction tasks.

cs.LG↗

arXiv2025

M2IST: Multi-Modal Interactive Side-Tuning for Efficient Referring Expression Comprehension

Referring expression comprehension (REC) is a vision-language task to locate a target object in an image based on a language expression. Fully fine-tuning general-purpose pre-trained vision-language foundation models for REC yields impressive performance but becomes increasingly costly. Parameter-efficient transfer learning (PETL) methods have shown strong performance with fewer tunable parameters. However, directly applying PETL to REC faces two challenges: (1) insufficient multi-modal interaction between pre-trained vision-language foundation models, and (2) high GPU memory usage due to gradients passing through the heavy vision-language foundation models. To this end, we present M2IST: Multi-Modal Interactive Side-Tuning with M3ISAs: Mixture of Multi-Modal Interactive Side-Adapters. During fine-tuning, we fix the pre-trained uni-modal encoders and update M3ISAs to enable efficient vision-language alignment for REC. Empirical results reveal that M2IST achieves better performance-efficiency trade-off than full fine-tuning and other PETL methods, requiring only 2.11\% tunable parameters, 39.61\% GPU memory, and 63.46\% training time while maintaining competitive performance. Our code is released at https://github.com/xuyang-liu16/M2IST.

cs.CV↗

arXiv2025

Gnothi Seauton: Empowering Faithful Self-Interpretability in Black-Box Transformers

The debate between self-interpretable models and post-hoc explanations for black-box models is central to Explainable AI (XAI). Self-interpretable models, such as concept-based networks, offer insights by connecting decisions to human-understandable concepts but often struggle with performance and scalability. Conversely, post-hoc methods like Shapley values, while theoretically robust, are computationally expensive and resource-intensive. To bridge the gap between these two lines of research, we propose a novel method that combines their strengths, providing theoretically guaranteed self-interpretability for black-box models without compromising prediction accuracy. Specifically, we introduce a parameter-efficient pipeline, AutoGnothi, which integrates a small side network into the black-box model, allowing it to generate Shapley value explanations without changing the original network parameters. This side-tuning approach significantly reduces memory, training, and inference costs, outperforming traditional parameter-efficient methods, where full fine-tuning serves as the optimal baseline. AutoGnothi enables the black-box model to predict and explain its predictions with minimal overhead. Extensive experiments show that AutoGnothi offers accurate explanations for both vision and language tasks, delivering superior computational efficiency with comparable interpretability.

cs.LG↗

arXiv2025

Non-Linear Analog Processing in MIMO Systems with Coarse Quantization

Analog to digital converters (ADCs) are a major contributor to the power consumption of multiple-input multiple-output (MIMO) receivers in large bandwidth millimeter-wave systems. Prior works have considered two mitigating solutions to reduce the ADC power consumption: i) decreasing the number of ADCs via analog and hybrid beamforming, and ii) decreasing the ADC resolution, i.e., utilizing one-bit and few-bit ADCs. These mitigating solutions lead to performance loss in terms of achievable rates due to increased quantization error. In this work, the use of nonlinear analog operators such as envelope detectors and polynomial operators, prior to sampling and quantization is considered, as a way to reduce the aforementioned rate-loss. The receiver architecture consists of linear combiners, nonlinear analog operators, and few-bit ADCs. The fundamental performance limits of the resulting communication system, in terms of achievable rates, are investigated under various assumptions on the set of implementable analog operators. Extensive numerical evaluations are provided to evaluate the set of achievable rates and the power consumption of the proposed receiver architectures. Circuit simulations and measurement results, based on both 22 nm FDSOI CMOS technology and 65 nm Bulk CMOS transistor technologies, are provided to justify the power efficiency of the proposed receiver architectures.

cs.IT↗

arXiv2025

Accelerating Diffusion Transformers with Token-wise Feature Caching

Diffusion transformers have shown significant effectiveness in both image and video synthesis at the expense of huge computation costs. To address this problem, feature caching methods have been introduced to accelerate diffusion transformers by caching the features in previous timesteps and reusing them in the following timesteps. However, previous caching methods ignore that different tokens exhibit different sensitivities to feature caching, and feature caching on some tokens may lead to 10$\times$ more destruction to the overall generation quality compared with other tokens. In this paper, we introduce token-wise feature caching, allowing us to adaptively select the most suitable tokens for caching, and further enable us to apply different caching ratios to neural layers in different types and depths. Extensive experiments on PixArt-$α$, OpenSora, and DiT demonstrate our effectiveness in both image and video generation with no requirements for training. For instance, 2.36$\times$ and 1.93$\times$ acceleration are achieved on OpenSora and PixArt-$α$ with almost no drop in generation quality.

cs.LG↗

arXiv2024

Perception- and Fidelity-aware Reduced-Reference Super-Resolution Image Quality Assessment

With the advent of image super-resolution (SR) algorithms, how to evaluate the quality of generated SR images has become an urgent task. Although full-reference methods perform well in SR image quality assessment (SR-IQA), their reliance on high-resolution (HR) images limits their practical applicability. Leveraging available reconstruction information as much as possible for SR-IQA, such as low-resolution (LR) images and the scale factors, is a promising way to enhance assessment performance for SR-IQA without HR for reference. In this letter, we attempt to evaluate the perceptual quality and reconstruction fidelity of SR images considering LR images and scale factors. Specifically, we propose a novel dual-branch reduced-reference SR-IQA network, \ie, Perception- and Fidelity-aware SR-IQA (PFIQA). The perception-aware branch evaluates the perceptual quality of SR images by leveraging the merits of global modeling of Vision Transformer (ViT) and local relation of ResNet, and incorporating the scale factor to enable comprehensive visual perception. Meanwhile, the fidelity-aware branch assesses the reconstruction fidelity between LR and SR images through their visual perception. The combination of the two branches substantially aligns with the human visual system, enabling a comprehensive SR image evaluation. Experimental results indicate that our PFIQA outperforms current state-of-the-art models across three widely-used SR-IQA benchmarks. Notably, PFIQA excels in assessing the quality of real-world SR images.

eess.IV↗

arXiv2024

DARA: Domain- and Relation-aware Adapters Make Parameter-efficient Tuning for Visual Grounding

Visual grounding (VG) is a challenging task to localize an object in an image based on a textual description. Recent surge in the scale of VG models has substantially improved performance, but also introduced a significant burden on computational costs during fine-tuning. In this paper, we explore applying parameter-efficient transfer learning (PETL) to efficiently transfer the pre-trained vision-language knowledge to VG. Specifically, we propose \textbf{DARA}, a novel PETL method comprising \underline{\textbf{D}}omain-aware \underline{\textbf{A}}dapters (DA Adapters) and \underline{\textbf{R}}elation-aware \underline{\textbf{A}}dapters (RA Adapters) for VG. DA Adapters first transfer intra-modality representations to be more fine-grained for the VG domain. Then RA Adapters share weights to bridge the relation between two modalities, improving spatial reasoning. Empirical results on widely-used benchmarks demonstrate that DARA achieves the best accuracy while saving numerous updated parameters compared to the full fine-tuning and other PETL methods. Notably, with only \textbf{2.13\%} tunable backbone parameters, DARA improves average accuracy by \textbf{0.81\%} across the three benchmarks compared to the baseline model. Our code is available at \url{https://github.com/liuting20/DARA}.

cs.CV↗

arXiv2024

VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders

Large-scale text-to-image diffusion models have shown impressive capabilities for generative tasks by leveraging strong vision-language alignment from pre-training. However, most vision-language discriminative tasks require extensive fine-tuning on carefully-labeled datasets to acquire such alignment, with great cost in time and computing resources. In this work, we explore directly applying a pre-trained generative diffusion model to the challenging discriminative task of visual grounding without any fine-tuning and additional training dataset. Specifically, we propose VGDiffZero, a simple yet effective zero-shot visual grounding framework based on text-to-image diffusion models. We also design a comprehensive region-scoring method considering both global and local contexts of each isolated proposal. Extensive experiments on RefCOCO, RefCOCO+, and RefCOCOg show that VGDiffZero achieves strong performance on zero-shot visual grounding. Our code is available at https://github.com/xuyang-liu16/VGDiffZero.

cs.CV↗

arXiv2024

Mass spectrum of $1^{--}$ heavy quarkonium

We calculate the masses and leptonic decay widths of the bottomonium $b\bar b$ and charmonium $c\bar c$ states in a constituent quark model where the Cornell-like potential and spin-dependent interaction are employed, with all model parameters predetermined by studying ground and first radial excited states of S- and P-wave heavy quarkonium mesons. By comparing the theoretical predictions for $J^{PC}=1^{--}$ quarkonium states with experimental data and considering possible mixtures of $nS$ and $(n-1)D$ states, we provide tentative assignments for all observed $J^{PC}=1^{--}$ heavy quarkonia. The work suggests that the $Υ$(10860) and $Υ$(11020) are $b\bar b$ $5S-4D$ mixture states, and the $ψ$(4360) and $ψ$(4415) are largely $4S$ and $3D$ $c\bar c$ states respectively. The $ψ$(4260) may not be accommodated with the conventional meson picture in the present work.

hep-ph↗

arXiv2023

Determination of parameters of a potential model for tetraquark study by studying all S-wave mesons

The masses of low-lying S-wave mesons are evaluated in a constituent quark model (CQM) where the Cornell-like potential and one-gluon exchange spin-spin interaction are employed. To make the model applicable to both the light and heavy quark sectors, we introduce mass-dependent coupling coefficients. There are four free parameters in the model, which are determined by comparing the theoretical results with experimental data. The established model with one set of parameters may be applied to study higher excited meson states as well as multiquark systems in both the light and heavy quark sectors.

hep-ph↗

arXiv2023

Study of light tetraquark spectroscopy

We calculate the masses of the $qq\bar q\bar q$ tetraquark ground state and first radial excited state in a constituent quark model where the Cornell-like potential and one-gluon exchange spin-spin coupling are employed. The three coupling parameters for the Cornell-like potential and one-gluon exchange spin-spin coupling are proposed mass-dependent in accordance with Lattice QCD data, and all model parameters are predetermined by studying light, charmed and bottom mesons. The theoretical predictions for light tetraquarks are compared with the observed exotic meson states in the light-unflavored meson sector, and tentative assignments are suggested. The work suggests that the $f_0(1500)$ and $f_0(1710)$ might be ground light tetraquark states with $J=0$.

hep-ph↗

arXiv2021

Study of charmonium-like and fully-charm tetraquark spectroscopy

The masses of tetraquark states of all $qc\bar q \bar c$ and $cc\bar c \bar c$ quark configurations are evaluated in a constituent quark model, where the Cornell-like potential and one-gluon exchange spin-spin coupling are employed. All model parameters are predetermined by comparing the theoretical and experimental masses of light, charmed and bottom mesons. The theoretical predictions of the charmoniumlike tetraquarks are compared with the observed $XYZ$ states, and one tentative assignment is suggested. The work suggests that the $X(6900)$ observed by LHCb is likely to be the first radial excited fully-charm tetraquark state with $J^{PC} = 1^{+-}$ in the $\bar 3_c \otimes 3_c$ configuration, and the ground and second radial excited states of fully-charm tetraquark are around $6494$ and $7253$ MeV respectively.

hep-ph↗

arXiv2020

Pentaquark components in low-lying baryon resonances

We study pentaquark states of both light $q^4\bar q$ and hidden heavy $q^3 Q\bar Q$ (q = u,d,s quark in SU(3) flavor symmetry; Q = c, b quark) systems with a general group theory approach in the constituent quark model, and the spectrum of light baryon resonances in the ansatz that the $l=1$ baryon states may consist of the $q^3$ as well as $q^4\bar q$ pentaquark component. The model is fitted to ground state baryons and light baryon resonances which are believed to be normal three-quark states. The work reveals that the $N(1535)1/2^{-}$ and $N(1520)3/2^-$ may consist of a large $q^4\bar q$ component while the $N(1895)1/2^{-}$ and $N(1875)3/2^-$ are respectively their partners, and the $N^+(1685)$ might be a $q^4\bar q$ state. By the way, a new set of color-spin-flavor-spatial wave function for $q^3 Q\bar Q$ systems in the compact pentaquark picture are constructed systematically for studying hidden charm pentaquark states.

hep-ph↗

arXiv2019

Complete basis for the pentaquark wave function in a group theory approach

Permutation groups are applied to analyze the symmetries of pentaquark states. All possible quark configurations of the color, flavor, spin and spatial degrees of freedom are worked out in the language of permutation groups, and the corresponding wave functions are constructed systematically in the form of a Yamanouchi basis. The pentaquark spatial wave functions of various symmetries, which are derived in the harmonic-oscillator interaction, are applied as complete bases to evaluate the low-lying light $q^4\overline q$ pentaquark mass of all configurations, where the Cornell-like potential is employed.

hep-ph↗

arXiv2019

Contributions of box diagrams and $Δ(1940)$ resonance to $K^0Σ^+$ photoproduction

We study first the box-diagram contribution to the $γp\,\rightarrow \,K^0Σ^+$ process to understand the anomaly of the kaon photoproduction cross section from CBELSA/TAPS experiment at Electron Stretcher Accelerator (ELSA), where the imaginary part of the scattering amplitude from the box-diagrams is calculated by using Cutkosky's rules in the on-shell approximation while the real part of the amplitude is derived by dispersion relation calculations. Together with the results of the K-MAID model, the contribution of the box-diagrams fails to provide the sudden drop of the differential cross-section between the $K^*\,Λ$ and $K^*\,Σ$ thresholds. In addition, we include the $Δ(1940)$ resonance in the process to complete the description of the differential cross-section. Combining the contributions from the K-MAID model, the box-diagrams and the $Δ(1940)$ resonance, we have obtained the theoretical differential cross-section the $γp\,\rightarrow \,K^0Σ^+$ process, which is compatible with the CBELSA/TAPS experimental data.

hep-ph↗

arXiv2017

Large-$N_c$ operator analysis of hyperon-nucleon interactions in SU(3) chiral effective field theory

We study octet-octet baryon ($J^P = {\textstyle \frac12}^+$) contact interactions in SU(3) chiral effective field theory by using large-$N_c$ operator analysis. Applying the $1/N_c$ expansion of the Hartee Hamiltonian, we find 15 operators in the octet-octet baryon potential where 4 operators for leading order (LO) and 11 for and net-to-next-to-leading order (NNLO). The large-$N_c$ operator analysis of octet-octet baryon matrix elements reduces the number of free parameters from 15 to 6 at LO of the $1/N_c$ expansion. The application of large-$N_c$ sum rules to the Jülich model of hyperon-nucleon (YN) interactions at the LO of the chiral expansion reduces the model parameters to 3 from 5 at the LO of $1/N_c$ expansion. We find that the values of LECs fitted to YN scattering data in Ref. \cite{Li:2016paq} in the relativistic covariant ChEFT (EG) approach is more consistent with the predictions of large-$N_c$ than in the heavy baryon (HB) formalism approach.

hep-ph↗

arXiv2017

Cosmological dynamics of magnetic Bianchi I in viable $f(R)$ models of gravity

Standard dynamical system analysis of Einstein-Maxwell equation in $f(R)$ theories is considered in this work. We investigate cosmological dynamics of a uniform magnetic field in the Orthogonal Spatially Homogeneous (OSH) Bianchi type I universe with viable $f(R)$ models of gravity. In this work, the $f(R) = R -αR^n$ and $f(R) = \left( R^b - Λ\right)^c$ models are examined by using our dynamical system analysis. Our results show that both of two $f(R)$ models have a viable cosmological consequence identical to the analysis present in Ref.\cite{Amendola:2007nt} for the FLRW background. Contrary to Ref.\cite{Amendola:2007nt}, we discover in our models that there is an additional anisotropic and non-zero cosmological magnetic fields fixed point emerging before the present of the standard matter epoch. This means that the universe has initially isotropic stage with the intermediated epoch as the anisotropic background and it ends up with the isotropic late-time acceleration. The primordial magnetic fields play a crucial role of the shear evolutions obtained from these two models which have the same scaling of the cosmic time as $σ\sim t^{-\frac13}$, instead of $σ\sim t^{-1}$ for the absence of the primordial magnetic cases.

gr-qc↗