arXiv subjects

Tianyu Jiang

Publications and source records attributed to Tianyu Jiang.

At least 37 records · Page 2Linked to original sources

arXiv2026

A Computational Approach to Visual Metonymy

Images often communicate more than they literally depict: a set of tools can suggest an occupation and a cultural artifact can suggest a tradition. This kind of indirect visual reference, known as visual metonymy, invites viewers to recover a target concept via associated cues rather than explicit depiction. In this work, we present the first computational investigation of visual metonymy. We introduce a novel pipeline grounded in semiotic theory that leverages large language models and text-to-image models to generate metonymic visual representations. Using this framework, we construct ViMET, the first visual metonymy dataset comprising 2,000 multiple-choice questions to evaluate the cognitive reasoning abilities in multimodal language models. Experimental results on our dataset reveal a significant gap between human performance (86.9%) and state-of-the-art vision-language models (65.9%), highlighting limitations in machines' ability to interpret indirect visual references. Our dataset is publicly available at: https://github.com/cincynlp/ViMET.

cs.CL↗

arXiv2025

Fast Time-Varying mmWave MIMO Channel Estimation and Reconstruction: An Efficient Rank-Aware Matrix Completion Method

We address the problem of fast time-varying channel estimation in millimeter-wave (mmWave) MIMO systems with imperfect channel state information (CSI) and facilitate efficient channel reconstruction. Specifically, leveraging the low-rank and sparse characteristics of the mmWave channel matrix, a two-phase rank-aware compressed sensing framework is proposed for efficient channel estimation and reconstruction. In the first phase, a robust rank-one matrix completion (R1MC) algorithm is used to reconstruct part of the observed channel matrix through low-rank matrix completion (LRMC). To address abrupt rank changes caused by user mobility, a discrete-time autoregressive (AR) model is established that leverages temporal rank correlations across consecutive time instances to enable adaptive observation matrix completion, thereby improving estimation accuracy under dynamic conditions. In the second phase, a rank-aware block orthogonal matching pursuit (RA-BOMP) algorithm is developed for sparse channel recovery with low computational complexity. Furthermore, a rank-aware measurement matrix design is introduced to improve angle estimation accuracy. Simulation results demonstrate that, compared with existing benchmark algorithms, the proposed approach achieves superior channel estimation performance while significantly reducing computational complexity and training overhead.

eess.SP↗

arXiv2025

Fast Time-Varying mmWave Channel Estimation: A Rank-Aware Matrix Completion Approach

We consider the problem of high-dimensional channel estimation in fast time-varying millimeter-wave MIMO systems with a hybrid architecture. By exploiting the low-rank and sparsity properties of the channel matrix, we propose a two-phase compressed sensing framework consisting of observation matrix completion and channel matrix sparse recovery, respectively. First, we formulate the observation matrix completion problem as a low-rank matrix completion (LRMC) problem and develop a robust rank-one matrix completion (R1MC) algorithm that enables the matrix and its rank to iteratively update. This approach achieves high-precision completion of the observation matrix and explicit rank estimation without prior knowledge. Second, we devise a rank-aware batch orthogonal matching pursuit (OMP) method for achieving low-latency sparse channel recovery. To handle abrupt rank changes caused by user mobility, we establish a discrete-time autoregressive (AR) model that leverages the temporal rank correlation between continuous-time instances to obtain a complete observation matrix capable of perceiving rank changes for more accurate channel estimates. Simulation results confirm the effectiveness of the proposed channel estimation frame and demonstrate that our algorithms achieve state-of-the-art performance in low-rank matrix recovery with theoretical guarantees.

eess.SP↗

arXiv2025

Can AI agents understand spoken conversations about data visualizations in online meetings?

In this short paper, we present work evaluating an AI agent's understanding of spoken conversations about data visualizations in an online meeting scenario. There is growing interest in the development of AI-assistants that support meetings, such as by providing assistance with tasks or summarizing a discussion. The quality of this support depends on a model that understands the conversational dialogue. To evaluate this understanding, we introduce a dual-axis testing framework for diagnosing the AI agent's comprehension of spoken conversations about data. Using this framework, we designed a series of tests to evaluate understanding of a novel corpus of 72 spoken conversational dialogues about data visualizations. We examine diverse pipelines and model architectures, LLM vs VLM, and diverse input formats for visualizations (the chart image, its underlying source code, or a hybrid of both) to see how this affects model performance on our tests. Using our evaluation methods, we found that text-only input modalities achieved the best performance (96%) in understanding discussions of visualizations in online meetings.

cs.HC↗

arXiv2025

GuessingGame: Measuring the Informativeness of Open-Ended Questions in Large Language Models

We introduce GuessingGame, a protocol for evaluating large language models (LLMs) as strategic question-askers in open-ended, open-domain settings. A Guesser LLM identifies a hidden object by posing free-form questions to an Oracle without predefined choices or candidate lists. To measure question quality, we propose two information gain (IG) metrics: a Bayesian method that tracks belief updates over semantic concepts using LLM-scored relevance, and an entropy-based method that filters candidates via ConceptNet. Both metrics are model-agnostic and support post hoc analysis. Across 858 games with multiple models and prompting strategies, higher IG strongly predicts efficiency: a one-standard-deviation IG increase reduces expected game length by 43\%. Prompting constraints guided by IG, such as enforcing question diversity, enable weaker models to significantly improve performance. These results show that question-asking in LLMs is both measurable and improvable, and crucial for interactive reasoning.

cs.CL↗

arXiv2025

Anatomy of a Feeling: Narrating Embodied Emotions via Large Vision-Language Models

The embodiment of emotional reactions from body parts contains rich information about our affective experiences. We propose a framework that utilizes state-of-the-art large vision-language models (LVLMs) to generate Embodied LVLM Emotion Narratives (ELENA). These are well-defined, multi-layered text outputs, primarily comprising descriptions that focus on the salient body parts involved in emotional reactions. We also employ attention maps and observe that contemporary models exhibit a persistent bias towards the facial region. Despite this limitation, we observe that our employed framework can effectively recognize embodied emotions in face-masked images, outperforming baselines without any fine-tuning. ELENA opens a new trajectory for embodied emotion analysis across the modality of vision and enriches modeling in an affect-aware setting.

cs.CL↗

arXiv2025

Do LLMs Encode Frame Semantics? Evidence from Frame Identification

We investigate whether large language models encode latent knowledge of frame semantics, focusing on frame identification, a core challenge in frame semantic parsing that involves selecting the appropriate semantic frame for a target word in context. Using the FrameNet lexical resource, we evaluate models under prompt-based inference and observe that they can perform frame identification effectively even without explicit supervision. To assess the impact of task-specific training, we fine-tune the model on FrameNet data, which substantially improves in-domain accuracy while generalizing well to out-of-domain benchmarks. Further analysis shows that the models can generate semantically coherent frame definitions, highlighting the model's internalized understanding of frame semantics.

cs.CL↗

arXiv2025

AI-Based Impedance Encoding-Decoding Method for Online Impedance Network Construction of Wind Farms

The impedance network (IN) model is gaining popularity in the oscillation analysis of wind farms. However, the construction of such an IN model requires impedance curves of each wind turbine under their respective operating conditions, making its online application difficult due to the transmission of numerous high-density impedance curves. To address this issue, this paper proposes an AI-based impedance encoding-decoding method to facilitate the online construction of IN model. First, an impedance encoder is trained to compress impedance curves by setting the number of neurons much smaller than that of frequency points. Then, the compressed data of each turbine are uploaded to the wind farm and an impedance decoder is trained to reconstruct original impedance curves. At last, based on the nodal admittance matrix (NAM) method, the IN model of the wind farm can be obtained. The proposed method is validated via model training and real-time simulations, demonstrating that the encoded impedance vectors enable fast transmission and accurate reconstruction of the original impedance curves.

eess.SP↗

arXiv2025

CHEER-Ekman: Fine-grained Embodied Emotion Classification

Emotions manifest through physical experiences and bodily reactions, yet identifying such embodied emotions in text remains understudied. We present an embodied emotion classification dataset, CHEER-Ekman, extending the existing binary embodied emotion dataset with Ekman's six basic emotion categories. Using automatic best-worst scaling with large language models, we achieve performance superior to supervised approaches on our new dataset. Our investigation reveals that simplified prompting instructions and chain-of-thought reasoning significantly improve emotion recognition accuracy, enabling smaller models to achieve competitive performance with larger ones. Our dataset is publicly available at: https://github.com/menamerai/cheer-ekman.

cs.CL↗

arXiv2025

Slow, Nanometer Light Confinement Observed in Atomically Thin TaS2

Extreme light confinement down to the atomic scale has been theoretically predicted for ultrathin, Ta-based transition metal dichalcogenides (TMDs). In this work, we experimentally demonstrate in 2H-TaS$_2$ monolayers and bilayers a lateral confinement ratio up to 300 at large wave vectors of $q = 0.15 \, Å^{-1}$, and slow light behaviour with a group velocity $\sim 10^{-4}c$. Quantitative momentum-resolved electron energy loss spectroscopy (q-EELS) with a momentum resolution of $0.0056 \, Å^{-1}$ was used as a platform for the nanoscale optical measurements. With it, momentum-dispersed, two-dimensional (2D) plasmon resonances were experimentally observed, showing a transition from 2D to 3D Coulomb interaction in the high-momentum regime, equivalent to light confinement volumes of $1\text{-}2 \, \text{nm}^3$. Remarkably, the resonant modes do not enter the electron-hole continuum, predicting even further enhanced optical field confinements for this material at cryogenic temperatures.

cond-mat.mtrl-sci↗

arXiv2025

ConMeC: A Dataset for Metonymy Resolution with Common Nouns

Metonymy plays an important role in our daily communication. People naturally think about things using their most salient properties or commonly related concepts. For example, by saying "The bus decided to skip our stop today," we actually mean that the bus driver made the decision, not the bus. Prior work on metonymy resolution has mainly focused on named entities. However, metonymy involving common nouns (such as desk, baby, and school) is also a frequent and challenging phenomenon. We argue that NLP systems should be capable of identifying the metonymic use of common nouns in context. We create a new metonymy dataset ConMeC, which consists of 6,000 sentences, where each sentence is paired with a target common noun and annotated by humans to indicate whether that common noun is used metonymically or not in that context. We also introduce a chain-of-thought based prompting method for detecting metonymy using large language models (LLMs). We evaluate our LLM-based pipeline, as well as a supervised BERT model on our dataset and three other metonymy datasets. Our experimental results demonstrate that LLMs could achieve performance comparable to the supervised BERT model on well-defined metonymy categories, while still struggling with instances requiring nuanced semantic understanding. Our dataset is publicly available at: https://github.com/SaptGhosh/ConMeC.

cs.CL↗

arXiv2024

FACOS: Enabling Privacy Protection Through Fine-Grained Access Control with On-chain and Off-chain System

Data-driven landscape across finance, government, and healthcare, the continuous generation of information demands robust solutions for secure storage, efficient dissemination, and fine-grained access control. Blockchain technology emerges as a significant tool, offering decentralized storage while upholding the tenets of data security and accessibility. However, on-chain and off-chain strategies are still confronted with issues such as untrusted off-chain data storage, absence of data ownership, limited access control policy for clients, and a deficiency in data privacy and auditability. To solve these challenges, we propose a permissioned blockchain-based privacy-preserving fine-grained access control on-chain and off-chain system, namely FACOS. We applied three fine-grained access control solutions and comprehensively analyzed them in different aspects, which provides an intuitive perspective for system designers and clients to choose the appropriate access control method for their systems. Compared to similar work that only stores encrypted data in centralized or non-fault-tolerant IPFS systems, we enhanced off-chain data storage security and robustness by utilizing a highly efficient and secure asynchronous Byzantine fault tolerance (BFT) protocol in the off-chain environment. As each of the clients needs to be verified and authorized before accessing the data, we involved the Trusted Execution Environment (TEE)-based solution to verify the credentials of clients. Additionally, our evaluation results demonstrated that our system offers better scalability and practicality than other state-of-the-art designs.

cs.CR↗

arXiv2023

DONNAv2 -- Lightweight Neural Architecture Search for Vision tasks

With the growing demand for vision applications and deployment across edge devices, the development of hardware-friendly architectures that maintain performance during device deployment becomes crucial. Neural architecture search (NAS) techniques explore various approaches to discover efficient architectures for diverse learning tasks in a computationally efficient manner. In this paper, we present the next-generation neural architecture design for computationally efficient neural architecture distillation - DONNAv2 . Conventional NAS algorithms rely on a computationally extensive stage where an accuracy predictor is learned to estimate model performance within search space. This building of accuracy predictors helps them predict the performance of models that are not being finetuned. Here, we have developed an elegant approach to eliminate building the accuracy predictor and extend DONNA to a computationally efficient setting. The loss metric of individual blocks forming the network serves as the surrogate performance measure for the sampled models in the NAS search stage. To validate the performance of DONNAv2 we have performed extensive experiments involving a range of diverse vision tasks including classification, object detection, image denoising, super-resolution, and panoptic perception network (YOLOP). The hardware-in-the-loop experiments were carried out using the Samsung Galaxy S10 mobile platform. Notably, DONNAv2 reduces the computational cost of DONNA by 10x for the larger datasets. Furthermore, to improve the quality of NAS search space, DONNAv2 leverages a block knowledge distillation filter to remove blocks with high inference costs.

cs.CV↗

arXiv2023

Classifying Organizations for Food System Ontologies using Natural Language Processing

Our research explores the use of natural language processing (NLP) methods to automatically classify entities for the purpose of knowledge graph population and integration with food system ontologies. We have created NLP models that can automatically classify organizations with respect to categories associated with environmental issues as well as Standard Industrial Classification (SIC) codes, which are used by the U.S. government to characterize business activities. As input, the NLP models are provided with text snippets retrieved by the Google search engine for each organization, which serves as a textual description of the organization that is used for learning. Our experimental results show that NLP models can achieve reasonably good performance for these two classification tasks, and they rely on a general framework that could be applied to many other classification problems as well. We believe that NLP models represent a promising approach for automatically harvesting information to populate knowledge graphs and aligning the information with existing ontologies through shared categories and concepts.

cs.CL↗

arXiv2021

Multiple Graph Learning for Scalable Multi-view Clustering

Graph-based multi-view clustering has become an active topic due to the efficiency in characterizing both the complex structure and relationship between multimedia data. However, existing methods have the following shortcomings: (1) They are inefficient or even fail for graph learning in large scale due to the graph construction and eigen-decomposition. (2) They cannot well exploit both the complementary information and spatial structure embedded in graphs of different views. To well exploit complementary information and tackle the scalability issue plaguing graph-based multi-view clustering, we propose an efficient multiple graph learning model via a small number of anchor points and tensor Schatten p-norm minimization. Specifically, we construct a hidden and tractable large graph by anchor graph for each view and well exploit complementary information embedded in anchor graphs of different views by tensor Schatten p-norm regularizer. Finally, we develop an efficient algorithm, which scales linearly with the data size, to solve our proposed model. Extensive experimental results on several datasets indicate that our proposed method outperforms some state-of-the-art multi-view clustering algorithms.

cs.CV↗

arXiv2021

VLBI data processing on coronal radio-sounding experiments of Mars express

The ESA's Mars Express solar corona experiments were performed at two solar conjunctions in the years 2015 and 2017 by a number of radio telescopes in the European VLBI Network. This paper presents the methods to measure the frequency and phase fluctuations of the spacecraft radio signal, and the applications to study the characteristics of the plasma turbulence effects on the signal at a single station and at multiple stations via cross-correlation. The power spectra of the frequency fluctuations observed between 4.9 and 76.3 $\rm R_{s}$ have a power-law shape close to a Kolmogorov spectrum over the frequency interval $ ν_{lo}< ν<ν_{up}$, where the nominal value of $ν_{lo}$ is set to 3 mHz and $ν_{up}$ is in the range of 0.03 $\sim$ 0.15 Hz. The RMS of the frequency fluctuations is presented as a function of the heliocentric distance. Furthermore, we analyse the variations of the electron column density fluctuations at solar offsets 4.9 $\rm{R_{s}}$ and 9.9 $\rm{R_{s}}$ and the cross-correlation products between the VLBI stations. The power density of the differential fluctuations between different stations decreases at $ν< 0.01$ Hz. Finally, the fast flow speeds of solar wind $>700$ $\rm{km~s^{-1}}$ are derived from the cross-correlation of frequency fluctuations at $ν< 0.01$ Hz. The fast flow speeds of solar wind correspond to the high heliolatitude of the coronal region that the radio rays passed. The VLBI observations and analysis methods can be used to study the electron column density fluctuations and the turbulence at multiple spatial points in the inner solar wind by providing multiple lines of sight between the Earth and the spacecraft.

astro-ph.IM↗

arXiv2018

Current status of Shanghai VLBI correlator

Shanghai Astronomical Observatory has upgraded its DiFX cluster to 420 CPU cores and a 432-TB storage system at the end of 2014. An international network connection for the raw data transfer has also been established. The routine operations for IVS sessions including CRF, AOV, and APSG series began in early 2015. In addition to the IVS observations, the correlator is dedicated to astrophysical and astrometric programs with the Chinese VLBI Network and international joint VLBI observations. It also worked with the new-built Tianma 65-m radio telescope and successfully found fringes as high as at X/Ka and Q bands in late 2015. A more powerful platform is planned for the high data rate and massive data correlation tasks in the future.

astro-ph.IM↗

arXiv2017

VLBI ecliptic plane survey: VEPS-1

We present here the results of the first part of the VLBI Ecliptic Plane Survey (VEPS) program. The goal of the program is to find all compact sources within $7.5^\circ$ of the ecliptic plane which are suitable as calibrators for anticipated phase referencing observations of spacecraft and determine their positions with accuracy at the 1.5~nrad level. We run the program in two modes: the search mode and the refining mode. In the search mode, a complete sample of all sources brighter than 50 mJy at 5 GHz listed in the Parkes-MIT-NRAO (PMN) and Green Bank 6~cm (GB6) catalogs, except those previously detected with VLBI, is observed. In the refining mode, the positions of all ecliptic plane sources, including those found in the search mode, are improved. By October 2016, thirteen 24-hr sessions that targeted all sources brighter than 100~mJy have been observed and analyzed. Among 3320 observed target sources, 555 objects have been detected. We also conducted a number of follow-up VLBI experiments in the refining mode and improved the positions of 249 ecliptic plane sources.

astro-ph.IM↗