arXiv subjects

Yan Li

Publications and source records attributed to Yan Li.

At least 217 records · Page 12Linked to original sources

arXiv2025

UniAPO: Unified Multimodal Automated Prompt Optimization

Prompting is fundamental to unlocking the full potential of large language models. To automate and enhance this process, automatic prompt optimization (APO) has been developed, demonstrating effectiveness primarily in text-only input scenarios. However, extending existing APO methods to multimodal tasks, such as video-language generation introduces two core challenges: (i) visual token inflation, where long visual token sequences restrict context capacity and result in insufficient feedback signals; (ii) a lack of process-level supervision, as existing methods focus on outcome-level supervision and overlook intermediate supervision, limiting prompt optimization. We present UniAPO: Unified Multimodal Automated Prompt Optimization, the first framework tailored for multimodal APO. UniAPO adopts an EM-inspired optimization process that decouples feedback modeling and prompt refinement, making the optimization more stable and goal-driven. To further address the aforementioned challenges, we introduce a short-long term memory mechanism: historical feedback mitigates context limitations, while historical prompts provide directional guidance for effective prompt optimization. UniAPO achieves consistent gains across text, image, and video benchmarks, establishing a unified framework for efficient and transferable prompt optimization.

cs.CV↗

arXiv2025

ChuLo: Chunk-Level Key Information Representation for Long Document Understanding

Transformer-based models have achieved remarkable success in various Natural Language Processing (NLP) tasks, yet their ability to handle long documents is constrained by computational limitations. Traditional approaches, such as truncating inputs, sparse self-attention, and chunking, attempt to mitigate these issues, but they often lead to information loss and hinder the model's ability to capture long-range dependencies. In this paper, we introduce ChuLo, a novel chunk representation method for long document understanding that addresses these limitations. Our ChuLo groups input tokens using unsupervised keyphrase extraction, emphasizing semantically important keyphrase based chunks to retain core document content while reducing input length. This approach minimizes information loss and improves the efficiency of Transformer-based models. Preserving all tokens in long document understanding, especially token classification tasks, is important to ensure that fine-grained annotations, which depend on the entire sequence context, are not lost. We evaluate our method on multiple long document classification tasks and long document token classification tasks, demonstrating its effectiveness through comprehensive qualitative and quantitative analysis. Our implementation is open-sourced on https://github.com/adlnlp/Chulo.

cs.CL↗

arXiv2025

MUSE: Multi-Subject Unified Synthesis via Explicit Layout Semantic Expansion

Existing text-to-image diffusion models have demonstrated remarkable capabilities in generating high-quality images guided by textual prompts. However, achieving multi-subject compositional synthesis with precise spatial control remains a significant challenge. In this work, we address the task of layout-controllable multi-subject synthesis (LMS), which requires both faithful reconstruction of reference subjects and their accurate placement in specified regions within a unified image. While recent advancements have separately improved layout control and subject synthesis, existing approaches struggle to simultaneously satisfy the dual requirements of spatial precision and identity preservation in this composite task. To bridge this gap, we propose MUSE, a unified synthesis framework that employs concatenated cross-attention (CCA) to seamlessly integrate layout specifications with textual guidance through explicit semantic space expansion. The proposed CCA mechanism enables bidirectional modality alignment between spatial constraints and textual descriptions without interference. Furthermore, we design a progressive two-stage training strategy that decomposes the LMS task into learnable sub-objectives for effective optimization. Extensive experiments demonstrate that MUSE achieves zero-shot end-to-end generation with superior spatial accuracy and identity consistency compared to existing solutions, advancing the frontier of controllable image synthesis. Our code and model are available at https://github.com/pf0607/MUSE.

cs.CV↗

arXiv2025

Co-Paced Learning Strategy Based on Confidence for Flying Bird Object Detection Model Training

The flying bird objects captured by surveillance cameras exhibit varying levels of recognition difficulty due to factors such as their varying sizes or degrees of similarity to the background. To alleviate the negative impact of hard samples on training the Flying Bird Object Detection (FBOD) model for surveillance videos, we propose the Co-Paced Learning strategy Based on Confidence (CPL-BC) and apply it to the training process of the FBOD model. This strategy involves maintaining two models with identical structures but different initial parameter configurations that collaborate with each other to select easy samples for training, where the prediction confidence exceeds a set threshold. As training progresses, the strategy gradually lowers the threshold, thereby gradually enhancing the model's ability to recognize objects, from easier to more hard ones. Prior to applying CPL-BC, we pre-trained the two FBOD models to equip them with the capability to assess the difficulty of flying bird object samples. Experimental results on two different datasets of flying bird objects in surveillance videos demonstrate that, compared to other model learning strategies, CPL-BC significantly improves detection accuracy, thereby verifying the method's effectiveness and advancement.

cs.CV↗

arXiv2025

A Steel Surface Defect Detection Method Based on Lightweight Convolution Optimization

Surface defect detection of steel, especially the recognition of multi-scale defects, has always been a major challenge in industrial manufacturing. Steel surfaces not only have defects of various sizes and shapes, which limit the accuracy of traditional image processing and detection methods in complex environments. However, traditional defect detection methods face issues of insufficient accuracy and high miss-detection rates when dealing with small target defects. To address this issue, this study proposes a detection framework based on deep learning, specifically YOLOv9s, combined with the C3Ghost module, SCConv module, and CARAFE upsampling operator, to improve detection accuracy and model performance. First, the SCConv module is used to reduce feature redundancy and optimize feature representation by reconstructing the spatial and channel dimensions. Second, the C3Ghost module is introduced to enhance the model's feature extraction ability by reducing redundant computations and parameter volume, thereby improving model efficiency. Finally, the CARAFE upsampling operator, which can more finely reorganize feature maps in a content-aware manner, optimizes the upsampling process and ensures detailed restoration of high-resolution defect regions. Experimental results demonstrate that the proposed model achieves higher accuracy and robustness in steel surface defect detection tasks compared to other methods, effectively addressing defect detection problems.

eess.IV↗

arXiv2025

Multi-View Clustering Meets Heterogenous Data: A Fusion Regularized Method

Multi-view clustering leverages consistent and complementary information across multiple views to provide more comprehensive insights than single-view analysis. However, the heterogeneity and redundancy of multi-view data pose significant challenges to the existing clustering techniques. To tackle these challenges effectively, this paper proposes a novel multi-view fusion regularized clustering method with adaptive group sparsity, enabling discriminative clustering while capturing informative features. Technically, for heterogeneous multi-view data with mixed-type feature sets, different losses or divergence metrics are considered with a joint fusion penalty to obtain consistent cluster structures. Moreover, the non-convex group sparsity consisting of inter-group sparsity and intra-group sparsity is utilized to eliminate redundant features, thereby enhancing the robustness. Furthermore, we develop an effective alternating direction method of multipliers (ADMM), where all subproblems can be solved in closed form. Extensive numerical experiments on real data validate the superior performance of our presented method in clustering accuracy and feature selection.

math.OC↗

arXiv2025

Embodied Intelligence for 3D Understanding: A Survey on 3D Scene Question Answering

3D Scene Question Answering (3D SQA) represents an interdisciplinary task that integrates 3D visual perception and natural language processing, empowering intelligent agents to comprehend and interact with complex 3D environments. Recent advances in large multimodal modelling have driven the creation of diverse datasets and spurred the development of instruction-tuning and zero-shot methods for 3D SQA. However, this rapid progress introduces challenges, particularly in achieving unified analysis and comparison across datasets and baselines. In this survey, we provide the first comprehensive and systematic review of 3D SQA. We organize existing work from three perspectives: datasets, methodologies, and evaluation metrics. Beyond basic categorization, we identify shared architectural patterns across methods. Our survey further synthesizes core limitations and discusses how current trends, such as instruction tuning, multimodal alignment, and zero-shot, can shape future developments. Finally, we propose a range of promising research directions covering dataset construction, task generalization, interaction modeling, and unified evaluation protocols. This work aims to serve as a foundation for future research and foster progress toward more generalizable and intelligent 3D SQA systems.

cs.CV↗

arXiv2025

Gradient-Boosted Pseudo-Weighting: Methods for Population Inference from Nonprobability samples

Nonprobability samples have rapidly emerged to address time-sensitive priority topics in a variety of fields. While these data are timely, they are prone to selection bias. To mitigate selection bias, a large number of survey research literature has explored the use of propensity score (PS) adjustment methods to enhance population representativeness of nonprobability samples, using probability-based survey samples as external references. A recent advancement, the 2-step PS-based pseudo-weighting adjustment method (2PS, Li 2024), has been shown to improve upon recent developments with respect to mean squared error. However, the effectiveness of these methods in reducing bias critically depends on the ability of the underlying propensity model to accurately reflect the true selection process, which is challenging with parametric regression. In this study, we propose a set of pseudo-weight construction methods, which utilize gradient boosting methods (GBM) to estimate PSs in 2PS to construct pseudo-weights, offering greater flexibility compared to logistic regression-based methods. We compare the proposed GBM-based pseudo-weights with existing methods, including 2PS. The population mean estimators are evaluated via Monte Carlo simulation studies. We also evaluated prevalence of various health outcomes, including 15-year mortality, using 1988 ~ 1994 NHANES III as a nonprobability sample and the 1994 NHIS as the reference survey.

stat.ME↗

arXiv2025

Principle-Guided Verilog Optimization: IP-Safe Knowledge Transfer via Local-Cloud Collaboration

Recent years have witnessed growing interest in adopting large language models (LLMs) for Register Transfer Level (RTL) code optimization. While powerful cloud-based LLMs offer superior optimization capabilities, they pose unacceptable intellectual property (IP) leakage risks when processing proprietary hardware designs. In this paper, we propose a new scenario where Verilog code must be optimized for specific attributes without leaking sensitive IP information. We introduce the first IP-preserving edge-cloud collaborative framework that leverages the benefits of both paradigms. Our approach employs local small LLMs (e.g., Qwen-2.5-Coder-7B) to perform secure comparative analysis between paired high-quality target designs and novice draft codes, yielding general design principles that summarize key insights for improvements. These principles are then used to query stronger cloud LLMs (e.g., Deepseek-V3) for targeted code improvement, ensuring that only abstracted and IP-safe guidance reaches external services. Our experimental results demonstrate that the framework achieves significantly higher optimization success rates compared to baseline methods. For example, combining Qwen-2.5-Coder-7B and Deepseek-V3 achieves a 66.67\% optimization success rate for power utilization, outperforming Deepseek-V3 alone (49.81\%) and even commercial models like GPT-4o (55.81\%). Further investigation of local and cloud LLM combinations reveals that different model pairings exhibit varying strengths for specific optimization objectives, with interesting trends emerging when varying the number of comparative code pairs. Our work establishes a new paradigm for secure hardware design optimization that balances performance gains with IP protection.

cs.CR↗

arXiv2025

Effect of Matter Accretion on Lithium Enhancement of Giants

A subset of low-mass giants ($<2.2\,M_{\odot}$) exhibit anomalous lithium enhancement behavior, which is still an open topic. Given that more massive giants retain more surface lithium, increasing mass by accreting circumstellar matter could be a channel to enrich lithium. We evaluate this process in the current work. Using MESA, we construct a model of matter accretion, including mass loss, that evolves a star from the main sequence turnoff to the red giant branch tip. The mean accretion rate is estimated from the upper limit of the accreted mass and the evolutionary time of the star during this period, and a grid of accretion rates is constructed. We separately consider their effects on the lithium enhancement of giants, both in terms of the mass and the composition of accretion. Accreting matter with higher lithium abundances has a promoting effect on the lithium enhancement of giants. The accreted matter with excess lithium alleviates the dilution of lithium in the convective envelope during the first dredge-up. The added mass results in lower temperatures at the bottom of the convective envelope, which likewise weakens the depletion of surface lithium. Weak accretion of circumstellar matter is a possible route to lithium enhancement for giants, and it predicts an upper limit on the lithium abundance of $\rm \sim 2.5\,dex$. However, the mass increment it requires poses a potential challenge to real astrophysical environments. Such accretion suppresses lithium dilution and depletion of the star during the first dredge-up, thus exhibiting lithium enhancement behavior.

astro-ph.SR↗

arXiv2025

A reference frame-based microgrid primary control for ensuring global convergence to a periodic orbit

Power systems with a high penetration of renewable generation are vulnerable to frequency oscillation and voltage instability. Traditionally, the stability of power systems is considered either in terms of local stability or as an angle oscillator synchronization problem with the simplifying assumption that the dynamics of the amplitudes are on much shorter time scales. Without this assumption, however, the steady state being studied is essentially a limit cycle with the convergence of its orbit in question. In this paper, we present a method to analyze the orbital stability of a microgrid and propose a voltage controller for the inverter-interfaced renewable generators. The main hurdle to the problem lies in the constant terms in the rotating internal reference frames of each generator. We extend the shifted passivity of port-Hamiltonian systems to the analysis of limit cycles and prove that, if the system is shifted passive without considering these constant terms, then the periodic orbit is globally attractive. To the best of our knowledge, this is the first global stability result for non-nominal steady states of the microgrid in the full state space, which provides new insights into the synchronization phenomenon where the dissipativity of the system ensures convergence. The proposed controller is verified with a test microgrid, demonstrating its stability and transient smoothness compared to the standard droop control.

eess.SY↗

arXiv2025

Who Owns This Sample: Cross-Client Membership Inference Attack in Federated Graph Neural Networks

Graph-structured data is prevalent in many real-world applications, including social networks, financial systems, and molecular biology. Graph Neural Networks (GNNs) have become the de facto standard for learning from such data due to their strong representation capabilities. As GNNs are increasingly deployed in federated learning (FL) settings to preserve data locality and privacy, new privacy threats arise from the interaction between graph structures and decentralized training. In this paper, we present the first systematic study of cross-client membership inference attacks (CC-MIA) against node classification tasks of federated GNNs (FedGNNs), where a malicious client aims to infer which client owns the given data. Unlike prior centralized-focused work that focuses on whether a sample was included in training, our attack targets sample-to-client attribution, a finer-grained privacy risk unique to federated settings. We design a general attack framework that exploits FedGNNs' aggregation behaviors, gradient updates, and embedding proximity to link samples to their source clients across training rounds. We evaluate our attack across multiple graph datasets under realistic FL setups. Results show that our method achieves high performance on both membership inference and ownership identification. Our findings highlight a new privacy threat in federated graph learning-client identity leakage through structural and model-level cues, motivating the need for attribution-robust GNN design.

cs.LG↗

arXiv2025

Scheduzz: Constraint-based Fuzz Driver Generation with Dual Scheduling

Fuzzing a library requires experts to understand the library usage well and craft high-quality fuzz drivers, which is tricky and tedious. Therefore, many techniques have been proposed to automatically generate fuzz drivers. However, they fail to generate rational fuzz drivers due to the lack of adherence to proper library usage conventions, such as ensuring a resource is closed after being opened. To make things worse, existing library fuzzing techniques unconditionally execute each driver, resulting in numerous irrational drivers that waste computational resources while contributing little coverage and generating false positive bug reports. To tackle these challenges, we propose a novel automatic library fuzzing technique, Scheduzz, an LLM-based library fuzzing technique. It leverages LLMs to understand rational usage of libraries and extract API combination constraints. To optimize computational resource utilization, a dual scheduling framework is implemented to efficiently manage API combinations and fuzz drivers. The framework models driver generation and the corresponding fuzzing campaign as an online optimization problem. Within the scheduling loop, multiple API combinations are selected to generate fuzz drivers, while simultaneously, various optimized fuzz drivers are scheduled for execution or suspension. We implemented Scheduzz and evaluated it in 33 real-world libraries. Compared to baseline approaches, Scheduzz significantly reduces computational overhead and outperforms UTopia on 16 out of 21 libraries. It achieves 1.62x, 1.50x, and 1.89x higher overall coverage than the state-of-the-art techniques CKGFuzzer, Promptfuzz, and the handcrafted project OSS-Fuzz, respectively. In addition, Scheduzz discovered 33 previously unknown bugs in these well-tested libraries, 3 of which have been assigned CVEs.

cs.SE↗

arXiv2025

Analysis of Fe and Co binary catalysts in chemical vapor deposition growth of single-walled carbon nanotubes

Metal catalysts play a pivotal role in the growth of single-walled carbon nanotubes (SWCNTs), with binary metallic catalysts emerging as an efficient SWCNT synthesis strategy. Among these, iron (Fe), cobalt (Co), and their alloys are particularly effective. However, prior studies have predominantly employed Fe--Co alloy catalysts with fixed atomic ratios as well as unchanged chemical vapor deposition (CVD) conditions, leaving the influence of variable Fe--Co compositions and CVD growth parameters on SWCNT synthesis poorly understood. This study focuses on the role of Fe--Co catalyst ratios, with the aim of elucidating the distinct contributions of Fe and Co atoms in the growth of SWCNTs. By systematically exploring a wide range of Fe--Co ratios and growth conditions, we identified Fe$_{0.75}$Co$_{0.25}$ as a highly efficient binary catalyst at 850~$^\circ$C, primarily forming catalyst clusters with diameters of 2.5--6~nm and yielding SWCNTs with diameters ranging from 0.9--1.1~nm. On the other hand, Fe$_{0}$Co$_{1}$ exhibited higher catalytic activity at 600~$^\circ$C, generating smaller catalyst clusters of 1.5--5~nm and producing SWCNTs with reduced diameters of about 0.6--0.9~nm. Transmission electron microscope (TEM) and energy dispersive X-ray spectroscopy (EDS) analyses reveal that high SWCNT yields correlate with the formation of uniformly sized Fe--Co catalyst particles with surface-segregated Co that optimizes carbon solubility. Molecular dynamics (MD) simulations further corroborate these findings, demonstrating that the structure and melting behavior of Fe$_x$Co$_{1-x}$ clusters depend on cluster size and composition.

cond-mat.mtrl-sci↗

arXiv2025

A Collaborative Framework Integrating Large Language Model and Chemical Fragment Space: Mutual Inspiration for Lead Design

Combinatorial optimization algorithm is essential in computer-aided drug design by progressively exploring chemical space to design lead compounds with high affinity to target protein. However current methods face inherent challenges in integrating domain knowledge, limiting their performance in identifying lead compounds with novel and valid binding mode. Here, we propose AutoLeadDesign, a lead compounds design framework that inspires extensive domain knowledge encoded in large language models with chemical fragments to progressively implement efficient exploration of vast chemical space. The comprehensive experiments indicate that AutoLeadDesign outperforms baseline methods. Significantly, empirical lead design campaigns targeting two clinically relevant targets (PRMT5 and SARS-CoV-2 PLpro) demonstrate AutoLeadDesign's competence in de novo generation of lead compounds achieving expert-competitive design efficacy. Structural analysis further confirms their mechanism-validated inhibitory patterns. By tracing the process of design, we find that AutoLeadDesign shares analogous mechanisms with fragment-based drug design which traditionally rely on the expert decision-making, further revealing why it works. Overall, AutoLeadDesign offers an efficient approach for lead compounds design, suggesting its potential utility in drug design.

q-bio.BM↗

arXiv2025

UniCode$^2$: Cascaded Large-scale Codebooks for Unified Multimodal Understanding and Generation

Unified multimodal large language models (MLLMs) have shown promise in jointly advancing multimodal understanding and generation, with visual codebooks discretizing images into tokens for autoregressive modeling. Existing codebook-based methods either rely on small vocabularies (~16K entries) that lack fine-grained semantics or naively scale up, resulting in low token utilization and unstable training. We propose UniCode$^2$, a cascaded codebook framework enabling large-scale, semantically aligned, and stable visual tokenization. By clustering millions of SigLIP sequence embeddings, we build a 500K-entry codebook that preserves vision-language alignment while expanding capacity. Stability is ensured via a cascaded design: a frozen codebook anchors the embedding space, and a trainable codebook refines task-specific semantics. This decoupling promotes high utilization and robust learning. Moreover, the alignment of our visual tokens with textual semantics enables seamless integration with pretrained diffusion decoders, supporting high-quality visual synthesis with minimal adaptation. UniCode^2 delivers strong performance across diverse benchmarks, demonstrating the viability of scaling visual token spaces without sacrificing stability, semantics, or modularity.

cs.CV↗

arXiv2025

Real-space titration and manipulation of particle-like correlated electrons in doped Mott insulator

The localized (particle-like) correlated electrons deserve particular attention as they govern various exotic quantum phenomena, such as quantum spin liquids, Wigner crystals, and Mott insulators in correlated systems. However, direct observation and manipulation of these particle-like electrons at the atomic or single-electron scale remain highly challenging. Here, we successfully realize and directly visualize particle-like correlated electrons in 1T-TaS2 through hole doping. The potential-dependent local electronic structure of single particle-like electron is revealed by angle-resolved photoemission spectroscopy (ARPES), scanning tunneling spectroscopy (STS) combined with theoretical calculations. The complex correlated interactions including nearest-neighbor attractive interactions and many-body repulsive interactions are further demonstrated and discussed based on the spatial distribution of particle-like electrons. Furthermore, the tentative manipulation of the particle-like electrons is successfully achieved by the energy-excitation mechanism. Our results not only provide profound insights into particle-like electrons in correlated systems, but also establish a versatile platform for designing and controlling quantum states at the atomic scale.

cond-mat.str-el↗

arXiv2025

Numerical Analysis of the Parallel Orbital-Updating Approach for Eigenvalue Problems

The parallel orbital-updating approach is an orbital/eigenfunction iteration based approach for solving eigenvalue problems when many eigenpairs are required. It has been proven to be efficient, for instance, in electronic structure calculations. In this paper, based on the investigation of a quasi-orthogonality, we present the numerical analysis of the parallel orbital-updating approach for linear eigenvalue problems, including convergence and error estimates of the numerical approximations.

math.NA↗