arXiv subjects

Yan Li

Publications and source records attributed to Yan Li.

At least 199 records · Page 11Linked to original sources

arXiv2025

Recent Advances in Microfluidics and Bioelectronics for Three-Dimensional Organoid Interfaces

Organoids offer a promising alternative in biomedical research and clinical medicine, with better feature recapitulation than 2D cultures. They also have more consistent responses with clinical results when compared to animal models. However, major challenges exist in the longevity of culture, the reproducibility of organoid properties, and the development of non-disruptive monitoring methods. Recent advances in materials and microfabrication methods, such as 3D printing and compressive buckling, have enabled three-dimensional (3D) interfaces of microfluidics and bioelectronics to manipulate and monitor these biological models in exciting ways. These advanced systems have great potential for applications in drug delivery, personalized medicine, and disease modelling. We conclude with important future considerations to generate longevity using further technological development in organoid and spheroid models.

q-bio.TO↗

arXiv2025

Towards Self-Refinement of Vision-Language Models with Triangular Consistency

Vision-Language Models (VLMs) integrate visual knowledge with the analytical capabilities of Large Language Models (LLMs) through supervised visual instruction tuning, using image-question-answer triplets. However, the potential of VLMs trained without supervised instruction remains largely unexplored. This study validates that VLMs possess inherent self-refinement capabilities, enabling them to generate high-quality supervised data without external inputs and thereby learn autonomously. Specifically, to stimulate the self-refinement ability of VLMs, we propose a self-refinement framework based on a Triangular Consistency principle: within the image-query-answer triangle, any masked elements should be consistently and accurately reconstructed. The framework involves three steps: (1) We enable the instruction generation ability of VLMs by adding multi-task instruction tuning like image$\rightarrow$question-answer or image-answer$\rightarrow$question. (2) We generate image-query-answer triplets from unlabeled images and use the Triangular Consistency principle for filtering. (3) The model is further updated using the filtered synthetic data. To investigate the underlying mechanisms behind this self-refinement capability, we conduct a theoretical analysis from a causal perspective. Using the widely recognized LLaVA-1.5 as our baseline, our experiments reveal that the model can autonomously achieve consistent, though deliberately modest, improvements across multiple benchmarks without any external supervision, such as human annotations or environmental feedback. We expect that the insights of this study on the self-refinement ability of VLMs can inspire future research on the learning mechanism of VLMs. Code is available at https://github.com/dengyl20/SRF-LLaVA-1.5.

cs.CV↗

arXiv2025

Cluster-Aware Prompt Ensemble Learning for Few-Shot Vision-Language Model Adaptation

Vision-language models (VLMs) such as CLIP achieve zero-shot transfer across various tasks by pre-training on numerous image-text pairs. These models often benefit from using an ensemble of context prompts to represent a class. Despite being effective, conventional prompt ensembling that averages textual features of context prompts often yields suboptimal results. This is because feature averaging shifts the class centroids away from the true class distribution. To address this issue, we propose the Cluster-Aware Prompt Ensemble Learning (CAPEL) framework, which preserves the cluster nature of context prompts. CAPEL classifies images into one of several class clusters, each represented by a distinct prompt. Instead of ensembling prompts in the feature space, we perform ensembling in the classification logits space, aligning better with the visual feature distribution. To further optimize prompt fine-tuning while maintaining cluster-specific discriminative power, we introduce a cluster-preserving regularization term. This ensures that prompts remain distinct and specialized for different clusters, preventing collapse into a uniform direction. Additionally, we integrate an adaptive prompt weighting technique to dynamically adjust the attention weights for flawed or ambiguous prompts, ensuring robust performance across diverse datasets and tasks.

cs.CV↗

arXiv2025

When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and Understanding

Large Multimodal Models (LMMs) have achieved impressive progress in visual perception and reasoning. However, when confronted with visually ambiguous or non-semantic scene text, they often struggle to accurately spot and understand the content, frequently generating semantically plausible yet visually incorrect answers, which we refer to as semantic hallucination. In this work, we investigate the underlying causes of semantic hallucination and identify a key finding: Transformer layers in LLM with stronger attention focus on scene text regions are less prone to producing semantic hallucinations. Thus, we propose a training-free semantic hallucination mitigation framework comprising two key components: (1) ZoomText, a coarse-to-fine strategy that identifies potential text regions without external detectors; and (2) Grounded Layer Correction, which adaptively leverages the internal representations from layers less prone to hallucination to guide decoding, correcting hallucinated outputs for non-semantic samples while preserving the semantics of meaningful ones. To enable rigorous evaluation, we introduce TextHalu-Bench, a benchmark of 1,740 samples spanning both semantic and non-semantic cases, with manually curated question answer pairs designed to probe model hallucinations. Extensive experiments demonstrate that our method not only effectively mitigates semantic hallucination but also achieves strong performance on public benchmarks for scene text spotting and understanding.

cs.CV↗

arXiv2025

Relief of EGFR/FOS-downregulated miR-103a by loganin alleviates NF-kappaB-triggered inflammation and gut barrier disruption in colitis

Due to the ever-rising global incidence rate of inflammatory bowel disease (IBD) and the lack of effective clinical treatment drugs, elucidating the detailed pathogenesis, seeking novel targets, and developing promising drugs are the top priority for IBD treatment. Here, we demonstrate that the levels of microRNA (miR)-103a were significantly downregulated in the inflamed mucosa of ulcerative colitis (UC) patients, along with elevated inflammatory cytokines (IL-1beta/TNF-alpha) and reduced tight junction protein (Occludin/ZO-1) levels, as compared with healthy control objects. Consistently, miR-103a deficient intestinal epithelial cells Caco-2 showed serious inflammatory responses and increased permeability, and DSS induced more severe colitis in miR-103a-/- mice than wild-type ones. Mechanistic studies unraveled that c-FOS suppressed miR-103a transcription via binding to its promoter, then miR-103a-targeted NF-kappaB activation contributes to inflammatory responses and barrier disruption by targeting TAB2 and TAK1. Notably, the traditional Chinese medicine Cornus officinalis (CO) and its core active ingredient loganin potently mitigated inflammation and barrier disruption in UC by specifically blocking the EGFR/RAS/ERK/c-FOS signaling axis, these effects mainly attributed to modulated miR-103a levels as the therapeutic activities of them were almost completely shielded in miR-103a KO mice. Taken together, this work reveals that loganin relieves EGFR/c-FOS axis-suppressed epithelial miR-103a expression, thereby inhibiting NF-kappaB pathway activation, suppressing inflammatory responses, and preserving tight junction integrity in UC. Thus, our data enrich mechanistic insights and promising targets for UC treatment.

q-bio.BM↗

arXiv2025

Finding the temperature window for atomic layer deposition of ruthenium metal via efficient phonon calculations

We investigate the use of first principles thermodynamics based on periodic density functional theory (DFT) to examine the gas-surface chemistry of an oxidized ruthenium surface reacting with hydrogen gas. This reaction system features in the growth of ultrathin Ru films by atomic layer deposition (ALD). We reproduce and rationalize the experimental observation that ALD of the metal from RuO4 and H2 occurs only in a narrow temperature window above 100°C, and this validates the approach. Specifically, the temperature-dependent reaction free energies are computed for the competing potential reactions of the H2 reagent, and show that surface oxide is reduced to water, which is predicted to desorb thermally above 113°C, exposing bare Ru that can further react to surface hydride, and hence deposit Ru metal. The saturating coverages give a predicted growth rate of 0.7 Å/cycle of Ru. At lower temperatures, free energies indicate that water is retained at the surface and reacts with the RuO4 precursor to form an oxide film, also in agreement with experiment. The temperature dependence is obtained with the required accuracy by computing Gibbs free energy corrections from phonon calculations within the harmonic approximation. Surface phonons are computed rapidly and efficiently by parallelization on a cloud architecture within the Schrödinger Materials Science Suite. We also show that rotational and translational entropy of gases dominate the free energies, permitting an alternative approach without phonon calculations, which would be suitable for rapid pre-screening of gas-surface chemistries.

cond-mat.mtrl-sci↗

arXiv2025

Diffusion Model as a Noise-Aware Latent Reward Model for Step-Level Preference Optimization

Preference optimization for diffusion models aims to align them with human preferences for images. Previous methods typically use Vision-Language Models (VLMs) as pixel-level reward models to approximate human preferences. However, when used for step-level preference optimization, these models face challenges in handling noisy images of different timesteps and require complex transformations into pixel space. In this work, we show that pre-trained diffusion models are naturally suited for step-level reward modeling in the noisy latent space, as they are explicitly designed to process latent images at various noise levels. Accordingly, we propose the Latent Reward Model (LRM), which repurposes components of the diffusion model to predict preferences of latent images at arbitrary timesteps. Building on LRM, we introduce Latent Preference Optimization (LPO), a step-level preference optimization method conducted directly in the noisy latent space. Experimental results indicate that LPO significantly improves the model's alignment with general, aesthetic, and text-image alignment preferences, while achieving a 2.5-28x training speedup over existing preference optimization methods. Our code and models are available at https://github.com/Kwai-Kolors/LPO.

cs.CV↗

arXiv2025

Pilot selection in the era of Virtual reality: algorithms for accurate and interpretable machine learning models

With the rapid growth of the aviation industry, there is a need for a large number of flight crew. How to select the right pilots in a cost-efficient manner has become an important research question. In the current study, twenty-three pilots were recruited from China Eastern Airlines, and 23 novices were from the community of Tsinghua University. A novel approach incorporating machine learning and virtual reality technology was applied to distinguish features between these participants with different flight skills. Results indicate that SVM with the MIC feature selection method consistently achieved the highest prediction performance on all metrics with an Accuracy of 0.93, an AUC of 0.96, and an F1 of 0.93, which outperforms four other classifier algorithms and two other feature selection methods. From the perspective of feature selection methods, the MIC method can select features with a nonlinear relationship to sampling labels, instead of a simple filter-out. Our new implementation of the SVM + MIC algorithm outperforms all existing pilot selection algorithms and perhaps provides the first implementation based on eye tracking and flight dynamics data. This study's VR simulation platforms and algorithms can be used for pilot selection and training.

cs.LG↗

arXiv2025

Half-order Fine-Tuning for Diffusion Model: A Recursive Likelihood Ratio Optimizer

The probabilistic diffusion model (DM), generating content by inferencing through a recursive chain structure, has emerged as a powerful framework for visual generation. After pre-training on enormous data, the model needs to be properly aligned to meet requirements for downstream applications. How to efficiently align the foundation DM is a crucial task. Contemporary methods are either based on Reinforcement Learning (RL) or truncated Backpropagation (BP). However, RL and truncated BP suffer from low sample efficiency and biased gradient estimation, respectively, resulting in limited improvement or, even worse, complete training failure. To overcome the challenges, we propose the Recursive Likelihood Ratio (RLR) optimizer, a Half-Order (HO) fine-tuning paradigm for DM. The HO gradient estimator enables the computation graph rearrangement within the recursive diffusive chain, making the RLR's gradient estimator an unbiased one with lower variance than other methods. We theoretically investigate the bias, variance, and convergence of our method. Extensive experiments are conducted on image and video generation to validate the superiority of the RLR. Furthermore, we propose a novel prompt technique that is natural for the RLR to achieve a synergistic effect.

cs.CV↗

arXiv2025

SynDoc: A Hybrid Discriminative-Generative Framework for Enhancing Synthetic Domain-Adaptive Document Key Information Extraction

Domain-specific Visually Rich Document Understanding (VRDU) presents significant challenges due to the complexity and sensitivity of documents in fields such as medicine, finance, and material science. Existing Large (Multimodal) Language Models (LLMs/MLLMs) achieve promising results but face limitations such as hallucinations, inadequate domain adaptation, and reliance on extensive fine-tuning datasets. This paper introduces SynDoc, a novel framework that combines discriminative and generative models to address these challenges. SynDoc employs a robust synthetic data generation workflow, using structural information extraction and domain-specific query generation to produce high-quality annotations. Through adaptive instruction tuning, SynDoc improves the discriminative model's ability to extract domain-specific knowledge. At the same time, a recursive inferencing mechanism iteratively refines the output of both models for stable and accurate predictions. This framework demonstrates scalable, efficient, and precise document understanding and bridges the gap between domain-specific adaptation and general world knowledge for document key information extraction tasks.

cs.CV↗

arXiv2025

Exploiting Block Coordinate Descent for Cost-Effective LLM Model Training

Training large language models typically demands extensive GPU memory and substantial financial investment, which poses a barrier for many small- to medium-sized teams. In this paper, we propose a full-parameter pre-training and fine-tuning framework based on block coordinate descent (BCD), enhanced with engineering optimizations, to enable efficient training of large-scale models on cost-effective RTX 4090, A100 and A800 GPU clusters. Under identical hardware configurations, we reduce the training cost of a 7B model to 33% on A100/A800 and only 2.6% on RTX 4090, compared to standard full-parameter training. It also enables large models previously restricted to A100 clusters to be trained on RTX 4090 without degrading performance. BCD achieves comparable or better accuracy than full-parameter and fine-tuning methods at most cases, with lower GPU consumption and improved hardware utilization.

cs.LG↗

arXiv2025

Convergence of the adaptive finite element discretization based parallel orbital-updating method for eigenvalue problems

It is significant and challenging to solve eigenvalue problems of partial differential operators when many highly accurate eigenpair approximations are required. The adaptive finite element discretization based parallel orbital-updating method, which can significantly reduce the computational cost and enhance the parallel scalability, has been shown to be efficient in electronic structure calculations. However, there is no any mathematical justification for this method in literature. In this paper, we will show the convergence of the method for clustered eigenvalue problems of linear partial differential operators.

math.NA↗

arXiv2025

Electrically Reconfigurable Arbitrary Splitting-Ratio Optical Splitter Based on Low-Loss Sb2Se3

Reconfigurable beam splitters capable of being arbitrarily programmed for the power splitting ratios are vital for the adaptive optical networks and photonic computing. Conventional mechanisms such as thermo-optic, free-carrier, or mechanical tuning are usually volatile and require continuous power, limiting their suitability for low-frequency and low power-consumption programmable operations. Here, we experimentally demonstrate an electrically reconfigurable beam splitter based on the low-loss phase-change material Sb2Se3, enabling multi-level and arbitrary splitting-ratio (SR) control. By locally triggering phase transitions in the coupling region with integrated micro-electrodes, we exploit the high refractive-index contrast between different phases and negligible absorption in the near-infrared wavelength of Sb2Se3 to precisely tune the coupling strength with non-volatile retention. 8-level of power splitting states is achieved within a compact footprint of ~14.5-μm in the experiments, with insertion loss is ~1 dB across 1515-1550 nm and near-zero static power. Combining the advantages of compactness, broad bandwidth, low loss, non-volatility, and multi-level control experimentally, this device provides a universal building block for scalable, energy-efficient reconfigurable photonic circuits, with great prospects in optical computing and intelligent communication systems.

physics.optics↗

arXiv2025

Phase Behavior and Ion Transport in Lithium-Niobium-Tantalum Oxide Alloys

Lithium niobate-tantalate mixtures have garnered considerable interest for their ability to merge the desirable properties of both end members, enabling diverse high-value applications, such as high-performance faradaic capacitors, non-linear optics, and protective coatings in rechargeable batteries. While numerous studies on the application of $\mathrm{LiNb_xTa_{1-x}O_3}$ exist, the phase behavior and properties of $\mathrm{Li_3Nb_xTa_{1-x}O_4}$ remain largely unexplored. In this work, we employ a multiscale approach that encompasses first-principles phonon calculations, cluster expansion, and Monte Carlo simulations to derive the temperature-composition phase diagram for $\mathrm{Li_3Nb_xTa_{1-x}O_4}$. Our findings reveal the critical role of vibrational entropy in accurately predicting phase stability, which promotes the solubility of Nb in $\mathrm{Li_3TaO_4}$ while suppressing the miscibility of Ta in $\mathrm{Li_3NbO_4}$. Additionally, we demonstrate that Nb/Ta mixing offers a promising avenue for tailoring the Li-ion conductivities of $\mathrm{Li_3Nb_xTa_{1-x}O_4}$. On the technical side, we demonstrated the importance of including vibrational entropy effects explicitly in Monte Carlo simulations dealing with multicomponent systems, beyond simple binary mixtures. On the application side, this study provides fundamental insights into the phase behavior and Li-ion transport properties of $\mathrm{Li_3Nb_xTa_{1-x}O_4}$, paving the way for its potential applications in energy storage and other fields.

cond-mat.mtrl-sci↗

arXiv2025

R-Net: A Reliable and Resource-Efficient CNN for Colorectal Cancer Detection with XAI Integration

State-of-the-art (SOTA) Convolutional Neural Networks (CNNs) are criticized for their extensive computational power, long training times, and large datasets. To overcome this limitation, we propose a reasonable network (R-Net), a lightweight CNN only to detect and classify colorectal cancer (CRC) using the Enteroscope Biopsy Histopathological Hematoxylin and Eosin Image Dataset (EBHI). Furthermore, six SOTA CNNs, including Multipath-based CNNs (DenseNet121, ResNet50), Depth-based CNNs (InceptionV3), width-based multi-connection CNNs (Xception), depth-wise separable convolutions (MobileNetV2), spatial exploitation-based CNNs (VGG16), Transfer learning, and two ensemble models are also tested on the same dataset. The ensemble models are a multipath-depth-width combination (DenseNet121-InceptionV3-Xception) and a multipath-depth-spatial combination (ResNet18-InceptionV3-VGG16). However, the proposed R-Net lightweight achieved 99.37% accuracy, outperforming MobileNet (95.83%) and ResNet50 (96.94%). Most importantly, to understand the decision-making of R-Net, Explainable AI such as SHAP, LIME, and Grad-CAM are integrated to visualize which parts of the EBHI image contribute to the detection and classification process of R-Net. The main novelty of this research lies in building a reliable, lightweight CNN R-Net that requires fewer computing resources yet maintains strong prediction results. SOTA CNNs, transfer learning, and ensemble models also extend our knowledge on CRC classification and detection. XAI functionality and the impact of pixel intensity on correct and incorrect classification images are also some novelties in CRC detection and classification.

q-bio.TO↗

arXiv2025

On the Equivalence of Koopman Eigenfunctions and Commuting Symmetries

The Koopman operator framework offers a way to represent a nonlinear system as a linear one. The key to this simplification lies in the identification of eigenfunctions. While various data-driven algorithms have been developed for this problem, a theoretical characterization of Koopman eigenfunctions from geometric properties of the flow is still missing. This paper provides such a characterization by establishing an equivalence between a set of Koopman eigenfunctions and a set of commuting symmetries -- both assumed to span the tangent spaces at every point on a simply connected open set. Based on this equivalence, we derive an explicit formula for the principal Koopman eigenfunctions and prove its uniform convergence on the region of attraction of a locally asymptotically stable equilibrium point, thereby offering a constructive method for computing Koopman eigenfunctions.

eess.SY↗

arXiv2025

Kwai Keye-VL 1.5 Technical Report

In recent years, the development of Large Language Models (LLMs) has significantly advanced, extending their capabilities to multimodal tasks through Multimodal Large Language Models (MLLMs). However, video understanding remains a challenging area due to the dynamic and information-dense nature of videos. Existing models struggle with the trade-off between spatial resolution and temporal coverage when processing video content. We present Keye-VL-1.5, which addresses fundamental challenges in video comprehension through three key innovations. First, we introduce a novel Slow-Fast video encoding strategy that dynamically allocates computational resources based on inter-frame similarity, processing key frames with significant visual changes at higher resolution (Slow pathway) while handling relatively static frames with increased temporal coverage at lower resolution (Fast pathway). Second, we implement a progressive four-stage pre-training methodology that systematically extends the model's context length from 8K to 128K tokens, enabling processing of longer videos and more complex visual content. Third, we develop a comprehensive post-training pipeline focusing on reasoning enhancement and human preference alignment, incorporating a 5-step chain-of-thought data construction process, iterative GSPO-based reinforcement learning with progressive prompt hinting for difficult cases, and alignment training. Through extensive evaluation on public benchmarks and rigorous internal human assessment, Keye-VL-1.5 demonstrates significant improvements over existing models, particularly excelling in video understanding tasks while maintaining competitive performance on general multimodal benchmarks.

cs.CV↗

arXiv2025

Meridional Circulation II: A Unified Mechanism for Lithium Depletion in Solar Analogs and the Lithium Dip in Mid-F Cluster Stars

The behavior of lithium (Li) in Population I main sequence stars challenges standard stellar theory. Two phenomena stand out: the solar Li problem which extends to Li depletion in solar analogs and the Li dip observed in mid-F stars within open clusters. Building on the meridional circulation-driven radial mixing framework previously developed to explain Li-enriched red clump stars, we explore its relevance to Li depletion on the main sequence. First, our models reproduce the observed $A(\text{Li})$-Age correlation in solar analogs. Through detailed isochrone analysis, we find good agreement between the simulated and observed $A(\text{Li})$-$T_{\text{eff}}$ relationships within the solar analog parameter space. However, the predicted solar Li abundance ($\sim 1.5\,\text{dex}$) is still higher than current solar measurements. Second, our models partially explain the Li dip phenomenon in mid-F cluster stars. The models accurately reproduce Li distributions on the cool side of the Li dip in most clusters and capture the Li behaviors on the hot side observed in systems like the Hyades. However, we identify limitations in the models' ability to fully reproduce the dip morphology, particularly due to the rotation velocity distribution of sample stars in this temperature zone.

astro-ph.SR↗