arXiv ScienceSearch

arXiv subjects

Hua Qu

Publications and source records attributed to Hua Qu.

5 recordsLinked to original sources

Metadata-Free Meta-Reweighted Direct Preference Optimization under Noisy Preference Labels

Direct Preference Optimization (DPO) has become an important method for aligning large language models (LLMs) with human preferences because it removes the need for explicit reward modeling and reinforcement learning. However, its performance depends heavily on the quality of preference data, and noisy preference data in real-world settings can weaken alignment performance. To address this issue, we propose a bilevel optimization framework and prove, under some idealized conditions, that this framework can recover the DPO optimum under clean data. We further derive a prior form for the learnable weighting function under label-flipping noise. Considering that high-quality metadata may be difficult to obtain, we propose a prompt augmentation consistency method that enables meta-learning even when metadata is completely unavailable. To reduce the high cost of higher-order gradients in LLM meta-learning, we combine central-difference approximation with LoRA fine-tuning and develop a scalable training scheme. Experiments on TL;DR summarization and Anthropic Helpful and Harmless dialogue show that the proposed method improves alignment performance over multiple DPO baselines under different noise rates.

cs.LG

Injectable Thermochemical Micro-Explosion for Prompt Thrombolysis via Liquid Alkali Metal

Thrombotic vascular diseases contribute to significant global mortality, yet current therapeutic strategies face persistent challenges including bleeding risks, suboptimal efficiency, and procedural complexity. Here, we report a micro-explosive thermochemical thrombolysis (METCT) therapy via injectable liquid alkali metal (LAM) encapsulated in dimethyl silicone (LAM@oil), which enables prompt, efficient and safe vascular recanalization within an ultrafast timeframe (< 90 seconds). This LAM@oil system effectively disrupts thrombus tissue through a synergistic triple-action mechanism: Mechanical micro-explosions forces, alkaline ablation due to highly localized exothermic chemical reactions, and thermal thrombolysis mediated by elevated temperature. Upon thrombolysis completion, the non-toxic reaction byproducts (sodium and potassium ions) exhibit physiologically biocompatible and metabolizable effects. Critically, the LAM@oil demonstrates significantly higher thrombolytic efficacy compared to clinically available thrombolytic drugs (residual thrombus area percent 10.87%+-7.16% for LAM@oil vs. 80.86%+-13.32% for urokinase), with no associated bleeding risks. This strategy opens a byproduct-free, cost-effective, and high-efficiency alternative to conventional thrombolytics, holding big potential for clinical translation in acute thrombosis management.

physics.med-ph

Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation

Despite their impressive capabilities, large language models (LLMs) often face challenges such as temporal misalignment and generating hallucinatory content. Enhancing LLMs with retrieval mechanisms to fetch relevant information from external sources offers a promising solution. Inspired by the proverb "Think twice before you act," we propose a dual-angle evaluated retrieval-augmented generation framework \textit{Think-then-Act}. Unlike previous approaches that indiscriminately rewrite queries or perform retrieval regardless of necessity, or generate temporary responses before deciding on additional retrieval, which increases model generation costs, our framework employs a two-phase process: (i) assessing the input query for clarity and completeness to determine if rewriting is necessary; and (ii) evaluating the model's capability to answer the query and deciding if additional retrieval is needed. Experimental results on five datasets show that the \textit{Think-then-Act} framework significantly improves performance. Our framework demonstrates notable improvements in accuracy and efficiency compared to existing baselines and performs well in both English and non-English contexts. Ablation studies validate the optimal model confidence threshold, highlighting the resource optimization benefits of our approach.

cs.CL

Scene-Specific Pedestrian Detection Based on Parallel Vision

As a special type of object detection, pedestrian detection in generic scenes has made a significant progress trained with large amounts of labeled training data manually. While the models trained with generic dataset work bad when they are directly used in specific scenes. With special viewpoints, flow light and backgrounds, datasets from specific scenes are much different from the datasets from generic scenes. In order to make the generic scene pedestrian detectors work well in specific scenes, the labeled data from specific scenes are needed to adapt the models to the specific scenes. While labeling the data manually spends much time and money, especially for specific scenes, each time with a new specific scene, large amounts of images must be labeled. What's more, the labeling information is not so accurate in the pixels manually and different people make different labeling information. In this paper, we propose an ACP-based method, with augmented reality's help, we build the virtual world of specific scenes, and make people walking in the virtual scenes where it is possible for them to appear to solve this problem of lacking labeled data and the results show that data from virtual world is helpful to adapt generic pedestrian detectors to specific scenes.

cs.CV

Sparsity Aware Normalized Least Mean p-power Algorithms with Correntropy Induced Metric Penalty

For identifying the non-Gaussian impulsive noise systems, normalized LMP (NLMP) has been proposed to combat impulsive-inducing instability. However, the standard algorithm is without considering the inherent sparse structure distribution of unknown system. To exploit sparsity as well as to mitigate the impulsive noise, this paper proposes a sparse NLMP algorithm, i.e., Correntropy Induced Metric (CIM) constraint based NLMP (CIMNLMP). Based on the first proposed algorithm, moreover, we propose an improved CIM constraint variable regularized NLMP(CIMVRNLMP) algorithm by utilizing variable regularized parameter(VRP) selection method which can further adjust convergence speed and steady-state error. Numerical simulations are given to confirm the proposed algorithms.

cs.IT