arXiv subjects

Haozheng Liu

Publications and source records attributed to Haozheng Liu.

3 recordsLinked to original sources

arXiv2026

Truncated Reasoning Under a Budget: Evaluating System-1 Models as Decision-makers

Large language models (LLMs) often generate more reasoning tokens than needed. Limiting the reasoning budget reduces cost, but forcing an answer from an incomplete trace can hurt accuracy. System-1 decision models select among candidate options without producing a reasoning response. We evaluate Jev as a decision reader of truncated reasoning across seven LLM reasoners and five multiple-choice benchmarks (35 pairs). Jev achieves higher mean accuracy than forced answering at tested budgets from 500 to 16,000 tokens, including the estimated costs of reasoning and answering. At a 1,500-token budget, it improves accuracy by 4.1 pp overall and 8.6 pp on truncated questions, with significant gains in 17 pairs under Holm-corrected bootstrap tests. Offline replay estimates 34.5% of the full-run cost, with a 1.13 pp accuracy loss. A policy selected on training folds saves 71.3% of the estimated full-run cost on held-out folds, with a 0.58 pp accuracy loss. We also find that Jev shows strong question-only accuracy, exceeding 500-token forced answering on average (68.0% vs. 65.5%), although this advantage varies by benchmark. These findings suggest that System-1 decision models can complement LLM reasoning and reduce the need for costly reasoning completion.

cs.CL↗

arXiv2026

ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews

Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tools based on large language models (LLMs) can search and summarize the literature but do not record which studies are excluded or where extracted values come from. We develop a conversational multi-agent system called ReviewPilot that automates the PRISMA workflow from paper screening to information extraction. Researchers can tailor criteria and schemas through dialogue, and a project memory keeps their configurations and revisions. Each screening decision comes with its reason and each extracted value with its source. On epidemiological expert reviews, ReviewPilot outperforms a single-prompt LLM and AgentSLR across three LLMs, with screening macro F1 up to 0.776 and extraction F1 up to 0.788. Case studies in biomedicine and human-computer interaction show close agreement with human annotators, suggesting that ReviewPilot can transfer beyond epidemiology. Code is available at https://github.com/ZhaoqianXue/ReviewPilot.

cs.CL↗

arXiv2026

Beyond What Is Visible: Context-Aware Sentiment Across Online Communities Among Crisis Events

Social media offers timely insight into disaster experiences, yet online communities may not represent those affected on the ground. Uneven participation can bias crisis information systems toward data-rich locations and obscure communities with fewer digital traces. We address this with an adaptive cross-community learning framework that combines text and aggregate mobility signals with socioeconomic and hazard-informed community representations, supplementing sparse local observations with evidence from structurally related cities. We evaluate the framework on the January 2025 Southern California wildfires and 2024 Hurricane Helene in Florida. The adaptive model achieves the highest F1-score in both cases (0.5923 and 0.7615), while augmentation has its strongest effect where original observations are limited. The framework also reveals finer cross-city community-level sentiment variation and stronger sentiment-mobility correspondence than text-only models, with relationships differing across disaster contexts. These findings support crisis systems that better account for context-dependent evidence and improve interpretation of underrepresented community signals.

cs.CY↗