arXiv subjects

Lilin Wang

Publications and source records attributed to Lilin Wang.

At least 19 recordsLinked to original sources

arXiv2026

Beyond Binary Labels: Diagnostic Evaluation of LLM Safety with Prompt-Level Rubrics

Current LLM safety benchmarks predominantly rely on binary safe or unsafe labels, lacking explanatory depth and suffering from low consistency across automated judges. To address this, we introduce DiagSafe, a diagnostic evaluation framework that moves beyond binary classification by employing prompt-level rubrics. Grounded in globally applicable AI safety policies, each rubric provides explicit criteria along two dimensions: safety, which targets concrete harms with specific exemptions to suppress false positives, and usefulness, which independently evaluates instruction fulfillment. To ensure a robust and realistic evaluation, we construct a bilingual (English-Chinese) benchmark grounded in a comprehensive 84-label safety taxonomy, consisting of two subsets: DiagBase, which covers single- and multi-turn prompts with direct harmful queries and template-based jailbreaks, and DiagAttack, which embeds harmful intents into complex instruction-following tasks to form challenging instruction attacks. Extensive experiments demonstrate that DiagSafe significantly enhances the reliability of LLM-as-a-judge evaluation, achieving 95.34% agreement with human annotations -- substantially higher than the 69%-87% achieved by the baselines -- and high inter-judge consistency (Cohen's $κ$ = 0.864). Furthermore, applying our framework reveals that leading LLMs differ markedly in their unsafe rates, and each model also exhibits unique vulnerabilities along different dimensions. In addition, we observe that models are particularly susceptible in Chinese and multi-turn contexts. Ultimately, DiagSafe provides a reliable and explainable tool for auditing and optimizing LLM alignment.

cs.CL↗

arXiv2026

Which Long Documents Matter? A Controlled Study of Data Selection for Context Extension

Natural long documents are widely used for context extension, but which selection pipelines are effective remains unclear. We conduct a controlled comparison on Qwen2.5-3B at 128K under matched 6B-token continued-training budgets. Random sampling of natural long documents (random-long) outperforms repacking at longer evaluation lengths. Within the same candidate pool, selecting documents with high LongPPL key-token density yields further gains, unlike the evaluated generic-quality and LLM-judge selectors. We introduce truncLongPPL to reduce scoring cost by computing key-token density over a truncated prefix. At 128K, scoring the first half of the reference span yields downstream performance close to full-span scoring with a measured $2.28\times$ end-to-end scoring speedup. Across three training seeds, truncLongPPL achieves the highest mean scores among evaluated pipelines, exceeding random-long by 4.54 points on validation HELMET and 3.28 on held-out RULER, with gains most consistent in retrieval. At a 256K target context, it gains 2.82 average RULER points over random-long on Qwen2.5-3B. In short/long mixed training across Qwen2.5-3B, Qwen3-8B, and OLMo~3-7B, it gains 1.47--7.31 average RULER points over random-long mixing, with seven-task short-context averages within 0.23 points of the corresponding baselines. After supervised fine-tuning (SFT), Qwen3-8B and OLMo~3-7B models trained with selected long documents outperform their random-long counterparts by 1.13--1.67 points on LongBench v2 and 0.62--1.44 points on MRCR.

cs.CL↗

arXiv2026

SMDDFNet: State-space Modeling and Dynamic Dual Fusion Network for Traffic Sign Detection

Traffic sign detection is a challenging visual signal processing task for advanced driver assistance, where small objects, scale variation, and occlusion limit conventional detectors with fixed receptive fields. This paper proposes State-space Modeling and Dynamic Dual Fusion Network (SMDDFNet), a deep learning detector for traffic sign images. SMDDFNet integrates a Dynamic Dual Fusion (DDF) module and a state-space modeling backbone to enhance multi-scale feature representation. DDF combines efficient multi-scale attention with content-aware dynamic filtering in the frequency domain, while the backbone captures long-range dependencies with linear computational complexity. A multi-scale feature fusion neck further aggregates pyramid features for robust localization of small signs. Experiments on TT100K, GTSDB, PASCAL VOC, and the Roboflow~100 \emph{vehicle} subset show that SMDDFNet achieves competitive accuracy against recent detectors while retaining real-time throughput. The source code is available at https://github.com/rainbowyuyu/SMDDFNet

cs.CV↗

arXiv2026

Environment Evolution for Terminal Agents

Scaling interactive and verifiable environments is critical for training terminal agents. As frontier models become more capable, environments synthesized from scratch become less challenging and thus provide limited learning signals. Recent co-evolution methods iteratively synthesize environments near the model's learnable frontier based on weaknesses exposed during rollouts. However, their dependence on on-policy rollouts limits generalization and the continuous provision of learning signals as the model becomes stronger. In this paper, we propose environment evolution, which incrementally increases environment difficulty off-policy and schedules the evolved environments generation by generation during training to provide continuous learning signals. We derive three evolution directions that influence environment difficulty from the multi-turn learning objective and then implement evolution along these directions through a loop-engineered multi-agent harness. Quantitative rollout experiments with Hy4 preview, Claude Opus 5, and GPT-5.6 Sol show that environment evolution consistently produces more difficult environments. We validate its effectiveness on Qwen3.6-27B and Qwen3.6-35B-A3B through simple long-horizon RL training, improving their performance by 14.4 and 18.0 percentage points on Terminal-Bench 2.1, respectively.

cs.AI↗

arXiv2026

Closed-loop AI achieves certifiable engineering design

Agentic AI has automated parts of scientific discovery, including paper generation, expert-level coding, therapeutic proposal, and autonomous experimentation. Complex physical engineering design remains a gap, because candidates must satisfy simultaneous constraints in fluid dynamics, solid mechanics, and structural stability. We introduce The AI Engineer, an agentic framework that couples large language models (LLMs) to deterministic engineering backends in a closed loop: natural-language requirements are converted into design-domain geometry and mesh; topology is optimized with bi-directional evolutionary structural optimization (BESO) coupled to the CalculiX solver; and member sizes are refined with particle swarm optimization (PSO) coupled to Zwind under offshore aero-hydro-servo-elastic load cases. To explore many designs without per-candidate certification cost, an Automated Reviewer scores each candidate on five dimensions (capacity, steel intensity, unit cost, constructability, and fatigue life) using piecewise-linear functions calibrated on 11 real floating-wind projects. Search terminates only when a candidate reaches a composite score $S \ge 85$ (grade A) with no subscore below 60. We validated this gate by submitting the top-scoring design to the China Classification Society (CCS) for Approval in Principle (AIP), which it passed; AIP is thus an external check that the reviewer tracks professional judgment, not the daily objective. The certified design outperforms the human-optimized TuQiang baseline, reducing steel mass and unit capital cost by 8.1% each while meeting all AIP criteria. This verification-closed regime, in which every proposal is judged by deterministic physics and codified limit states, distinguishes The AI Engineer from open-ended generative systems. Remaining limits include detailed design and fabrication-hard constraints.

cs.AI↗

arXiv2026

Deep Research Pretraining via Predictive Navigation

Deep research agents are often trained on expensive, environment-grounded tool-use trajectories that require repeated retrieval, document inspection, and report evaluation. We introduce Deep Research Pretraining (DRP), an offline framework that derives predictive navigation supervision from naturally occurring evidence structures. Given a citation-bearing or hyperlinked passage, DRP constructs a proxy research objective, recovers linked evidence and graph-related alternatives, and converts them into search-open-write trajectories. This teaches models what to search for, which documents to inspect, and how to synthesize evidence, without a live retrieval environment or executed policy rollout. We instantiate DRP on scholarly citation graphs (DRP-Paper) and Wikipedia hyperlinks (DRP-Web), continually pretrain separate Qwen3-14B-Base models on 1B tokens, and fine-tune them on controlled fractions of 13K agent trajectories. Across five independently sampled subsets at each low-data budget, both variants consistently outperform matched no-DRP models on DeepResearch Bench. With one quarter of the SFT data, DRP-Web even surpasses a fixed no-DRP full-data checkpoint, with gains transferring to ResearchQA, WebWalkerQA, and SimpleQA. Starting from matched low-data SFT checkpoints, the DRP-Web advantage also persists through subsequent agentic RL. Source-matched and evidence-mismatch controls indicate that these improvements arise from evidence-conditioned navigation rather than domain exposure or agent-format imitation. DRP thus provides a promising complementary approach to trajectory-based agent training.

cs.CL↗

arXiv2026

Toward Scalable Terminal Task Synthesis via Skill Graphs

Terminal agents have demonstrated strong potential for autonomous command-line execution, yet their training remains constrained by the scarcity of high-quality and diverse execution trajectories. Existing approaches mitigate this bottleneck by synthesizing large-scale terminal task instances for trajectory sampling. However, they primarily focus on scaling the number of tasks while providing limited control over the diversity of execution trajectories that agents actually experience during training. In this paper, we present SkillSynth, an automated framework for terminal task synthesis built on a scenario-mediated skill graph. SkillSynth first constructs a large-scale skill graph, where scenarios serve as intermediate transition nodes that connect diverse command-line skills. It then samples paths from this graph as abstractions of real-world workflows, and uses a multi-agent harness to instantiate them into executable task instances. By grounding task synthesis in graph-sampled workflow paths, SkillSynth explicitly controls the diversity of minimal execution trajectories required to solve the synthesized tasks. Experiments on Terminal-Bench demonstrate the effectiveness of SkillSynth. Moreover, task instances synthesized by SkillSynth have been adopted to train Hy3 Preview, contributing to its enhanced agentic capabilities in terminal-based settings.

cs.AI↗

arXiv2026

HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds

We introduce HY-World 2.0, a multi-modal world model framework that advances our prior project HY-World 1.0. HY-World 2.0 accommodates diverse input modalities, including text prompts, single-view images, multi-view images, and videos, and produces 3D world representations. With text or single-view image inputs, the model performs world generation, synthesizing high-fidelity, navigable 3D Gaussian Splatting (3DGS) scenes. This is achieved through a four-stage method: a) Panorama Generation with HY-Pano 2.0, b) Trajectory Planning with WorldNav, c) World Expansion with WorldStereo 2.0, and d) World Composition with WorldMirror 2.0. Specifically, we introduce key innovations to enhance panorama fidelity, enable 3D scene understanding and planning, and upgrade WorldStereo, our keyframe-based view generation model with consistent memory. We also upgrade WorldMirror, a feed-forward model for universal 3D prediction, by refining model architecture and learning strategy, enabling world reconstruction from multi-view images or videos. Also, we introduce WorldLens, a high-performance 3DGS rendering platform featuring a flexible engine-agnostic architecture, automatic IBL lighting, efficient collision detection, and training-rendering co-design, enabling interactive exploration of 3D worlds with character support. Extensive experiments demonstrate that HY-World 2.0 achieves state-of-the-art performance on several benchmarks among open-source approaches, delivering results comparable to the closed-source model Marble. We release all model weights, code, and technical details to facilitate reproducibility and support further research on 3D world models.

cs.CV↗

arXiv2025

SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositories

Benchmarks like SWE-bench have standardized the evaluation of Large Language Models (LLMs) on repository-level software engineering tasks. However, these efforts remain limited by manual curation, static datasets, and a focus on Python-based bug fixes. We introduce SWE-Bench++, an automated framework that generates repository-level coding tasks from open-source GitHub projects. Unlike synthetic approaches, our pipeline harvests live pull requests to cover both bug fixes and feature requests across 11 languages. SWE-Bench++ turns GitHub pull requests (PRs) into reproducible, execution-based tasks via four stages: programmatic sourcing, environment synthesis, test oracle extraction, and quality assurance. A final hint-guided trajectory synthesis step converts instances that strong models fail on into training trajectories. Our initial benchmark consists of 11,133 instances from 3,971 repositories across 11 languages. On a subset of 1,782 instances of this benchmark, today's strongest models perform as follows: claude-sonnet-4.5 achieves 36.20% pass@10, gpt-5-2025-08-07 34.57%, gemini/gemini-2.5-pro 24.92%, and gpt-4o 16.89%. We further demonstrate the utility of our dataset by showing that fine-tuning on SWE-Bench++ instances yields measurable improvements on the SWE-bench Multilingual benchmark. SWE-Bench++ provides a scalable, multilingual benchmark for evaluating and improving repository-level code generation.

cs.SE↗

arXiv2025

A co-evolving agentic AI system for medical imaging analysis

Agentic AI is rapidly advancing in healthcare and biomedical research. However, in medical image analysis, their performance and adoption remain limited due to the lack of a robust ecosystem, insufficient toolsets, and the absence of real-time interactive expert feedback. Here we present "TissueLab", a co-evolving agentic AI system that allows researchers to ask direct questions, automatically plan and generate explainable workflows, and conduct real-time analyses where experts can visualize intermediate results and refine them. TissueLab integrates tool factories across pathology, radiology, and spatial omics domains. By standardizing inputs, outputs, and capabilities of diverse tools, the system determines when and how to invoke them to address research and clinical questions. Across diverse tasks with clinically meaningful quantifications that inform staging, prognosis, and treatment planning, TissueLab achieves state-of-the-art performance compared with end-to-end vision-language models (VLMs) and other agentic AI systems such as GPT-5. Moreover, TissueLab continuously learns from clinicians, evolving toward improved classifiers and more effective decision strategies. With active learning, it delivers accurate results in unseen disease contexts within minutes, without requiring massive datasets or prolonged retraining. Released as a sustainable open-source ecosystem, TissueLab aims to accelerate computational research and translational adoption in medical imaging while establishing a foundation for the next generation of medical AI.

cs.CV↗

arXiv2025

A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directions

Mental health is increasingly critical in contemporary healthcare, with psychotherapy demanding dynamic, context-sensitive interactions that traditional NLP methods struggle to capture. Large Language Models (LLMs) offer significant potential for addressing this gap due to their ability to handle extensive context and multi-turn reasoning. This review introduces a conceptual taxonomy dividing psychotherapy into interconnected stages--assessment, diagnosis, and treatment--to systematically examine LLM advancements and challenges. Our comprehensive analysis reveals imbalances in current research, such as a focus on common disorders, linguistic biases, fragmented methods, and limited theoretical integration. We identify critical challenges including capturing dynamic symptom fluctuations, overcoming linguistic and cultural biases, and ensuring diagnostic reliability. Highlighting future directions, we advocate for continuous multi-stage modeling, real-time adaptive systems grounded in psychological theory, and diversified research covering broader mental disorders and therapeutic approaches, aiming toward more holistic and clinically integrated psychotherapy LLMs systems.

cs.CL↗

arXiv2024

Guardians of Discourse: Evaluating LLMs on Multilingual Offensive Language Detection

Identifying offensive language is essential for maintaining safety and sustainability in the social media era. Though large language models (LLMs) have demonstrated encouraging potential in social media analytics, they lack thorough evaluation when in offensive language detection, particularly in multilingual environments. We for the first time evaluate multilingual offensive language detection of LLMs in three languages: English, Spanish, and German with three LLMs, GPT-3.5, Flan-T5, and Mistral, in both monolingual and multilingual settings. We further examine the impact of different prompt languages and augmented translation data for the task in non-English contexts. Furthermore, we discuss the impact of the inherent bias in LLMs and the datasets in the mispredictions related to sensitive topics.

cs.CL↗

arXiv2022

Prediction of nonlinear interface dynamics in the unidirectional freezing of particle suspensions with rigid compacted layer

Water freezing in particle suspensions widely exists in nature. As a typical physical system of free boundary problem, the spatiotemporal evolution of the solid/liquid interface not only origins from phase transformation but also from permeation flow in front of ice. Physical models have been proposed in previous efforts to describe the interface dynamic behaviors in unidirectional freezing of particle suspensions. However, there are several physical parameters difficult to be determined in previous investigations dedicated to describing the spatiotemporal evolution in unidirectional freezing of particle suspensions. Here, based on the fundamental momentum theorem, we propose a consistent theoretical framework to address the unidirectional freezing process in the particle suspensions coupled with the effect of water permeation. An interface undercooling-dependent pushing force exerted on the compacted layer with a specific formula is derived based on the surface tension. Then a dynamic compacted layer is considered and analyzed. Numerical solutions of the nonlinear models reveal the dependence of system dynamics on some typical physical parameters, particle radius, initial particle concentration in the suspensions, freezing velocity and so on. The system dynamics are characterized by interface velocity, interface undercooling and interface recoil as functions of time. The models allow us to reconsider the formation mechanism of ice spears in freezing of particle suspensions in a simpler but novel way, with potential implications for both understanding and controlling not only ice formation in porous media but also crystallization processes in other complex systems.

cond-mat.mtrl-sci↗

arXiv2022

In-situ comparison of interface instability of basal and edge planes during unidirectional growth of sea ice

The unique anisotropy of ice has endowed sea ice growth a peculiar and attractive subject from both fundamental and applied viewpoints. The distinct growth behaviors between edge and basal plane of ice are one of the central topics in ice growth. And the unidirectional freezing pattern stems from perturbations of both basal and edge planes. To date there is no direct comparison of unidirectional freezing behavior between basal and edge plane ice. Here, we in-situ investigate the planar instability as well as the unidirectional freezing pattern of basal and edge planes of ice by a design of parallel freezing samples with specified ice orientations in a NaCl solution as a modeled sea water. The planar instability is discussed via neutral stability curves with surface tension anisotropy for both basal and edge plane ice. For the first time, we realize the simultaneous observation of solid/liquid interfaces of basal and edge plane ice under the same set of freezing conditions. The results show that planar instability occurs faster for edge plane ice than basal plane ice. The time-lapse observations confirm a transient competitive interaction of perturbations between the basal and edge planes ice, which is explained by the anisotropic growth of perturbations in basal and edge planes of ice. These experimental results provide a link between morphology evolution of unidirectional grown sea ice and different ice orientations and are suggested to enrich our understanding of sea ice growth as well as crystallization pattern of other anisotropic materials.

cond-mat.mtrl-sci↗

arXiv2021

Ultra strong and ductile eutectic high entropy alloy fabricated by selective laser melting

With important application prospects, eutectic high entropy alloys have received extensive attention for their excellent strength and ductility in a large temperature range. The excellent casting characteristics of eutectic high entropy alloys make it possible to achieve well manufacturability of selective laser melting. For the first time, we have achieved crack-free eutectic high entropy alloy fabricated by selective laser melting, which has excellent mechanical properties in a wide temperature range of -196 degrees Celsius~760 degrees Celsius due to ultra-fine eutectic lamellar spacing of 150 ~ 200nm and lamellar colony of 2 ~ 6 μm. Specifically, the room temperature tensile strength exceeds 1400MPa and the elongation is more than 20%, significantly improved compared with those manufactured by other techniques with lower cooling rate.

physics.app-ph↗

arXiv2021

Tilting behavior of lamellar ice tip during unidirectional freezing of aqueous solutions

Freezing of ice has been largely reported from many aspects, especially its complex pattern formation. Ice grown from liquid phase is usually characteristic of lamellar morphology which plays a significant role in various domains. However, tilted growth of ice via transition from coplanar to non-coplanar growth in directional solidification has been paid little attention in previous studies and there is misleading explanation of the formation of tilted lamellar ice. Here, we in-situ investigated the variations of tilting behavior of lamellar ice tip under different conditions within a single ice crystal with manipulated orientation via unidirectional freezing of aqueous solutions. It is found that tilted growth of ice tips is sensitive to pulling velocity and solute type. These experimental results reveal intrinsic tilted growth behavior of lamellar ice and enrich our understanding in pattern formation of ice.

cond-mat.soft↗

arXiv2021

Crossover from lamellar to spongy ice morphologies within a single ice crystal during unidirectional freezing of an aqueous solution

Ice growth from liquid phase has been extensively investigated in various conditions, especially for ice freely grown in undercooled water and aqueous solutions. Although unidirectional ice growth plays a significant role in sea ice and freeze casting, the detailed pattern formation of unidirectionally grown ice in an aqueous solution remains elusive. For the first time, we in situ proved a crossover from lamellar to spongy ice morphologies of a single ice crystal via unidirectional freezing of an aqueous solution. The spongy ice morphology originates from the intersect of tilted lamellar ice and is observed in a single ice crystal, which is intrinsically different from the competitive growth of bi-crystal composed of two differently orientated grains in directional solidification. These results provide a complete physical picture of unidirectionally grown ice from aqueous solution and are believed to promote our understanding of various pattern of ice in many relevant domains where pattern formation of ice crystal is vital.

cond-mat.mtrl-sci↗

arXiv2020

The planar interface instability during freezing of a polymer solution: Diffusion-controlled or not?

Freezing of polymer solutions has been extensively investigated from many aspects, especially the complex pattern formation. The cell/dendrite micro-structures are believed to be in the type of diffusion-induced M-S instability. However, the presence of polymer as an impurity in water is significantly different from that of small ions. The quantitative transient investigation on directional freezing of polymer solutions remains lack due to some challenges. For the first time, we observed the planar instability behaviors during unidirectional freezing of a polymer solution together with a typical ionic solution with manipulated ice orientation, and their pattern formation of S/L interface morphology as a function of time in the transient planar instability process has been revealed and compared to each other. It is found with real-time observation that the polymer solution exhibits a global instability mode instead of a local instability mode that is common in ionic solution during planar instability. W-L model was applied to quantitatively address the variation of solute recoil of ionic/polymer solution. And it is found that the W-L model can only reproduce the solute recoil of ionic solution instead of polymer solution, which indicates the complex physics behind freezing of a polymer solution. The paper provides a spectacular contrast of directional freezing process between polymer solution and ionic solution and is believed to promote relevant investigations in terms of the theoretical approach to describing the freezing behavior of polymer solution.

cond-mat.soft↗