arXiv ScienceSearch

arXiv subjects

Yiqi Zhu

Publications and source records attributed to Yiqi Zhu.

11 recordsLinked to original sources

Benchmarking General Mobile Assistants in Challenging Real-World Scenarios

Graphical user interfaces have emerged as an important environment for evaluating autonomous AI agents on multimodal interactive tasks. Existing benchmarks such as AndroidWorld and MobileWorld provide strong foundations for mobile agent evaluation, but their application coverage and task design do not yet fully capture the diversity and complexity of realistic mobile use. We present GMA, a benchmark for evaluating general mobile assistants in challenging real-world scenarios. GMA introduces seven applications based on open-source projects, spanning domains such as lifestyle sharing and travel planning, and 300 tasks across four difficulty tiers, from atomic actions to complex multi-step workflows. We evaluate eight frontier models and find that performance declines substantially as task complexity increases, with current agents remaining far from reliably handling realistic user requirements. We further conduct controlled ablation studies of agent harness choices, including context retention and explicit state tracking, under a shared environment, model setting, and task taxonomy. Results show that appropriate harness design can meaningfully improve performance, particularly on demanding workflows, while the effectiveness of specific designs can vary across foundation models. Overall, GMA complements existing benchmarks by expanding application coverage and task complexity, providing a challenging testbed for evaluating mobile agents and studying how harness design supports reliable execution in complex mobile workflows.

cs.AI

State2State: Environment-Derived Mid-Training for LLM Agents

Training LLM agents commonly relies on supervised fine-tuning from expert trajectories or online reinforcement learning over human-specified tasks with handcrafted verifiers. Though effective, both remain bottlenecked by externally specified tasks and supervision signals, limiting the scalability and diversity of agent training. We study an environment learning paradigm in which agents acquire interaction and manipulation capabilities solely through environment interaction, without externally specified tasks. We propose State2State, an environment-derived mid-training method that converts explored environment states into training objectives, challenging agents to reach a specified target state. By deriving tasks from environment exploration and verifying success through rule-based state matching, State2State provides scalable and verifiable training objectives without expert supervision or manual task design. Experiments on ALFWorld and ScienceWorld show that State2State improves agent performance as a standalone environment-learning stage in most settings. As initialization for downstream RL, it further improves final performance and learning efficiency, with promising evidence of cross-environment generalization.

cs.CL

When AI Meets Wall Street: A Survey on Trustworthy AI in Fintech

Artificial intelligence is now embedded as a primary decision engine in continuously operated financial AI pipelines spanning training and updating, deployment and inference, and operation with monitoring and feedback. The automation and scale that make these pipelines effective also create novel attack surfaces, where small algorithmic perturbations can amplify into persistent, system-level financial harm. Existing surveys, however, either treat AI as a defensive tool or analyse adversarial machine learning in a domain-agnostic manner, abstracting away finance-specific constraints such as accounting plausibility, non-IID federated data, continuous retraining, and automation-amplified downstream effects. We address this gap with a unified, lifecycle-centric and mechanism-driven framework. We partition financial AI into three lifecycle stages: training and updating, deployment and inference, and operation, monitoring, and feedback. We further propose the Financial AI Security and Robustness Taxonomy, organising seventeen attack subtypes across data and model poisoning, adversarial attacks on decision boundaries, prompt injection in LLM-mediated workflows, and deepfake-driven subversion of KYC verification layers. For each subtype, we analyse algorithmic strategy, feasibility constraints, stealth and persistence, and downstream financial consequences. Finally, we identify open challenges and outline a research agenda toward lifecycle-aware stress testing and finance-relevant robustness benchmarks.

cs.CR

ScioMind: Cognitively Grounded Multi-Agent Social Simulation with Anchoring-Based Belief Dynamics and Dynamic Profiles

Large language model (LLM)-based multi-agent simulation offers a powerful testbed for studying social opinion dynamics. Yet current approaches often adopt two contrasting methods: either relying on fixed update rules with limited cognitive grounding or delegating belief change largely to unconstrained LLM interaction. We introduce ScioMind, a cognitively grounded simulation framework that bridges these paradigms by combining structured opinion dynamics with LLM-based agent reasoning. ScioMind integrates three key components: 1) a memory-anchored belief update rule that modulates susceptibility to influence via personality-conditioned anchoring strength; 2) a hierarchical memory architecture that supports persistent, experience-driven belief formation; and 3) dynamic agent profiles derived from a corpus-grounded retrieval pipeline, enabling heterogeneous personalities, rationales, and evolving internal states. We evaluate ScioMind on multiple case studies in a real-world policy debate scenario. Across metrics including polarisation, diversity, extremization, and trajectory stability, the proposed components consistently yield improvements in behavioural realism. In particular, dynamic profiles increase opinion diversity, memory and reflection reduce unstable oscillation, and anchoring induces persistent belief trajectories that better align with patterns reported in political psychology. These results suggest that our cognitively grounded design provides a novel solution to LLM-based social simulation that improves both stable and behavioural realism

cs.AI

Training Versatile Coding Agents in Synthetic Environments

Prior works on training software engineering agents have explored utilizing existing resources such as issues on GitHub repositories to construct software engineering tasks and corresponding test suites. These approaches face two key limitations: (1) their reliance on pre-existing GitHub repositories offers limited flexibility, and (2) their primary focus on issue resolution tasks restricts their applicability to the much wider variety of tasks a software engineer must handle. To overcome these challenges, we introduce SWE-Playground, a novel pipeline for generating environments and trajectories which supports the training of versatile coding agents. Unlike prior efforts, SWE-Playground synthetically generates projects and tasks from scratch with strong language models and agents, eliminating reliance on external data sources. This allows us to tackle a much wider variety of coding tasks, such as reproducing issues by generating unit tests and implementing libraries from scratch. We demonstrate the effectiveness of this approach on three distinct benchmarks, and results indicate that SWE-Playground produces trajectories with dense training signal, enabling agents to reach comparable performance with significantly fewer trajectories than previous works.

cs.SE

CoSpace: Benchmarking Continuous Space Perception Ability for Vision-Language Models

Vision-Language Models (VLMs) have recently witnessed significant progress in visual comprehension. As the permitting length of image context grows, VLMs can now comprehend a broader range of views and spaces. Current benchmarks provide insightful analysis of VLMs in tasks involving complex visual instructions following, multi-image understanding and spatial reasoning. However, they usually focus on spatially irrelevant images or discrete images captured from varied viewpoints. The compositional characteristic of images captured from a static viewpoint remains underestimated. We term this characteristic as Continuous Space Perception. When observing a scene from a static viewpoint while shifting orientations, it produces a series of spatially continuous images, enabling the reconstruction of the entire space. In this paper, we present CoSpace, a multi-image visual understanding benchmark designed to assess the Continuous Space perception ability for VLMs. CoSpace contains 2,918 images and 1,626 question-answer pairs, covering seven types of tasks. We conduct evaluation across 19 proprietary and open-source VLMs. Results reveal that there exist pitfalls on the continuous space perception ability for most of the evaluated models, including proprietary ones. Interestingly, we find that the main discrepancy between open-source and proprietary models lies not in accuracy but in the consistency of responses. We believe that enhancing the ability of continuous space perception is essential for VLMs to perform effectively in real-world tasks and encourage further research to advance this capability.

cs.CV

AIGS: Generating Science from AI-Powered Automated Falsification

Rapid development of artificial intelligence has drastically accelerated the development of scientific discovery. Trained with large-scale observation data, deep neural networks extract the underlying patterns in an end-to-end manner and assist human researchers with highly-precised predictions in unseen scenarios. The recent rise of Large Language Models (LLMs) and the empowered autonomous agents enable scientists to gain help through interaction in different stages of their research, including but not limited to literature review, research ideation, idea implementation, and academic writing. However, AI researchers instantiated by foundation model empowered agents with full-process autonomy are still in their infancy. In this paper, we study $\textbf{AI-Generated Science}$ (AIGS), where agents independently and autonomously complete the entire research process and discover scientific laws. By revisiting the definition of scientific research, we argue that $\textit{falsification}$ is the essence of both human research process and the design of an AIGS system. Through the lens of falsification, prior systems attempting towards AI-Generated Science either lack the part in their design, or rely heavily on existing verification engines that narrow the use in specialized domains. In this work, we propose Baby-AIGS as a baby-step demonstration of a full-process AIGS system, which is a multi-agent system with agents in roles representing key research process. By introducing FalsificationAgent, which identify and then verify possible scientific discoveries, we empower the system with explicit falsification. Experiments on three tasks preliminarily show that Baby-AIGS could produce meaningful scientific discoveries, though not on par with experienced human researchers. Finally, we discuss on the limitations of current Baby-AIGS, actionable insights, and related ethical issues in detail.

cs.LG

Browse and Concentrate: Comprehending Multimodal Content via prior-LLM Context Fusion

With the bloom of Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) that incorporate LLMs with pre-trained vision models have recently demonstrated impressive performance across diverse vision-language tasks. However, they fall short to comprehend context involving multiple images. A primary reason for this shortcoming is that the visual features for each images are encoded individually by frozen encoders before feeding into the LLM backbone, lacking awareness of other images and the multimodal instructions. We term this issue as prior-LLM modality isolation and propose a two phase paradigm, browse-and-concentrate, to enable in-depth multimodal context fusion prior to feeding the features into LLMs. This paradigm initially "browses" through the inputs for essential insights, and then revisits the inputs to "concentrate" on crucial details, guided by these insights, to achieve a more comprehensive understanding of the multimodal inputs. Additionally, we develop training strategies specifically to enhance the understanding of multi-image inputs. Our method markedly boosts the performance on 7 multi-image scenarios, contributing to increments on average accuracy by 2.13% and 7.60% against strong MLLMs baselines with 3B and 11B LLMs, respectively.

cs.CL

A holistic review on fatigue properties of additively manufactured metals

Additive manufacturing (AM) technology is undergoing rapid development and emerging as an advanced technique that can fabricate complex near-net shaped and light-weight metallic parts with acceptable strength and fatigue performance. A number of studies have indicated that the strength or other mechanical properties of AM metals are comparable or even superior to that of conventionally manufactured metals, but the fatigue performance is still a thorny problem that may hinder the replacement of currently used metallic components by AM counterparts when the cyclic loading and thus fatigue failure dominates. This article reviews the state-of-art published data on the fatigue properties of AM metals, principally including $S$--$N$ data and fatigue crack growth data. The AM techniques utilized to generate samples in this review include powder bed fusion (e.g., EBM, SLM, DMLS) and directed energy deposition (e.g., LENS, WAAM). Further, the fatigue properties of AM metallic materials that involve titanium alloys, aluminum alloys, stainless steel, nickel-based alloys, magnesium alloys, and high entropy alloys, are systematically overviewed. In addition, summary figures or tables for the published data on fatigue properties are presented for the above metals, the AM techniques, and the influencing factors (manufacturing parameters, e.g., built orientation, processing parameter, and post-processing). The effects of build direction, particle, geometry, manufacturing parameters, post-processing, and heat-treatment on fatigue properties, when available, are provided and discussed. The fatigue performance and main factors affecting the fatigue behavior of AM metals are finally compared and critically analyzed, thus potentially providing valuable guidance for improving the fatigue performance of AM metals.

cond-mat.mtrl-sci

Nanoinstabilities of Cu2O porous nanostructured films as driven by nanocurvature effect and thermal activation effect

In this work, the instabilities at the nanoscale (i.e. nanoinstabilities) of triangular pyramids-like Cu2O porous nanostructured films (PNFs) are studied by heating treatments under different atmosphere and temperature. It is found that the nanoscale building triangular-pyramids turn round preferentially at the sharp angles and/or coalesce with their contacting ones by directional diffusion and plastic flow of atoms, which are driven by the nonuniformly-distributed surface nanocurvature. As a result, the triangular pyramids become quasi-sphere shape and the PNF evolves into a big, dense particles film. It is also observed that the heating or thermal activation effect efficiently promotes the reduction or oxidation of Cu2O pyramids and the crystallization or growth of the as-achieved Cu or CuO grains. The above physical and chemical instabilities or changes at the nanoscale of Cu2O PNFs can be well accounted for by the combined mechanism of nanocurvature effect and thermal activation effect. The nanocurvature effect can lower the energy barrier for the atom diffusion or plastic flow and lower the activation energy for the chemical reactions, while the thermal activation effect can supply the required kinetic energy or activation energy and make the atomic transportations and reactions kinetically possible. The findings reveal the evolution laws of morphology, crystal structure and composition of triangular pyramids-like Cu2O PNF during heating treatments, which can further be extended to other types of Cu2O PNFs. Also, the findings have important implications for the nanoinstabilities of Cu2O PNFs-based devices, especially those working at a high temperature.

cond-mat.mtrl-sci

Cu2O porous nanostructured films fabricated by positive bias sputtering deposition

In this work, the authors fabricated Cu2O porous nanostructured films (PNFs) on glass slide substrates by the newly developed positive bias deposition approach in a balanced magnetron sputtering (MS) system. It was found that the surface morphology, crystal structure and optical property of the as-deposited products were greatly dependent on the applied positive substrate bias. In particular, when the substrate was biased at +50 V and +150 V, both of the as-prepared Cu2O PNFs exhibited a unique triangular pyramids-like structure with obvious edges and corners and little gluing, a preferred orientation of (111) and a blue shift of energy band gap at 2.35 eV. Quantitative calculation results indicated that the traditional bombardment effects of electrons and sputtering argon ions were both negligible during the bias deposition in the balanced MS system. Instead, a new model of tip charging effect was further proposed to account for the controllable formation of PNFs by the balanced bias sputtering deposition.

cond-mat.mtrl-sci