arXiv subjects

Lu Qiu

Publications and source records attributed to Lu Qiu.

17 recordsLinked to original sources

arXiv2026

Making Foresight Actionable: Repurposing Representation Alignment in World Action Models

World Action Models (WAMs) offer a promising route for robot manipulation by using video generation models to model future scene evolution before producing control actions. However, our empirical observations reveal a phenomenon: generating plausible visual futures does not always guarantee the extraction of accurate actions. To diagnose this failure, we conduct action-head attention analysis and causal interventions. We find that the action decoder fails to focus on task-relevant interaction regions and remains sensitive to perturbations in task-irrelevant areas. This reveals a representation mismatch: hidden states optimized for visual reconstruction are not inherently organized in a form useful for low-level action control. In this paper, we propose AGRA, an Action-Grounded Representation Alignment objective that regularizes the world-action interface by aligning intermediate video diffusion features with spatially coherent semantic representations from a foundation visual encoder. We evaluate AGRA on real-world manipulation tasks. Experiments show that AGRA makes world model representations more action-grounded: by focusing the action decoder on the correct interaction regions, it improves object localization accuracy and affordance understanding, and makes the policy more robust to perturbations in task-irrelevant regions. As a result, AGRA consistently improves both in-distribution performance and out-of-distribution generalization over the baseline world action model.

cs.CV↗

arXiv2026

UniT: Toward a Unified Physical Language for Human-to-Humanoid Policy Learning and World Modeling

Scaling humanoid foundation models is bottlenecked by the scarcity of robotic data. While massive egocentric human data offers a scalable alternative, bridging the cross-embodiment chasm remains a fundamental challenge due to kinematic mismatches. We introduce UniT (Unified Latent Action Tokenizer via Visual Anchoring), a framework that establishes a unified physical language for human-to-humanoid transfer. Grounded in the philosophy that heterogeneous kinematics share universal visual consequences, UniT employs a tri-branch cross-reconstruction mechanism: actions predict vision to anchor kinematics to physical outcomes, while vision reconstructs actions to filter out irrelevant visual confounders. Concurrently, a fusion branch synergies these purified modalities into a shared discrete latent space of embodiment-agnostic physical intents. We validate UniT across two paradigms: 1) Policy Learning (VLA-UniT): By predicting these unified tokens, it effectively leverages diverse human data to achieve state-of-the-art data efficiency and robust out-of-distribution (OOD) generalization on both humanoid simulation benchmark and real-world deployments, notably demonstrating zero-shot task transfer. 2) World Modeling (WM-UniT): By aligning cross-embodiment dynamics via unified tokens as conditions, it realizes direct human-to-humanoid action transfer. This alignment ensures that human data seamlessly translates into enhanced action controllability for humanoid video generation. Ultimately, by inducing a highly aligned cross-embodiment representation (empirically verified by t-SNE visualizations revealing the convergence of human and humanoid features into a shared manifold), UniT offers a scalable path to distill vast human knowledge into general-purpose humanoid capabilities.

cs.RO↗

arXiv2025

ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shorts

Real-world user-generated short videos, especially those distributed on platforms such as WeChat Channel and TikTok, dominate the mobile internet. However, current large multimodal models lack essential temporally-structured, detailed, and in-depth video comprehension capabilities, which are the cornerstone of effective video search and recommendation, as well as emerging video applications. Understanding real-world shorts is actually challenging due to their complex visual elements, high information density in both visuals and audio, and fast pacing that focuses on emotional expression and viewpoint delivery. This requires advanced reasoning to effectively integrate multimodal information, including visual, audio, and text. In this work, we introduce ARC-Hunyuan-Video, a multimodal model that processes visual, audio, and textual signals from raw video inputs end-to-end for structured comprehension. The model is capable of multi-granularity timestamped video captioning and summarization, open-ended video question answering, temporal video grounding, and video reasoning. Leveraging high-quality data from an automated annotation pipeline, our compact 7B-parameter model is trained through a comprehensive regimen: pre-training, instruction fine-tuning, cold start, reinforcement learning (RL) post-training, and final instruction fine-tuning. Quantitative evaluations on our introduced benchmark ShortVid-Bench and qualitative comparisons demonstrate its strong performance in real-world video comprehension, and it supports zero-shot or fine-tuning with a few samples for diverse downstream applications. The real-world production deployment of our model has yielded tangible and measurable improvements in user engagement and satisfaction, a success supported by its remarkable efficiency, with stress tests indicating an inference time of just 10 seconds for a one-minute video on H20 GPU.

cs.CV↗

arXiv2025

AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generation

Recent advances in AI-generated content (AIGC) have significantly accelerated animation production. To produce engaging animations, it is essential to generate coherent multi-shot video clips with narrative scripts and character references. However, existing public datasets primarily focus on real-world scenarios with global descriptions, and lack reference images for consistent character guidance. To bridge this gap, we present AnimeShooter, a reference-guided multi-shot animation dataset. AnimeShooter features comprehensive hierarchical annotations and strong visual consistency across shots through an automated pipeline. Story-level annotations provide an overview of the narrative, including the storyline, key scenes, and main character profiles with reference images, while shot-level annotations decompose the story into consecutive shots, each annotated with scene, characters, and both narrative and descriptive visual captions. Additionally, a dedicated subset, AnimeShooter-audio, offers synchronized audio tracks for each shot, along with audio descriptions and sound sources. To demonstrate the effectiveness of AnimeShooter and establish a baseline for the reference-guided multi-shot video generation task, we introduce AnimeShooterGen, which leverages Multimodal Large Language Models (MLLMs) and video diffusion models. The reference image and previously generated shots are first processed by MLLM to produce representations aware of both reference and context, which are then used as the condition for the diffusion model to decode the subsequent shot. Experimental results show that the model trained on AnimeShooter achieves superior cross-shot visual consistency and adherence to reference visual guidance, which highlight the value of our dataset for coherent animated video generation.

cs.CV↗

arXiv2025

Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal Large Language Models (MLLMs) inherit this reasoning potential but remain underexplored in tasks requiring both perception and logical reasoning. To address this, we introduce SEED-Bench-R1, a benchmark designed to systematically evaluate post-training methods for MLLMs in video understanding. It includes intricate real-world videos and complex everyday planning tasks in the format of multiple-choice questions, requiring sophisticated perception and reasoning. SEED-Bench-R1 assesses generalization through a three-level hierarchy: in-distribution, cross-environment, and cross-environment-task scenarios, equipped with a large-scale training dataset with easily verifiable ground-truth answers. Using Qwen2-VL-Instruct-7B as a base model, we compare RL with supervised fine-tuning (SFT), demonstrating RL's data efficiency and superior performance on both in-distribution and out-of-distribution tasks, even outperforming SFT on general video understanding benchmarks like LongVideoBench. Our detailed analysis reveals that RL enhances visual perception but often produces less logically coherent reasoning chains. We identify key limitations such as inconsistent reasoning and overlooked visual cues, and suggest future improvements in base model reasoning, reward modeling, and RL robustness against noisy signals.

cs.CV↗

arXiv2024

EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios

The advent of Multimodal Large Language Models, leveraging the power of Large Language Models, has recently demonstrated superior multimodal understanding and reasoning abilities, heralding a new era for artificial general intelligence. However, achieving AGI necessitates more than just comprehension and reasoning. A crucial capability required is effective planning in diverse scenarios, which involves making reasonable decisions based on complex environments to solve real-world problems. Despite its importance, the planning abilities of current MLLMs in varied scenarios remain underexplored. In this paper, we introduce EgoPlan-Bench2, a rigorous and comprehensive benchmark designed to assess the planning capabilities of MLLMs across a wide range of real-world scenarios. EgoPlan-Bench2 encompasses everyday tasks spanning 4 major domains and 24 detailed scenarios, closely aligned with human daily life. EgoPlan-Bench2 is constructed through a semi-automatic process utilizing egocentric videos, complemented by manual verification. Grounded in a first-person perspective, it mirrors the way humans approach problem-solving in everyday life. We evaluate 21 competitive MLLMs and provide an in-depth analysis of their limitations, revealing that they face significant challenges in real-world planning. To further improve the planning proficiency of current MLLMs, we propose a training-free approach using multimodal Chain-of-Thought (CoT) prompting through investigating the effectiveness of various multimodal prompts in complex planning. Our approach enhances the performance of GPT-4V by 10.24 on EgoPlan-Bench2 without additional training. Our work not only sheds light on the current limitations of MLLMs in planning, but also provides insights for future enhancements in this critical area. We have made data and code available at https://qiulu66.github.io/egoplanbench2/.

cs.AI↗

arXiv2024

Data Caching for Enterprise-Grade Petabyte-Scale OLAP

With the exponential growth of data and evolving use cases, petabyte-scale OLAP data platforms are increasingly adopting a model that decouples compute from storage. This shift, evident in organizations like Uber and Meta, introduces operational challenges including massive, read-heavy I/O traffic with potential throttling, as well as skewed and fragmented data access patterns. Addressing these challenges, this paper introduces the Alluxio local (edge) cache, a highly effective architectural optimization tailored for such environments. This embeddable cache, optimized for petabyte-scale data analytics, leverages local SSD resources to alleviate network I/O and API call pressures, significantly improving data transfer efficiency. Integrated with OLAP systems like Presto and storage services like HDFS, the Alluxio local cache has demonstrated its effectiveness in handling large-scale, enterprise-grade workloads over three years of deployment at Uber and Meta. We share insights and operational experiences in implementing these optimizations, providing valuable perspectives on managing modern, massive-scale OLAP workloads.

cs.DC↗

arXiv2024

Ultra-Long Homochiral Graphene Nanoribbons Grown Within h-BN Stacks for High-Performance Electronics

Van der Waals encapsulation of two-dimensional materials within hexagonal boron nitride (h-BN) stacks has proven to be a promising way to create ultrahigh-performance electronic devices. However, contemporary approaches for achieving van der Waals encapsulation, which involve artificial layer stacking using mechanical transfer techniques, are difficult to control, prone to contamination, and unscalable. Here, we report on the transfer-free direct growth of high-quality graphene nanoribbons (GNRs) within h-BN stacks. The as-grown embedded GNRs exhibit highly desirable features being ultralong (up to 0.25 mm), ultranarrow ( < 5 nm), and homochiral with zigzag edges. Our atomistic simulations reveal that the mechanism underlying the embedded growth involves ultralow GNR friction when sliding between AA'-stacked h-BN layers. Using the grown structures, we demonstrate the transfer-free fabrication of embedded GNR field-effect devices that exhibit excellent performance at room temperature with mobilities of up to 4,600 $cm^{2} V^{-1} s^{-1}$ and on-off ratios of up to $10^{6}$. This paves the way to the bottom-up fabrication of high-performance electronic devices based on embedded layered materials.

cond-mat.mes-hall↗

arXiv2023

Rapid online solution of inverse heat transfer problem by ANN-based extended Kalman smoothing algorithm

Digital twin is a modern technology for many advanced applications. To construct a digital twin of a thermal system, it is required to make online estimations of unknown time-varying boundary conditions from sensor measured data, which needs to solve inverse heat transfer problems (IHTPs). However, a fast and accurate solution is challenging since the measured data is normally contaminated with noise and the traditional method to solve IHTP involves significant amount of calculations. Therefore, in this work, a rapid yet robust inversion algorithm called ANN-based extended Kalman smoothing algorithm is developed to realize the online prediction of desired parameter based on the measurements. The fast prediction is realized by replacing the conventional CFD-based state transfer models in extended Kalman smoothing algorithm with pre-trained ANN. Then, a two-dimensional internal convective heat transfer problem was employed as the case study to test the algorithm. The results have proved that the proposed algorithm is a computational-light and robust approach for solving IHTPs. The proposed algorithm can achieve estimation of unknown boundary conditions with a dimensionless average error of 0.0580 under noisy temperature measurement with a standard deviation of 10 K with a drastic reduction of computational cost compared to the conventional approach. Moreover, the effects of training data, location of sensor, future time step selection on the performance of prediction are investigated.

eess.SY↗

arXiv2022

Catalytic growth of ultralong graphene nanoribbons on insulating substrates

Graphene nanoribbons (GNRs) with widths of a few nanometres are promising candidates for future nano-electronic applications due to their structurally tunable bandgaps, ultrahigh carrier mobilities, and exceptional stability. However, the direct growth of micrometre-long GNRs on insulating substrates, which is essential for the fabrication of nano-electronic devices, remains an immense challenge. Here, we report the epitaxial growth of GNRs on an insulating hexagonal boron nitride (h-BN) substrate through nanoparticle-catalysed chemical vapor deposition (CVD). Ultra-narrow GNRs with lengths of up to 10 {\mu}m are synthesized. Remarkably, the as-grown GNRs are crystallographically aligned with the h-BN substrate, forming one-dimensional (1D) moir\'e superlattices. Scanning tunnelling microscopy reveals an average width of 2 nm and a typical bandgap of ~1 eV for similar GNRs grown on conducting graphite substrates. Fully atomistic computational simulations support the experimental results and reveal a competition between the formation of GNRs and carbon nanotubes (CNTs) during the nucleation stage, and van der Waals sliding of the GNRs on the h-BN substrate throughout the growth stage. Our study provides a scalable, single-step method for growing micrometre-long narrow GNRs on insulating substrates, thus opening a route to explore the performance of high-quality GNR devices and the fundamental physics of 1D moir\'e superlattices.

cond-mat.mes-hall↗

arXiv2021

A General Machine Learning-based Approach for Inverse Design of One-dimensional Photonic Crystals Toward Targeted Visible Light Reflection Spectrum

Data-driven methods have increasingly been applied to the development of optical systems as inexpensive and effective inverse design approaches. Optical properties (e.g., band-gap properties) of photonic crystals (PCs) are closely associated with characteristics of their light reflection spectra. Finding optimal PC constructions (within a pre-specified parameter space) that generate reflection spectra closest to a targeted spectrum is thus an interesting and meaningful inverse design problem, although relevant studies are still limited. Here we report a generally effective machine learning-based inverse design approach for one-dimensional photonic crystals (1DPCs), focusing on visible light spectra which are of high practical relevance. For a given class of 1DPC system, a deep neural network (DNN) in a unified structure is first trained over data from sizeable forward calculations (from layer thicknesses to spectrum). An iterative optimization scheme is then developed based on a coherent integration of DNN backward predictions (from spectrum to layer thicknesses), forward calculations, and Monte Carlo moves. We employ this new approach to four representative 1DPC systems including periodic structures with two-, three-, and four-layer repeating units and a heterostructure. The approach successfully converges to solutions of optimal 1DPC constructions for various targeted spectra regardless of their exact achievability. As two demonstrating examples, inverse designs toward a specially constructed "rectangle-shaped" green-light or red-light reflection spectrum are presented and discussed in detail. Remarkably, the results show that the approach can efficiently find out optimal layer thicknesses even when they are far outside the range covered by the original training data of DNN.

physics.optics↗

arXiv2021

Two distinct approaches to tune multiple reflective bands of one-dimensional photonic crystal at normal incidence

One-dimensional photonic crystals (1D PC) represent a class of periodic optical material, composed of alternating media with different dielectric constants along one direction. The most important property of 1D PCs is their photonic band-gap. However, multiple reflective bands are rarely reported in this research area. In this paper we demonstrate the tunability of multiple reflective bands in conventional 1D PC structure and 1D PC heterostructure. For both two types of 1D PC construction, positions of multiple reflective bands can be regulated under certain principles. In addition, structural color is revealed by transforming reflection spectra into CIE coordinates. It is indicated that the CIE coordinate shifts caused by multiple reflective bands behave quite different compared to those caused by one major photonic band-gap. The two approaches reported in this work may provide insights for the application of 1D PC in areas such as displays, sensors, and decoration.

physics.optics↗

arXiv2021

High-Intensity and Uniform Red-Green-Blue Triple Reflective Bands Achieved by Rationally-Designed Ultrathin Heterostructure Photonic Crystals

The relationships between material constructions and reflective spectrum patterns are important properties of photonic crystals. One particular interesting reflectance profile is a high-intensity and uniform three-peak pattern with peak positions right located at the red, green, and blue (RGB, three original colors) region. For ease of construction, a seek for using one-dimensional photonic crystals to achieve RGB triple reflective bands is a meaningful endeavor. Only very limited previous studies exist, all relying on traditional periodic photonic crystals (PPCs) and of large thickness. The underlying physical principles remain elusive, leaving the question of thickness limit to achieve RGB bands unaddressed. Here, we present the first detailed work to explore the thickness limit issue based on both theoretical and experimental investigation. A set of heuristically derived design principles are used to uncover that the break of translational symmetry, thus introducing heterostructure photonic crystals (HPCs), is essential to reduce the total optical path difference (OPD) to ~ 3200nm (the theoretical limit) while still exhibiting high-quality RGB bands. A systematic experiment based on a 12-layer heterostructure construction was performed and well confirmed the theoretical predictions. The associated three-peak properties are successfully used to realize quantum dot fluorescent enhancement phenomena. Furthermore, the HPC exhibits unusually stability against solvent stimulus, in strong contrast to typical behaviors reported in PPCs. Our work for the first time proposes and verifies important rational rules for designing ultrathin HPCs toward RGB reflective bands, and provides insights for a wider range of explorations of light manipulation in photonic crystals.

physics.optics↗

arXiv2021

Angstrom-wide conductive channels in black phosphorus by Cu intercalation

Intercalation is an effective method to improve and modulate properties of two-dimensional materials. Even so, spatially controlled intercalation at atomic scale, which is important to introduce and modulated properties, has not been successful due to difficulties in controlling the diffusion of intercalants. Here, we show formation of angstrom-wide conductive channels (~4.3 A) in black phosphorus by Cu intercalation. The atomic structure, resultant microstructural effects, intercalation mechanism, and local variations of electronic properties modulated in black phosphorus by Cu intercalation were investigated extensively by transmission electron microscopy including in situ observation, DFT calculation, and conductive atomic force microscopy.

cond-mat.mtrl-sci↗

arXiv2018

Size dependence of the Graphene Islands Moving on Cu (111) Surface during the CVD Growth

The graphene islands, formed as different sizes, are crucial for the final quality of the formed graphene during the CVD growth either as the nucleation seeds or as the build blocks for larger graphene domains. Extensive efforts had been devoted to the size or the morphology control while fewer works were reported on the moving dynamics of these graphene islands as well as the associate influences to their coalescence during the CVD Growth of graphene. In this study, based on the self-developed C-Cu empirical potential, we performed systematic molecular dynamics simulations on the surface moving of three typical graphene islands CN (N = 24, 54 and 96) on the Cu (111) surface and discovered their different behaviors in sinking, lateral translation and rotation at the atomic scale owning to their different sizes, which were proved to bring forth significant impacts to their coalescences and the final quality of the as-formed larger domains of graphene. This study would deepen our atomistic insights into the mechanisms of the graphene CVD growth and provide significant theoretical guidelines to its controlled synthesis.

physics.comp-ph↗

arXiv2018

Immediate Causality Network of Stock Markets

A financial system contains many elements networked by their relationships. Extensive works show that topological structure of the network stores rich information on evolutionary behaviors of the system such as early warning signals of collapses and/or crises. Existing works focus mainly on the network structure within a single stock market, while a collapse/crisis occurs in a macro-scale covering several or even all markets in the world. This mismatch of scale leads to unacceptable noise to the topological structure, and lack of information stored in relationships between different markets. In this work by using the transfer entropy we reconstruct the influential network between ten typical stock markets distributed in the world. Interesting findings include, before a financial crisis the connection strength reaches a maxima, which can act as an early warning signal of financial crises; The markets in America are mono-directionally and strongly influenced by that in Europe and act as the center; Some strongly linked pairs have also close correlations. The findings are helpful in understanding the evolution and modelling the dynamical process of the global financial system.

q-fin.ST↗

arXiv2012

Evaluation of Scale-Invariance In Physiological Signals By Means Of Balanced Estimation Of Diffusion Entropy

By means of the concept of balanced estimation of diffusion entropy we evaluate reliable scale-invariance embedded in different sleep stages and stride records. Segments corresponding to Wake, light sleep, REM, and deep sleep stages are extracted from long-term EEG signals. For each stage the scaling value distributes in a considerable wide range, which tell us that the scaling behavior is subject- and sleep cycle- dependent. The average of the scaling exponent values for wake segments is almost the same with that for REM segments ($\sim 0.8$). Wake and REM stages have significant high value of average scaling exponent, compared with that for light sleep stages ($\sim 0.7$). For the stride series, the original diffusion entropy (DE) and balanced estimation of diffusion entropy (BEDE) give almost the same results for de-trended series. Evolutions of local scaling invariance show that the physiological states change abruptly, though in the experiments great efforts have been done to keep conditions unchanged. Global behaviors of a single physiological signal may lose rich information on physiological states. Methodologically, BEDE can evaluate with considerable precision scale-invariance in very short time series ($\sim 10^2$), while the original DE method sometimes may underestimate scale-invariance exponents or even fail in detecting scale-invariant behavior. The BEDE method is sensitive to trends in time series. Existence of trend may leads to a unreasonable high value of scaling exponent, and consequent mistake conclusions.

cond-mat.dis-nn↗