arXiv subjects

Lei Shi

Publications and source records attributed to Lei Shi.

At least 163 records · Page 9Linked to original sources

arXiv2024

Full Quantum dynamics study for H atom scattering from graphene

This study deals with the understanding of hydrogen atom scattering from graphene, a process critical for exploring C-H bond formation and energy transfer during the atom surface collision. In our previous work (J.Chem.Phys \textbf{159}, 194102, (2023)), starting from a cell with 24 carbon atoms treated periodically, we have achieved quantum dynamics (QD) simulations with a reduced-dimensional model (15D) and a simulation in full dimensionality (75D). In the former work, the H atom attacked the top of a single C atom, enabling a comparison of QD simulation results with classical molecular dynamics (cMD). Our approach required the use of sophisticated techniques such as Monte Carlo Canonical Polyadic Decomposition (MCCPD) and Multilayer Multi-Configuration Time-Dependent Hartree (ML-MCTDH), as well as a further development of quantum flux calculations. We could benchmark our calculations by comparison with cMD calculations. We have now refined our method to better mimic experimental conditions. Specifically, rather than sending the H atom to a specific position on the surface, we have employed a plane wave for the H atom in directions parallel to the surface. Key findings for these new simulations include the identification of discrepancies between classical molecular dynamics (cMD) simulations and experiments, which are attributed to both the potential energy surface (PES) and quantum effects. Additionally, the study sheds light on the role of classical collective normal modes during collisions, providing insights into energy transfer processes. The results validate the robustness of our simulation methodologies and highlight the importance of considering quantum mechanical effects in the study of hydrogen-graphene interactions.

physics.chem-ph↗

arXiv2024

MFE-ETP: A Comprehensive Evaluation Benchmark for Multi-modal Foundation Models on Embodied Task Planning

In recent years, Multi-modal Foundation Models (MFMs) and Embodied Artificial Intelligence (EAI) have been advancing side by side at an unprecedented pace. The integration of the two has garnered significant attention from the AI research community. In this work, we attempt to provide an in-depth and comprehensive evaluation of the performance of MFM s on embodied task planning, aiming to shed light on their capabilities and limitations in this domain. To this end, based on the characteristics of embodied task planning, we first develop a systematic evaluation framework, which encapsulates four crucial capabilities of MFMs: object understanding, spatio-temporal perception, task understanding, and embodied reasoning. Following this, we propose a new benchmark, named MFE-ETP, characterized its complex and variable task scenarios, typical yet diverse task types, task instances of varying difficulties, and rich test case types ranging from multiple embodied question answering to embodied task reasoning. Finally, we offer a simple and easy-to-use automatic evaluation platform that enables the automated testing of multiple MFMs on the proposed benchmark. Using the benchmark and evaluation platform, we evaluated several state-of-the-art MFMs and found that they significantly lag behind human-level performance. The MFE-ETP is a high-quality, large-scale, and challenging benchmark relevant to real-world tasks.

cs.AI↗

arXiv2024

Unbiased third-party bots lead to a tradeoff between cooperation and social payoffs

The rise of artificial intelligence (AI) offers new opportunities to influence cooperative dynamics with greater applicability and control. In this paper, we examine the impact of third-party bots--agents that do not directly participate in games but unbiasedly modify the payoffs of normal players engaged in prisoner's dilemma interactions--on the emergence of cooperation. Using an evolutionary simulation model, we demonstrate that unbiased bots are unable to shift the defective equilibrium among normal players in well-mixed populations. However, in structured populations, despite their unbiased actions, the bots spontaneously generate distinct impacts on cooperators and defectors, leading to enhanced cooperation. Notably, bots that apply negative influences are more effective at promoting cooperation than those applying positive ones, as fewer bots are needed to catalyze cooperative behavior among normal players. However, as the number of bots increases, a trade-off emerges: while cooperation is maintained, overall social payoffs decline. These findings highlight the need for careful management of AI's role in social systems, as even well-intentioned bots can have unintended consequences on collective outcomes.

physics.soc-ph↗

arXiv2024

A Fairness-Oriented Control Framework for Safety-Critical Multi-Robot Systems: Alternative Authority Control

This paper proposes a fair control framework for multi-robot systems, which integrates the newly introduced Alternative Authority Control (AAC) and Flexible Control Barrier Function (F-CBF). Control authority refers to a single robot which can plan its trajectory while considering others as moving obstacles, meaning the other robots do not have authority to plan their own paths. The AAC method dynamically distributes the control authority, enabling fair and coordinated movement across the system. This approach significantly improves computational efficiency, scalability, and robustness in complex environments. The proposed F-CBF extends traditional CBFs by incorporating obstacle shape, velocity, and orientation. F-CBF enhances safety by accurate dynamic obstacle avoidance. The framework is validated through simulations in multi-robot scenarios, demonstrating its safety, robustness and computational efficiency.

cs.RO↗

arXiv2024

Explicit Modelling of Theory of Mind for Belief Prediction in Nonverbal Social Interactions

We propose MToMnet - a Theory of Mind (ToM) neural network for predicting beliefs and their dynamics during human social interactions from multimodal input. ToM is key for effective nonverbal human communication and collaboration, yet, existing methods for belief modelling have not included explicit ToM modelling or have typically been limited to one or two modalities. MToMnet encodes contextual cues (scene videos and object locations) and integrates them with person-specific cues (human gaze and body language) in a separate MindNet for each person. Inspired by prior research on social cognition and computational ToM, we propose three different MToMnet variants: two involving fusion of latent representations and one involving re-ranking of classification scores. We evaluate our approach on two challenging real-world datasets, one focusing on belief prediction, while the other examining belief dynamics prediction. Our results demonstrate that MToMnet surpasses existing methods by a large margin while at the same time requiring a significantly smaller number of parameters. Taken together, our method opens up a highly promising direction for future work on artificial intelligent systems that can robustly predict human beliefs from their non-verbal behaviour and, as such, more effectively collaborate with humans.

cs.AI↗

arXiv2024

Generative Agent-Based Models for Complex Systems Research: a review

The advent of Large Language Models (LLMs) has significantly transformed the fields of natural and social sciences. Generative Agent-Based Models (GABMs), which utilize large language models in place of real subjects, are gaining increasing public attention. Far from aiming for comprehensiveness, this paper aims to offer readers an opportunity to understand how large language models are disrupting complex systems research and behavioral sciences. In particular, we evaluate recent advancements in various domains within complex systems, encompassing network science, evolutionary game theory, social dynamics, and epidemic propagation. Additionally, we propose possible directions for future research to further advance these fields.

physics.soc-ph↗

arXiv2024

OpenCity: Open Spatio-Temporal Foundation Models for Traffic Prediction

Accurate traffic forecasting is crucial for effective urban planning and transportation management, enabling efficient resource allocation and enhanced travel experiences. However, existing models often face limitations in generalization, struggling with zero-shot prediction on unseen regions and cities, as well as diminished long-term accuracy. This is primarily due to the inherent challenges in handling the spatial and temporal heterogeneity of traffic data, coupled with the significant distribution shift across time and space. In this work, we aim to unlock new possibilities for building versatile, resilient and adaptive spatio-temporal foundation models for traffic prediction. To achieve this goal, we introduce a novel foundation model, named OpenCity, that can effectively capture and normalize the underlying spatio-temporal patterns from diverse data characteristics, facilitating zero-shot generalization across diverse urban environments. OpenCity integrates the Transformer architecture with graph neural networks to model the complex spatio-temporal dependencies in traffic data. By pre-training OpenCity on large-scale, heterogeneous traffic datasets, we enable the model to learn rich, generalizable representations that can be seamlessly applied to a wide range of traffic forecasting scenarios. Experimental results demonstrate that OpenCity exhibits exceptional zero-shot predictive performance. Moreover, OpenCity showcases promising scaling laws, suggesting the potential for developing a truly one-for-all traffic prediction solution that can adapt to new urban contexts with minimal overhead. We made our proposed OpenCity model open-source and it is available at the following link: https://github.com/HKUDS/OpenCity.

cs.LG↗

arXiv2024

GeneticPrism: Multifaceted Visualization of Scientific Impact Evolutions

Understanding the evolution of scholarly impact is essential for many real-life decision-making processes in academia, such as research planning, frontier exploration, and award selection. Popular platforms like Google Scholar and Web of Science rely on numerical indicators that are too abstract to convey the context and content of scientific impact, while most existing visualization approaches on mapping science do not consider the presentation of individual scholars' impact evolution using curated self-citation data. This paper builds on our previous work and proposes an integrated pipeline to visualize a scholar's impact evolution from multiple topic facets. A novel 3D prism-shaped visual metaphor is introduced as the overview of a scholar's impact, whilst their scientific evolution on each topic is displayed in a more structured manner. Additional designs by topic chord diagram, streamgraph visualization, and inter-topic flow map, optimized by an elaborate layout algorithm, assist in perceiving the scholar's scientific evolution across topics. A new six-degree-impact glyph metaphor highlights key interdisciplinary works driving the evolution. The proposed visualization methods are evaluated through case studies analyzing the careers of prestigious Turing award laureates and a major visualization venue.

cs.DL↗

arXiv2024

LEGENT: Open Platform for Embodied Agents

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical environments. Existing integrations often feature limited open sourcing, challenging collective progress in this field. We introduce LEGENT, an open, scalable platform for developing embodied agents using LLMs and LMMs. LEGENT offers a dual approach: a rich, interactive 3D environment with communicable and actionable agents, paired with a user-friendly interface, and a sophisticated data generation pipeline utilizing advanced algorithms to exploit supervision from simulated worlds at scale. In our experiments, an embryonic vision-language-action model trained on LEGENT-generated data surpasses GPT-4V in embodied tasks, showcasing promising generalization capabilities.

cs.CL↗

arXiv2024

Solving PDEs on Spheres with Physics-Informed Convolutional Neural Networks

Physics-informed neural networks (PINNs) have been demonstrated to be efficient in solving partial differential equations (PDEs) from a variety of experimental perspectives. Some recent studies have also proposed PINN algorithms for PDEs on surfaces, including spheres. However, theoretical understanding of the numerical performance of PINNs, especially PINNs on surfaces or manifolds, is still lacking. In this paper, we establish rigorous analysis of the physics-informed convolutional neural network (PICNN) for solving PDEs on the sphere. By using and improving the latest approximation results of deep convolutional neural networks and spherical harmonic analysis, we prove an upper bound for the approximation error with respect to the Sobolev norm. Subsequently, we integrate this with innovative localization complexity analysis to establish fast convergence rates for PICNN. Our theoretical results are also confirmed and supplemented by our experiments. In light of these findings, we explore potential strategies for circumventing the curse of dimensionality that arises when solving high-dimensional PDEs.

math.NA↗

arXiv2024

Inherent spin-orbit locking in topological bound state in the continuum lasing

Bound states in the continuum (BICs) are exotic optical topological singularities that defy the typical radiation within the continuum of radiative modes and carry topological polarization vortices in momentum space. Enabling ultrahigh quality factors, BICs have been applied in realizing lasing and Bose-Einstein condensation via micro-/nano- photonic structures, and their momentum-space vortex topologies have been exploited in passive systems, revealing novel spin-orbit photonic effects. However, as representative topological properties, the spin-orbit-related phenemona of BICs in active systems have not yet been explored. Here, we demonstrate the inherent spin-orbit locking in topological BIC lasing. Utilizing photonic crystal (PhC) slabs with square (C4v) and triangular (C6v) lattices, we achieve distinct spin-orbit locking combinations in topological BIC lasing of +1 and -2 topological charges. These BIC lasing profiles manifest as vortex and high-order anti-vortex polarization configurations, directly tied to the topological properties of BICs. Our experimental results directly reveal the spin-orbit locking phenomena through momentum-space spin-dependent self-interference patterns and real-space spin separations of the lasing emissions. This study not only highlights the inherent spin-orbit-locking behaviours of topological BIC lasing but also opens new possibilities for dynamically switchable orbital angular momentum (OAM) lasing by controlling photonic spin, presenting significant potential for advancements in topological photonic source applications.

physics.optics↗

arXiv2024

ActionDiffusion: An Action-aware Diffusion Model for Procedure Planning in Instructional Videos

We present ActionDiffusion -- a novel diffusion model for procedure planning in instructional videos that is the first to take temporal inter-dependencies between actions into account in a diffusion model for procedure planning. This approach is in stark contrast to existing methods that fail to exploit the rich information content available in the particular order in which actions are performed. Our method unifies the learning of temporal dependencies between actions and denoising of the action plan in the diffusion process by projecting the action information into the noise space. This is achieved 1) by adding action embeddings in the noise masks in the noise-adding phase and 2) by introducing an attention mechanism in the noise prediction network to learn the correlations between different action steps. We report extensive experiments on three instructional video benchmark datasets (CrossTask, Coin, and NIV) and show that our method outperforms previous state-of-the-art methods on all metrics on CrossTask and NIV and all metrics except accuracy on Coin dataset. We show that by adding action embeddings into the noise mask the diffusion model can better learn action temporal dependencies and increase the performances on procedure planning.

cs.CV↗

arXiv2024

Spin-Orbit-Locking Chiral Bound States in the Continuum

Bound states in the continuum (BICs), which are confined optical modes exhibiting infinite quality factors and carrying topological polarization configurations in momentum space, have recently sparked significant interest across both fundamental and applied physics.} Here we show that breaking time-reversal symmetry by external magnetic field enables a new form of chiral BICs with spin-orbit locking. Applying a magnetic field to a magneto-optical photonic crystal slab lifts doubly degenerate BICs into a pair of chiral BICs carrying opposite pseudo-spins and orbital angular momenta. Multipole analysis verifies the non-zero angular momenta and reveals the spin-orbital-locking behaviors. In momentum space, we observe ultrahigh quality factors and near-circular polarization surrounding chiral BICs, enabling potential applications in spin-selective nanophotonics. Compared to conventional BICs, the magnetically-induced chiral BICs revealed here exhibit distinct properties and origins, significantly advancing the topological photonics of BICs by incorporating broken time-reversal symmetry.

physics.optics↗

arXiv2024

Multi-Modal Video Dialog State Tracking in the Wild

We present MST-MIXER - a novel video dialog model operating over a generic multi-modal state tracking scheme. Current models that claim to perform multi-modal state tracking fall short of two major aspects: (1) They either track only one modality (mostly the visual input) or (2) they target synthetic datasets that do not reflect the complexity of real-world in the wild scenarios. Our model addresses these two limitations in an attempt to close this crucial research gap. Specifically, MST-MIXER first tracks the most important constituents of each input modality. Then, it predicts the missing underlying structure of the selected constituents of each modality by learning local latent graphs using a novel multi-modal graph structure learning method. Subsequently, the learned local graphs and features are parsed together to form a global graph operating on the mix of all modalities which further refines its structure and node embeddings. Finally, the fine-grained graph node features are used to enhance the hidden states of the backbone Vision-Language Model (VLM). MST-MIXER achieves new state-of-the-art results on five challenging benchmarks.

cs.CV↗

arXiv2024

A microwave photonic prototype for concurrent radar detection and spectrum sensing over an 8 to 40 GHz bandwidth

In this work, a microwave photonic prototype for concurrent radar detection and spectrum sensing is proposed, designed, built, and investigated. A direct digital synthesizer and an analog electronic circuit are integrated to generate an intermediate frequency (IF) linearly frequency-modulated (LFM) signal with a tunable center frequency from 2.5 to 9.5 GHz and an instantaneous bandwidth of 1 GHz. The IF LFM signal is converted to the optical domain via an intensity modulator and then filtered by a fiber Bragg grating (FBG) to generate only two 2nd-order optical LFM sidebands. In radar detection, the two optical LFM sidebands beat with each other to generate a frequency-and-bandwidth-quadrupled LFM signal, which is used for ranging, radial velocity measurement, and imaging. By changing the center frequency of the IF LFM signal, the radar function can be operated within 8 to 40 GHz. In spectrum sensing, one 2nd-order optical LFM sideband is selected by another FBG, which then works in conjunction with the stimulated Brillouin scattering gain spectrum to map the frequency of the signal under test to time with an instantaneous measurement bandwidth of 2 GHz. By using a frequency shift module to adjust the pump frequency, the frequency measurement range can be adjusted from 0 to 40 GHz. The prototype is comprehensively studied and tested, which is capable of achieving a range resolution of 3.75 cm, a range error of less than $\pm$ 2 cm, a radial velocity error within $\pm$ 1 cm/s, delivering clear imaging of multiple small targets, and maintaining a frequency measurement error of less than $\pm$ 7 MHz and a frequency resolution of better than 20 MHz.

physics.optics↗

arXiv2024

Some theoretical foundations for the design and analysis of randomized experiments

Neyman[106]'s seminal work in 1923 has been a milestone in statistics over the century, which has motivated many fundamental statistical concepts and methodology. In this review, we delve into Neyman[106]'s groundbreaking contribution and offer technical insights into the design and analysis of randomized experiments. We shall review the basic setup of completely randomized experiments and the classical approaches for inferring the average treatment effects. We shall in particular review more efficient design and analysis of randomized experiments by utilizing pretreatment covariates, which move beyond Neyman's original work without involving any covariate. We then summarize several technical ingredients regarding randomizations and permutations that have been developed over the century, such as permutational central limit theorems and Berry-Esseen bounds, and elaborate on how these technical results facilitate the understanding of randomized experiments. The discussion is also extended to other randomized experiments including rerandomization, stratified randomized experiments, matched pair experiments, cluster randomized experiments, etc.

math.ST↗

arXiv2024

Topological water-wave structures manipulating particles

Topological wave structures, such as vortices and skyrmions, appear in a variety of quantum and classical wave fields, including optics and acoustics. In particular, optical vortices have found numerous applications ranging from quantum information to astrophysics. Furthermore, both optical and acoustic structured waves are crucial for manipulation of small particles, from atoms to macroscopic biological objects. Here we report on the controllable generation of topological structures -- wave vortices, skyrmions, and polarization Möbius strips -- in interfering gravity water waves. Most importantly, we demonstrate efficient manipulation of subwavelength and wavelength-order floating particles with topologically structured water waves. This includes trapping of the particles in the high-intensity field zones, as well as controllable orbital and spinning motions due to the orbital and spin angular momenta of water waves. Our results reveal the water-wave counterpart of optical and acoustic manipulations, which paves the avenue for applications in hydrodynamics and microfluidics.

physics.class-ph↗

arXiv2024

Enhancing social cohesion with cooperative bots in societies of greedy, mobile individuals

Addressing collective issues in social development requires a high level of social cohesion, characterized by cooperation and close social connections. However, social cohesion is challenged by selfish, greedy individuals. With the advancement of artificial intelligence (AI), the dynamics of human-machine hybrid interactions introduce new complexities in fostering social cohesion. This study explores the impact of simple bots on social cohesion from the perspective of human-machine hybrid populations within network. By investigating collective self-organizing movement during migration, results indicate that cooperative bots can promote cooperation, facilitate individual aggregation, and thereby enhance social cohesion. The random exploration movement of bots can break the frozen state of greedy population, help to separate defectors in cooperative clusters, and promote the establishment of cooperative clusters. However, the presence of defective bots can weaken social cohesion, underscoring the importance of carefully designing bot behavior. Our research reveals the potential of bots in guiding social self-organization and provides insights for enhancing social cohesion in the era of human-machine interaction within social networks.

physics.soc-ph↗