arXiv subjects

Peng Li

Publications and source records attributed to Peng Li.

At least 163 records · Page 9Linked to original sources

arXiv2025

Orbital-selective charge transfer drives two-step negative thermal expansion structural transitions in PbTa2Se4

The negative thermal expansion (NTE) effect has been found generally combined with structural phase transitions. However, the charge and orbital freedoms of the NTE has not been well studied. This study employs angle-resolved photoemission spectroscopy and first-principles calculations to elucidate the charge and orbital kinetics of the anomalous two-step negative thermal expansion structural phase transitions in PbTa2Se4. As the temperature decreases, each transition undergoes a similar block-layer sliding, although the charge transfer behaviors differ significantly. During the first transition, charge is mainly transferred from the Pb 6pz orbital to an M-shaped band below the Fermi level, barely altering the Fermi surface. In contrast, the second transition involves modifications to both the Fermi surface and charge-transfer orbitals, with charge selectively transferred from Pb 6px/py orbitals to Ta 5dz2 orbitals and a decrease of the Fermi pockets formed by Pb 6px/py orbitals. Furthermore, a small pressure can easily tune the base structure phase among the three phases and the corresponding superconductivity. Therefore, our findings reveal that the orbital-selective charge transfer drives the unusual structure transition in PbTa2Se4, offering new insights into the NTE mechanisms and providing a unique window to study the pressure-tuned superconductivity in this metal-intercalated transition chalcogenides.

cond-mat.mtrl-sci↗

arXiv2025

Nodeless superconducting gap and electron-boson coupling in (La,Pr,Sm)$_{3}$Ni$_2$O$_7$ films

The discovery of superconductivity in Ruddlesden-Popper (RP) bilayer nickelate films under ambient pressure provides an unprecedented opportunity to directly investigate electronic energy scales of the superconducting state and the pairing mechanism. Here, we report angle-resolved photoemission spectroscopy measurements of superconducting (La,Pr,Sm)$_{3}$Ni$_2$O$_7$ thin films epitaxially grown on SrLaAlO$_4$ substrates by developing an ultra-high vacuum low-temperature quenching and transfer technique. A finite superconducting gap of ~18 meV with pronounced coherence peak is observed along the Brillouin zone diagonal direction. Remarkably, the finite superconducting gap persists across the entire Brillouin zone of the underlying Fermi surfaces, revealing the absence of gap nodes. An abrupt band renormalization, manifested as a kink in the energy-momentum dispersion at ~70 meV below the Fermi level, indicates an electron-boson coupling in the system. The simultaneous observation of a nodeless superconducting gap and electron-boson coupling provides crucial insights into the pairing symmetry and gluing mechanism in high-T$_c$ RP bilayer nickelates.

cond-mat.supr-con↗

arXiv2025

Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation

In tasks like summarization and open-book question answering (QA), Large Language Models (LLMs) often encounter "contextual hallucination", where they produce irrelevant or incorrect responses despite having access to accurate source information. This typically occurs because these models tend to prioritize self-generated content over the input context, causing them to disregard pertinent details. To address this challenge, we introduce a novel method called "Guided Attention Map Editing" (GAME), which dynamically adjusts attention maps to improve contextual relevance. During inference, GAME employs a trained classifier to identify attention maps prone to inducing hallucinations and executes targeted interventions. These interventions, guided by gradient-informed "edit directions'', strategically redistribute attention weights across various heads to effectively reduce hallucination. Comprehensive evaluations on challenging summarization and open-book QA tasks show that GAME consistently reduces hallucinations across a variety of open-source models. Specifically, GAME reduces hallucinations by 10% in the XSum summarization task while achieving a 7X speed-up in computational efficiency compared to the state-of-the-art baselines.

cs.CL↗

arXiv2025

CMD: Controllable Multiview Diffusion for 3D Editing and Progressive Generation

Recently, 3D generation methods have shown their powerful ability to automate 3D model creation. However, most 3D generation methods only rely on an input image or a text prompt to generate a 3D model, which lacks the control of each component of the generated 3D model. Any modifications of the input image lead to an entire regeneration of the 3D models. In this paper, we introduce a new method called CMD that generates a 3D model from an input image while enabling flexible local editing of each component of the 3D model. In CMD, we formulate the 3D generation as a conditional multiview diffusion model, which takes the existing or known parts as conditions and generates the edited or added components. This conditional multiview diffusion model not only allows the generation of 3D models part by part but also enables local editing of 3D models according to the local revision of the input image without changing other 3D parts. Extensive experiments are conducted to demonstrate that CMD decomposes a complex 3D generation task into multiple components, improving the generation quality. Meanwhile, CMD enables efficient and flexible local editing of a 3D model by just editing one rendered image.

cs.CV↗

arXiv2025

Fully stabilized Er fiber comb at 1 GHz by harmonic modelocking

Modelocked frequency comb lasers have always operated with a single pulse circulating in the laser cavity. This meant that each laser technology had an associated limit on pulse repetition rate. Achieving higher rates required different technology, for example exchanging optical fiber for solid state gain media. However, this is a perceived, rather than a fundamental limit. We demonstrate a new fiber laser design with multiple pulses circulating in the fiber gain cavity with the same high precision as a conventional fiber frequency comb. This has the immediate benefit of bringing mature fiber technology to higher repetition rate frequency combs. More generally, it adds great design freedom to laser engineering, where the laser can be separated into an optical cavity and a gain medium that are combined using standard frequency comb techniques. Fundamental frequency comb performance improvements may even be possible from the filtering intrinsic to our design, or by incorporating high stability cavities directly into the laser itself.

physics.optics↗

arXiv2025

Perspective Transition of Large Language Models for Solving Subjective Tasks

Large language models (LLMs) have revolutionized the field of natural language processing, enabling remarkable progress in various tasks. Different from objective tasks such as commonsense reasoning and arithmetic question-answering, the performance of LLMs on subjective tasks is still limited, where the perspective on the specific problem plays crucial roles for better interpreting the context and giving proper response. For example, in certain scenarios, LLMs may perform better when answering from an expert role perspective, potentially eliciting their relevant domain knowledge. In contrast, in some scenarios, LLMs may provide more accurate responses when answering from a third-person standpoint, enabling a more comprehensive understanding of the problem and potentially mitigating inherent biases. In this paper, we propose Reasoning through Perspective Transition (RPT), a method based on in-context learning that enables LLMs to dynamically select among direct, role, and third-person perspectives for the best way to solve corresponding subjective problem. Through extensive experiments on totally 12 subjective tasks by using both closed-source and open-source LLMs including GPT-4, GPT-3.5, Llama-3, and Qwen-2, our method outperforms widely used single fixed perspective based methods such as chain-of-thought prompting and expert prompting, highlights the intricate ways that LLMs can adapt their perspectives to provide nuanced and contextually appropriate responses for different problems.

cs.CL↗

arXiv2025

EscapeCraft: A 3D Room Escape Environment for Benchmarking Complex Multimodal Reasoning Ability

The rapid advancing of Multimodal Large Language Models (MLLMs) has spurred interest in complex multimodal reasoning tasks in the real-world and virtual environment, which require coordinating multiple abilities, including visual perception, visual reasoning, spatial awareness, and target deduction. However, existing evaluations primarily assess the final task completion, often degrading assessments to isolated abilities such as visual grounding and visual question answering. Less attention is given to comprehensively and quantitatively analyzing reasoning process in multimodal environments, which is crucial for understanding model behaviors and underlying reasoning mechanisms beyond merely task success. To address this, we introduce MM-Escape, an extensible benchmark for investigating multimodal reasoning, inspired by real-world escape games. MM-Escape emphasizes intermediate model behaviors alongside final task completion. To achieve this, we develop EscapeCraft, a customizable and open environment that enables models to engage in free-form exploration for assessing multimodal reasoning. Extensive experiments show that MLLMs, regardless of scale, can successfully complete the simplest room escape tasks, with some exhibiting human-like exploration strategies. Yet, performance dramatically drops as task difficulty increases. Moreover, we observe that performance bottlenecks vary across models, revealing distinct failure modes and limitations in their multimodal reasoning abilities, such as repetitive trajectories without adaptive exploration, getting stuck in corners due to poor visual spatial awareness, and ineffective use of acquired props, such as the key. We hope our work sheds light on new challenges in multimodal reasoning, and uncovers potential improvements in MLLMs capabilities.

cs.CV↗

arXiv2025

Angle-resolved photoemission spectroscopy of superconducting (La,Pr)3Ni2O7/SrLaAlO4 heterostructures

Ruddlesden-Popper bilayer nickelate thin film superconductors discovered under ambient pressure enable vast possibilities for investigating electronic structures of the superconducting state. Here, we report angle-resolved photoemission spectroscopy (ARPES) measurements of 1, 2, and 3 unit-cell epitaxial La2.85Pr0.15Ni2O7 films grown on SrLaAlO4 substates, through pure-oxygen in situ sample transportation. Evidence obtained using photons with distinct probing depths shows that conduction is localized primarily at the first unit cell near the interface. Scanning transmission electron microscopy (STEM), together with energy-dispersive X-ray spectroscopy (EDS) and electron energy loss spectroscopy (EELS), indicates that interfacial Sr diffusion and pronounced p-d hybridization gradient may collectively account for the interfacial confinement of conduction. Fermi surface maps reveal hole doping compared to non-superconducting ambient-pressure bulk crystals. Measurements of dispersive band structures suggest the contributions from both Ni dx2-y2 and dz2 orbitals at the Fermi level. Density functional theory (DFT) + U calculations capture qualitative features of the ARPES results, consistent with a hole-doped scenario. These findings constrain theoretical models of the superconducting mechanism and suggest potential for enhancing superconductivity in nickelates under ambient pressure.

cond-mat.supr-con↗

arXiv2025

DetailFusion: A Dual-branch Framework with Detail Enhancement for Composed Image Retrieval

Composed Image Retrieval (CIR) aims to retrieve target images from a gallery based on a reference image and modification text as a combined query. Recent approaches focus on balancing global information from two modalities and encode the query into a unified feature for retrieval. However, due to insufficient attention to fine-grained details, these coarse fusion methods often struggle with handling subtle visual alterations or intricate textual instructions. In this work, we propose DetailFusion, a novel dual-branch framework that effectively coordinates information across global and detailed granularities, thereby enabling detail-enhanced CIR. Our approach leverages atomic detail variation priors derived from an image editing dataset, supplemented by a detail-oriented optimization strategy to develop a Detail-oriented Inference Branch. Furthermore, we design an Adaptive Feature Compositor that dynamically fuses global and detailed features based on fine-grained information of each unique multimodal query. Extensive experiments and ablation analyses not only demonstrate that our method achieves state-of-the-art performance on both CIRR and FashionIQ datasets but also validate the effectiveness and cross-domain adaptability of detail enhancement for CIR.

cs.CV↗

arXiv2025

DongbaMIE: A Multimodal Information Extraction Dataset for Evaluating Semantic Understanding of Dongba Pictograms

Dongba pictographic is the only pictographic script still in use in the world. Its pictorial ideographic features carry rich cultural and contextual information. However, due to the lack of relevant datasets, research on semantic understanding of Dongba hieroglyphs has progressed slowly. To this end, we constructed \textbf{DongbaMIE} - the first dataset focusing on multimodal information extraction of Dongba pictographs. The dataset consists of images of Dongba hieroglyphic characters and their corresponding semantic annotations in Chinese. It contains 23,530 sentence-level and 2,539 paragraph-level high-quality text-image pairs. The annotations cover four semantic dimensions: object, action, relation and attribute. Systematic evaluation of mainstream multimodal large language models shows that the models are difficult to perform information extraction of Dongba hieroglyphs efficiently under zero-shot and few-shot learning. Although supervised fine-tuning can improve the performance, accurate extraction of complex semantics is still a great challenge at present.

cs.CV↗

arXiv2025

Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency

Speculative decoding accelerates Large Language Model (LLM) inference by employing a small speculative model (SSM) to generate multiple candidate tokens and verify them using the LLM in parallel. This technique has been widely integrated into LLM inference serving systems. However, inference requests typically exhibit uncertain execution time, which poses a significant challenge of efficiently scheduling requests in these systems. Existing work estimates execution time based solely on predicted output length, which could be inaccurate because execution time depends on both output length and token acceptance rate of verification by the LLM. In this paper, we propose a semi-clairvoyant request scheduling algorithm called Least-Attained/Perceived-Service for Speculative Decoding (LAPS-SD). Given a number of inference requests, LAPS-SD can effectively minimize average inference latency by adaptively scheduling requests according to their features during decoding. When the token acceptance rate is dynamic and execution time is difficult to estimate, LAPS-SD maintains multiple priority queues and allows request execution preemption across different queues. Once the token acceptance rate becomes stable, LAPS-SD can accurately estimate the execution time and schedule requests accordingly. Extensive experiments show that LAPS-SD reduces inference latency by approximately 39\% compared to state-of-the-art scheduling methods.

cs.CL↗

arXiv2025

Unconventional band splitting of CeSb in the devil's staircase transition

The interplay between magnetism and electronic band structure is a central theme in condensed matter physics. CeSb, with its complex devil's staircase antiferromagnetic transition, offers a unique opportunity to explore this interplay. Using angle-resolved photoemission spectroscopy (ARPES), we investigate the electronic structure evolution across the devil's staircase transition. Upon entering the antiferromagnetic phase, we observe an intriguing band splitting of the electron pocket around the X point. The energy separation between the split bands changes abruptly with temperature, consistent with the characteristics of the first-order phase transition. However, their respective spectral weights behave gradually with temperature. Combined with our density functional theory (DFT) calculations, we suggest that this atypical behavior deviates from conventional magnetically induced band splitting and potentially arises from the intricate modulation of paramagnetic and antiferromagnetic layers within the devil's staircase transition. Our results provide insights into the complex relationship between electronic structure and magnetism in correlated electron systems.

cond-mat.str-el↗

arXiv2025

Bishop: Sparsified Bundling Spiking Transformers on Heterogeneous Cores with Error-Constrained Pruning

We present Bishop, the first dedicated hardware accelerator architecture and HW/SW co-design framework for spiking transformers that optimally represents, manages, and processes spike-based workloads while exploring spatiotemporal sparsity and data reuse. Specifically, we introduce the concept of Token-Time Bundle (TTB), a container that bundles spiking data of a set of tokens over multiple time points. Our heterogeneous accelerator architecture Bishop concurrently processes workload packed in TTBs and explores intra- and inter-bundle multiple-bit weight reuse to significantly reduce memory access. Bishop utilizes a stratifier, a dense core array, and a sparse core array to process MLP blocks and projection layers. The stratifier routes high-density spiking activation workload to the dense core and low-density counterpart to the sparse core, ensuring optimized processing tailored to the given spatiotemporal sparsity level. To further reduce data access and computation, we introduce a novel Bundle Sparsity-Aware (BSA) training pipeline that enhances not only the overall but also structured TTB-level firing sparsity. Moreover, the processing efficiency of self-attention layers is boosted by the proposed Error-Constrained TTB Pruning (ECP), which trims activities in spiking queries, keys, and values both before and after the computation of spiking attention maps with a well-defined error bound. Finally, we design a reconfigurable TTB spiking attention core to efficiently compute spiking attention maps by executing highly simplified "AND" and "Accumulate" operations. On average, Bishop achieves a 5.91x speedup and 6.11x improvement in energy efficiency over previous SNN accelerators, while delivering higher accuracy across multiple datasets.

cs.NE↗

arXiv2025

SpikeX: Exploring Accelerator Architecture and Network-Hardware Co-Optimization for Sparse Spiking Neural Networks

Spiking Neural Networks (SNNs) are promising biologically plausible models of computation which utilize a spiking binary activation function similar to that of biological neurons. SNNs are well positioned to process spatiotemporal data, and are advantageous in ultra-low power and real-time processing. Despite a large body of work on conventional artificial neural network accelerators, much less attention has been given to efficient SNN hardware accelerator design. In particular, SNNs exhibit inherent unstructured spatial and temporal firing sparsity, an opportunity yet to be fully explored for great hardware processing efficiency. In this work, we propose a novel systolic-array SNN accelerator architecture, called SpikeX, to take on the challenges and opportunities stemming from unstructured sparsity while taking into account the unique characteristics of spike-based computation. By developing an efficient dataflow targeting expensive multi-bit weight data movements, SpikeX reduces memory access and increases data sharing and hardware utilization for computations spanning across both time and space, thereby significantly improving energy efficiency and inference latency. Furthermore, recognizing the importance of SNN network and hardware co-design, we develop a co-optimization methodology facilitating not only hardware-aware SNN training but also hardware accelerator architecture search, allowing joint network weight parameter optimization and accelerator architectural reconfiguration. This end-to-end network/accelerator co-design approach offers a significant reduction of 15.1x-150.87x in energy-delay-product(EDP) without comprising model accuracy.

cs.NE↗

arXiv2025

SenseFlow: A Physics-Informed and Self-Ensembling Iterative Framework for Power Flow Estimation

Power flow estimation plays a vital role in ensuring the stability and reliability of electrical power systems, particularly in the context of growing network complexities and renewable energy integration. However, existing studies often fail to adequately address the unique characteristics of power systems, such as the sparsity of network connections and the critical importance of the unique Slack node, which poses significant challenges in achieving high-accuracy estimations. In this paper, we present SenseFlow, a novel physics-informed and self-ensembling iterative framework that integrates two main designs, the Physics-Informed Power Flow Network (FlowNet) and Self-Ensembling Iterative Estimation (SeIter), to carefully address the unique properties of the power system and thereby enhance the power flow estimation. Specifically, SenseFlow enforces the FlowNet to gradually predict high-precision voltage magnitudes and phase angles through the iterative SeIter process. On the one hand, FlowNet employs the Virtual Node Attention and Slack-Gated Feed-Forward modules to facilitate efficient global-local communication in the face of network sparsity and amplify the influence of the Slack node on angle predictions, respectively. On the other hand, SeIter maintains an exponential moving average of FlowNet's parameters to create a robust ensemble model that refines power state predictions throughout the iterative fitting process. Experimental results demonstrate that SenseFlow outperforms existing methods, providing a promising solution for high-accuracy power flow estimation across diverse grid configurations.

cs.LG↗

arXiv2025

Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks

Recent advances in deep thinking models have demonstrated remarkable reasoning capabilities on mathematical and coding tasks. However, their effectiveness in embodied domains which require continuous interaction with environments through image action interleaved trajectories remains largely -unexplored. We present Embodied Reasoner, a model that extends o1 style reasoning to interactive embodied search tasks. Unlike mathematical reasoning that relies primarily on logical deduction, embodied scenarios demand spatial understanding, temporal reasoning, and ongoing self-reflection based on interaction history. To address these challenges, we synthesize 9.3k coherent Observation-Thought-Action trajectories containing 64k interactive images and 90k diverse thinking processes (analysis, spatial reasoning, reflection, planning, and verification). We develop a three-stage training pipeline that progressively enhances the model's capabilities through imitation learning, self-exploration via rejection sampling, and self-correction through reflection tuning. The evaluation shows that our model significantly outperforms those advanced visual reasoning models, e.g., it exceeds OpenAI o1, o3-mini, and Claude-3.7 by +9\%, 24\%, and +13\%. Analysis reveals our model exhibits fewer repeated searches and logical inconsistencies, with particular advantages in complex long-horizon tasks. Real-world environments also show our superiority while exhibiting fewer repeated searches and logical inconsistency cases.

cs.CL↗

arXiv2025

On-demand longitudinal transformations of light beams via an amplitude-phase-decoupled Pancharatnam-Berry phase element

Overcoming the inherent phase-only modulation limitation of conventional Pancharatnam-Berry (PB) elements, we propose a checkerboard-encoded PB element that enables simultaneous amplitude and phase modulation through PB phase engineering. This single-element platform directly generates polarization-rotating beams with continuously varying polarization angles along the propagation axis, eliminating traditional dynamic phase requirements. By strategically combining the proposed element with a liquid crystal q-plate and waveplates, we demonstrate on-demand longitudinal transformations of polarization states and high-order Poincaré sphere beams. Significantly, we achieve, for the first time to our knowledge, the propagation-transformed optical skyrmions, whose topological textures evolve with propagation distance. This amplitude-phase decoupling mechanism and the integration solution for various longitudinal transformations open new avenues in structured light manipulation, particularly benefiting quantum optics and topological photonics applications requiring longitudinal mode control.

physics.optics↗

arXiv2025

All-fiber highly efficient delivery of 2 kW laser over 2.45 km hollow-core fiber

Anti-resonant hollow-core fibers (AR-HCFs) have emerged as an important medium for high-power laser delivery due to their low optical nonlinearity and high damage threshold. However, current delivery systems of high-power laser based on AR-HCFs mainly rely on free-space optical components, which limits long-term stability in dynamic environments. Here, we report an all-fiber delivery of 2 kW laser with 85.3% transmission efficiency over 2.45 km, using a self-fabricated AR-HCF with a record low transmission loss of 0.175 dB/km at 1080 nm. This represents a nearly 500-fold improvement in the power-distance product compared to reported all-fiber AR-HCF-based laser transmission systems, achieving a record transmission distance for high-power laser delivery. Notably, we observed the phenomenon of stimulated Raman scattering amplified within the silica nested tubes in AR-HCF for the first time. By effectively suppressing the Raman noise from the laser source, we achieve an all-fiber laser delivery without stimulated Raman scattering of silica glass. This work marks a significant breakthrough in multi-kilometer and multi-kilowatt power delivery that is potentially useful for industrial manufacturing, nuclear decommissioning, laser drilling of oil, particle acceleration and so on.

physics.optics↗