arXiv Science⌕ Search

arXiv subjects

Wei Ji

Publications and source records attributed to Wei Ji.

At least 109 records · Page 6Linked to original sources

Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Model

We present Step-Video-TI2V, a state-of-the-art text-driven image-to-video generation model with 30B parameters, capable of generating videos up to 102 frames based on both text and image inputs. We build Step-Video-TI2V-Eval as a new benchmark for the text-driven image-to-video task and compare Step-Video-TI2V with open-source and commercial TI2V engines using this dataset. Experimental results demonstrate the state-of-the-art performance of Step-Video-TI2V in the image-to-video generation task. Both Step-Video-TI2V and Step-Video-TI2V-Eval are available at https://github.com/stepfun-ai/Step-Video-TI2V.

cs.CV↗

Luttinger compensated bipolarized magnetic semiconductor

Altermagnetic materials, with real-space antiferromagnetic arrangement and reciprocal-space anisotropic spin splitting, have attracted much attention. However, the spin splitting is small in most altermagnetic materials, which is a disadvantage to their application in electronic devices. In this study, based on symmetry analysis and the first-principles electronic structure calculations, we predict for the first time two Luttinger compensated bipolarized magnetic semiconductors Mn(CN)2 and Co(CN)2 with isotropic spin splitting as in the ferromagnetic materials. Our further analysis shows that the Luttinger compensated magnetism here depends not only on spin group symmetry, but also on the crystal field splitting and the number of d-orbital electrons. In addition, the polarized charge density indicates that both Mn(CN)2 and Co(CN)2 have the quasi-symmetry Tτ , resulting from the crystal field splitting and the number of d-orbital electrons. The Luttinger compensated magnetism not only has the zero total magnetic moment as the antiferromagnetism, but also has the isotropic spin splitting as the ferromagnetism, thus our work not only provides theoretical guidance for searching Luttinger compensated magnetic materials with distinctive properties, but also provides a material basis for the application in spintronic devices.

cond-mat.mtrl-sci↗

Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Model

We present Step-Video-T2V, a state-of-the-art text-to-video pre-trained model with 30B parameters and the ability to generate videos up to 204 frames in length. A deep compression Variational Autoencoder, Video-VAE, is designed for video generation tasks, achieving 16x16 spatial and 8x temporal compression ratios, while maintaining exceptional video reconstruction quality. User prompts are encoded using two bilingual text encoders to handle both English and Chinese. A DiT with 3D full attention is trained using Flow Matching and is employed to denoise input noise into latent frames. A video-based DPO approach, Video-DPO, is applied to reduce artifacts and improve the visual quality of the generated videos. We also detail our training strategies and share key observations and insights. Step-Video-T2V's performance is evaluated on a novel video generation benchmark, Step-Video-T2V-Eval, demonstrating its state-of-the-art text-to-video quality when compared with both open-source and commercial engines. Additionally, we discuss the limitations of current diffusion-based model paradigm and outline future directions for video foundation models. We make both Step-Video-T2V and Step-Video-T2V-Eval available at https://github.com/stepfun-ai/Step-Video-T2V. The online version can be accessed from https://yuewen.cn/videos as well. Our goal is to accelerate the innovation of video foundation models and empower video content creators.

cs.CV↗

Step-Audio: Unified Understanding and Generation in Intelligent Speech Interaction

Real-time speech interaction, serving as a fundamental interface for human-machine collaboration, holds immense potential. However, current open-source models face limitations such as high costs in voice data collection, weakness in dynamic control, and limited intelligence. To address these challenges, this paper introduces Step-Audio, the first production-ready open-source solution. Key contributions include: 1) a 130B-parameter unified speech-text multi-modal model that achieves unified understanding and generation, with the Step-Audio-Chat version open-sourced; 2) a generative speech data engine that establishes an affordable voice cloning framework and produces the open-sourced lightweight Step-Audio-TTS-3B model through distillation; 3) an instruction-driven fine control system enabling dynamic adjustments across dialects, emotions, singing, and RAP; 4) an enhanced cognitive architecture augmented with tool calling and role-playing abilities to manage complex tasks effectively. Based on our new StepEval-Audio-360 evaluation benchmark, Step-Audio achieves state-of-the-art performance in human evaluations, especially in terms of instruction following. On open-source benchmarks like LLaMA Question, shows 9.3% average performance improvement, demonstrating our commitment to advancing the development of open-source multi-modal language technologies. Our code and models are available at https://github.com/stepfun-ai/Step-Audio.

cs.CL↗

Artificially creating emergent interfacial antiferromagnetism and its manipulation in a magnetic van-der-Waals heterostructure

Van der Waals (vdW) magnets, with their two-dimensional (2D) atomic structures, provide a unique platform for exploring magnetism at the nanoscale. Although there have been numerous reports on their diverse quantum properties, the emergent interfacial magnetism--artificially created at the interface between two layered magnets--remains largely unexplored. This work presents observations of such emergent interfacial magnetism at the ferromagnet/antiferromagnet interface in a vdW heterostructure. We report the discovery of an intermediate Hall resistance plateau in the anomalous Hall loop, indicative of emergent interfacial antiferromagnetism fostered by the heterointerface. This plateau can be stabilized and further manipulated under varying pressures but collapses under high pressures over 10 GPa. Our theoretical calculations reveal that charge transfer at the interface is pivotal in establishing the interlayer antiferromagnetic spin-exchange interaction. This work illuminates the previously unexplored emergent interfacial magnetism at a vdW interface comprised of a ferromagnetic metal and an antiferromagnetic insulator, and highlights its gradual evolution under increasing pressure. These findings enrich the portfolio of emergent interfacial magnetism and support further investigations on vdW magnetic interfaces and the development of next-generation spintronic devices.

cond-mat.mtrl-sci↗

Kagome electronic states in gradient-strained untwisted graphene bilayers

Moiré superlattices in twisted homo-bilayers have revealed exotic electronic states, including unconventional superconductivity and correlated insulating phases. However, their fabrication process often introduces moiré disorders, hindering reproducibility and experimental control. Here, we propose an alternative approach using gradient strain to construct moiré superlattices in untwisted bilayer graphene (gs-BLG). Through force-field and first-principles calculations, we show that gs-BLG exhibits kagome-like interlayer-spacing distributions and strain-tunable kagome electronic bands. The competition between interlayer coupling and in-plane strain relaxation leads to distinct structural deformations, giving rise to three forms of diatomic kagome lattices: subtle, pronounced, and distorted. Kagome electronic bands are identified near the Fermi level in their band structures. Modulating strain gradients enables tailoring bandwidths and signs of hopping parameters of these kagome bands, providing a versatile platform for studying exotic electronic phases. Our findings establish gradient strain as an alternative to twist engineering, opening an avenue for exploring emergent electronic phases in graphene-based systems.

cond-mat.mes-hall↗

Filling-dependent intertwined electronic and atomic orders in the flat-band state of 1T-TaS2

The delicate interplay among the complex intra-/inter-layer electron-electron and electron-lattice interactions is the fundamental prerequisite of these exotic quantum states, such as superconductivity, nematic order, and checkerboard charge order. Here we explore the filling-dependent multiple stable intertwined electronic and atomic orders of flat-band state of 1T-TaS2 encompassing hole order, phase orders, coexisting left- and right-chiral orders and mixed phase/chiral orders via scanning tunneling microscopy (STM). Combining first-principles calculations, the emergent electronic/atomic orders can be attributed to the weakening of electron-electron correlations and stacking-dependent interlayer interactions. Moreover, achiral intermediate ring-like clusters and nematic charge density wave (CDW) states are successfully realized in intralayer chiral domain wall and interlayer heterochiral stacking regions through chiral overlap configurations. Our study not only deepens the understanding of filling-dependent electronic/atomic orders in flat-band systems, but also offers perspectives for exploring exotic quantum states in correlated electronic systems.

cond-mat.str-el↗

High-Throughput Discovery of Kagome Materials in Transition Metal Oxide Monolayers

Kagome materials are known for hosting exotic quantum states, including quantum spin liquids, charge density waves, and unconventional superconductivity. The search for kagome monolayers is driven by their ability to exhibit neat and well-defined kagome bands near the Fermi level, which are more easily realized in the absence of interlayer interactions. However, this absence also destabilizes the monolayer forms of many bulk kagome materials, posing significant challenges to their discovery. In this work, we propose a strategy to address this challenge by utilizing oxygen vacancies in transition metal oxides within a "1+3" design framework. Through high-throughput computational screening of 349 candidate materials, we identified 12 thermodynamically stable kagome monolayers with diverse electronic and magnetic properties. These materials were classified into three categories based on their lattice geometry, symmetry, band gaps, and magnetic configurations. Detailed analysis of three representative monolayers revealed kagome band features near their Fermi levels, with orbital contributions varying between oxygen 2p and transition metal d states. This study demonstrates the feasibility of the "1+3" strategy, offering a promising approach to uncovering low-dimensional kagome materials and advancing the exploration of their quantum phenomena.

cond-mat.mes-hall↗

WisdomBot: Tuning Large Language Models with Artificial Intelligence Knowledge

Large language models (LLMs) have emerged as powerful tools in natural language processing (NLP), showing a promising future of artificial generated intelligence (AGI). Despite their notable performance in the general domain, LLMs have remained suboptimal in the field of education, owing to the unique challenges presented by this domain, such as the need for more specialized knowledge, the requirement for personalized learning experiences, and the necessity for concise explanations of complex concepts. To address these issues, this paper presents a novel LLM for education named WisdomBot, which combines the power of LLMs with educational theories, enabling their seamless integration into educational contexts. To be specific, we harness self-instructed knowledge concepts and instructions under the guidance of Bloom's Taxonomy as training data. To further enhance the accuracy and professionalism of model's response on factual questions, we introduce two key enhancements during inference, i.e., local knowledge base retrieval augmentation and search engine retrieval augmentation during inference. We substantiate the effectiveness of our approach by applying it to several Chinese LLMs, thereby showcasing that the fine-tuned models can generate more reliable and professional responses.

cs.CL↗

Two-dimensional Kagome Materials: Theoretical Insights, Experimental Realizations, and Electronic Structures

In recent years, kagome materials have attracted significant attention due to their rich emergent phenomena arising from the quantum interplay of geometry, topology, spin, and correlations. However, in the search for kagome materials, it has been found that bulk compounds with electronic properties related to the kagome lattice are relatively scarce, primarily due to the hybridization of kagome layers with adjacent layers. Therefore, researchers have shown increasing interest in the discovery and construction of two-dimensional (2D) kagome materials, aiming to achieve clean kagome bands near the Fermi level in monolayer or few-layer systems. Substantial advancements have already been made in this area. In this review, we summarize the current progress in the construction and development of 2D kagome materials. We begin by introducing the geometric and electronic structures of the kagome lattice model and its variants, followed by discussions on the experimental realizations and electronic structure characterizations of 2D kagome materials. Finally, we provide an outlook on the future developments of 2D kagome materials.

cond-mat.mtrl-sci↗

New Constraints on Axion Mediated Dipole-Dipole Interactions

The search for axions sits at the intersection of solving critical problems in fundamental physics, including the strong CP problem in QCD, uncovering the nature of dark matter, and understanding the origin of the universe's matter-antimatter asymmetry. The measurement of axion-mediated spin-dependent interactions offers a powerful approach for axion detection. However, it has long been restricted to regions outside the 'axion window' due to a significant trade-off: the need to effectively suppress the magnetic leakage from highly polarized spin sources while simultaneously detecting sub-femtotesla level exotic physics signals at sub-decimeter-scale distances. In this work, we report new experimental results on axion-mediated exotic spin-spin interactions using an iron-shielded SmCo$_5$ spin source in combination with a specially designed self-compensation comagnetometer. Employing a composite shielding structure, we achieved a suppression of the magnetic field by up to $10^{11}$. This enabled us to establish new constraints on the coupling between electrons and neutrons, surpassing previous experimental limits by more than 10000 times within the axion window. Furthermore, we also set strongest constraints on the coupling between electrons and protons. The proposed method holds substantial potential not only for advancing the search for new physics beyond the Standard Model but also for enabling transformative applications in biological and chemical research.

hep-ph↗

A Generalizable 3D Diffusion Framework for Low-Dose and Few-View Cardiac SPECT

Myocardial perfusion imaging using SPECT is widely utilized to diagnose coronary artery diseases, but image quality can be negatively affected in low-dose and few-view acquisition settings. Although various deep learning methods have been introduced to improve image quality from low-dose or few-view SPECT data, previous approaches often fail to generalize across different acquisition settings, limiting their applicability in reality. This work introduced DiffSPECT-3D, a diffusion framework for 3D cardiac SPECT imaging that effectively adapts to different acquisition settings without requiring further network re-training or fine-tuning. Using both image and projection data, a consistency strategy is proposed to ensure that diffusion sampling at each step aligns with the low-dose/few-view projection measurements, the image data, and the scanner geometry, thus enabling generalization to different low-dose/few-view settings. Incorporating anatomical spatial information from CT and total variation constraint, we proposed a 2.5D conditional strategy to allow the DiffSPECT-3D to observe 3D contextual information from the entire image volume, addressing the 3D memory issues in diffusion model. We extensively evaluated the proposed method on 1,325 clinical 99mTc tetrofosmin stress/rest studies from 795 patients. Each study was reconstructed into 5 different low-count and 5 different few-view levels for model evaluations, ranging from 1% to 50% and from 1 view to 9 view, respectively. Validated against cardiac catheterization results and diagnostic comments from nuclear cardiologists, the presented results show the potential to achieve low-dose and few-view SPECT imaging without compromising clinical performance. Additionally, DiffSPECT-3D could be directly applied to full-dose SPECT images to further improve image quality, especially in a low-dose stress-first cardiac SPECT imaging protocol.

eess.IV↗

Reduced-order modeling of neutron transport separated in axial and radial space by Proper Generalized Decomposition with applications to nuclear reactor physics

In this article, we demonstrate the novel use of Proper Generalized Decomposition (PGD) to separate the axial and, optionally, polar dimensions of neutron transport. Doing so, the resulting Reduced-Order Models (ROMs) can exploit the fact that nuclear reactors tend to be tall, but geometrically simple, in the axial direction $z$, and so the 3D neutron flux distribution often admits a low-rank "2D/1D" approximation. Through PGD, this approximation is computed by alternately solving 2D and 1D sub-models, like in existing 2D/1D models of reactor physics. However, the present methodology is more general in that the decomposition is arbitrary-rank, rather than rank-one, and no simplifying approximations of the transverse leakage are made. To begin, we derive two original models: that of axial PGD -- which separates only $z$ and the sign of the polar angle $α\in\{-1,+1\}$ -- and axial-polar PGD -- which separates both $z$ and the full polar angle $μ$ from the radial domain. Additionally, we grant that the energy dependence $E$ may be ascribed to either radial or axial modes, or both, bringing the total number of candidate 2D/1D ROMs to six. To assess performance, these PGD ROMs are applied to two few-group benchmarks characteristic of Light Water Reactors. Therein, we find both the axial and axial-polar ROMs are convergent and that the latter are often more economical than the former. Ultimately, given the popularity of 2D/1D methods in reactor physics, we expect a PGD ROM which achieves a similar effect, but perhaps with superior accuracy, a quicker runtime, and/or broader applicability, would be eminently useful, especially for full-core problems.

math.NA↗

Ultralight dark matter detection with levitated ferromagnets

Levitated ferromagnets act as ultraprecise magnetometers, which can exhibit high quality factors due to their excellent isolation from the environment. These instruments can be utilized in searches for ultralight dark matter candidates, such as axionlike dark matter or dark-photon dark matter. In addition to being sensitive to an axion-photon coupling or kinetic mixing, which produce physical magnetic fields, ferromagnets are also sensitive to the effective magnetic field (or "axion wind") produced by an axion-electron coupling. While the dynamics of a levitated ferromagnet in response to a DC magnetic field have been well studied, all of these couplings would produce AC fields. In this work, we study the response of a ferromagnet to an applied AC magnetic field and use these results to project their sensitivity to axion and dark-photon dark matter. We pay special attention to the direction of motion induced by an applied AC field, in particular, whether it precesses around the applied field (similar to an electron spin) or librates in the plane of the field (similar to a compass needle). We show that existing levitated ferromagnet setups can already have comparable sensitivity to an axion-electron coupling as comagnetometer or torsion balance experiments. In addition, future setups can become sensitive probes of axion-electron coupling, dark-photon kinetic mixing, and axion-photon coupling, for ultralight dark matter masses $m_\mathrm{DM}\lesssim\mathrm{feV}$.

hep-ph↗

Interlayer coupling rotatable magnetic easy-axis in MnSe2 mono- and bi-layers

Interlayer coupling plays a critical role in tuning the electronic structures and magnetic ground states of two-dimensional materials, influenced by the number of layers, interlayer distances, and stacking order. However, its effect on the orientation of the magnetic easy axis remains underexplored. In this study, we demonstrate that interlayer coupling can significantly alter the magnetic easy-axis orientation, as shown by the magnetic easy-axis of monolayer 1T-MnSe2 tilting 67° from the z-axis, while aligning with the z-axis in the bilayer. This change results from variations in orbital occupations near the Fermi level, particularly involving nonmetallic Se atoms. Contrary to the traditional focus on magnetic metal atoms, our findings reveal that Se orbitals play a key role in influencing the easy-axis orientation and topological Chern numbers. Furthermore, we validated our conclusions by changing stacking orders, introducing charge doping, applying in-plane biaxial strains, and substituting non-metallic atoms. Our results highlight the pivotal role of interlayer coupling in tuning the magnetic properties of layered materials, with important implications for spintronic applications.

cond-mat.mtrl-sci↗

MoTe: Learning Motion-Text Diffusion Model for Multiple Generation Tasks

Recently, human motion analysis has experienced great improvement due to inspiring generative models such as the denoising diffusion model and large language model. While the existing approaches mainly focus on generating motions with textual descriptions and overlook the reciprocal task. In this paper, we present~\textbf{MoTe}, a unified multi-modal model that could handle diverse tasks by learning the marginal, conditional, and joint distributions of motion and text simultaneously. MoTe enables us to handle the paired text-motion generation, motion captioning, and text-driven motion generation by simply modifying the input context. Specifically, MoTe is composed of three components: Motion Encoder-Decoder (MED), Text Encoder-Decoder (TED), and Moti-on-Text Diffusion Model (MTDM). In particular, MED and TED are trained for extracting latent embeddings, and subsequently reconstructing the motion sequences and textual descriptions from the extracted embeddings, respectively. MTDM, on the other hand, performs an iterative denoising process on the input context to handle diverse tasks. Experimental results on the benchmark datasets demonstrate the superior performance of our proposed method on text-to-motion generation and competitive performance on motion captioning.

cs.CV↗

Layered semiconducting electrides in p-block metal oxides

In conventional electrides, excess electrons are localized in crystal voids to serve as anions. Most of these electrides are metallic and the metal cations are primarily from the s-block, d-block, or rare-earth elements. Here, we report a class of p-block metal-based electrides found in bilayer SnO and PbO, which are semiconducting and feature electride states in both the valence band (VB) and conduction band (CB), as referred to 2D "bipolar" electrides. These bilayers are hybrid electrides where excess electrons are localized in the interlayer region and hybridize with the orbitals of Sn atoms in the VB, exhibiting strong covalent-like interactions with neighboring metal atoms. Compared to previously studied hybrid electrides, the higher electronegativity of Sn and Pb enhances these covalent-like interactions, leading to largely enhanced semiconducting bandgap of up to 2.5 eV. Moreover, the CBM primarily arises from the overlap between metal states and interstitial charges, denoting a potential electride and forming a free-electron-like (FEL) state with small effective mass. This state offers high carrier mobilities for both electron and hole in bilayer SnO, suggesting its potential as a promising p-type semiconductor material.

cond-mat.mtrl-sci↗

Backpropagation-Free Multi-modal On-Device Model Adaptation via Cloud-Device Collaboration

In our increasingly interconnected world, where intelligent devices continually amass copious personalized multi-modal data, a pressing need arises to deliver high-quality, personalized device-aware services. However, this endeavor presents a multifaceted challenge to prevailing artificial intelligence (AI) systems primarily rooted in the cloud. As these systems grapple with shifting data distributions between the cloud and devices, the traditional approach of fine-tuning-based adaptation (FTA) exists the following issues: the costly and time-consuming data annotation required by FTA and the looming risk of model overfitting. To surmount these challenges, we introduce a Universal On-Device Multi-modal Model Adaptation Framework, revolutionizing on-device model adaptation by striking a balance between efficiency and effectiveness. The framework features the Fast Domain Adaptor (FDA) hosted in the cloud, providing tailored parameters for the Lightweight Multi-modal Model on devices. To enhance adaptability across multi-modal tasks, the AnchorFrame Distribution Reasoner (ADR) minimizes communication costs. Our contributions, encapsulated in the Cloud-Device Collaboration Multi-modal Parameter Generation (CDC-MMPG) framework, represent a pioneering solution for on-Device Multi-modal Model Adaptation (DMMA). Extensive experiments validate the efficiency and effectiveness of our method, particularly in video question answering and retrieval tasks, driving forward the integration of intelligent devices into our daily lives.

cs.DC↗