arXiv ScienceSearch

arXiv subjects

Fu Li

Publications and source records attributed to Fu Li.

At least 19 recordsLinked to original sources

Tree-Structured Vector Quantization For Efficient And Progressive Image Compression

Vector-quantization based image compression has achieved strong rate--distortion performance, yet most of them still produce a separate compressed representation for each target bitrate. Such variable-rate behavior allows one model to operate at multiple rates, but it does not necessarily provide a progressive bitstream whose prefixes are themselves decodable and can be refined by appending additional bits. We propose \textbf{Tree-VQ}, a progressive tree-structured vector quantization framework for learned image compression. Tree-VQ organizes discrete codewords as a hierarchical binary tree and represents each latent token by a routed root-to-leaf path. Crucially, every prefix of this path corresponds to a valid quantized representation, so shallow internal nodes serve as coarse reconstruction codes and deeper nodes provide successive refinements. This allows a compressed image to be decoded from an early prefix and progressively improved as more branch symbols are received, rather than being re-encoded for different target rates. To make this structure practical for compression, we introduce a prefix-compatible tree entropy model that codes progressive continuation decisions and routed branch refinements using only causally available decoded contexts. We further use rate-aware refinement scheduling to decide which spatial blocks should receive additional tree bits under a given prefix budget, and hierarchical prefix supervision to ensure that internal nodes are directly decodable at low rates. Experiments show that Tree-VQ achieves a superior performance--efficiency trade-off, delivering the best perceptual compression results with much fewer parameters and lower latency than competing methods.

cs.CV

Strain-Tunable Shift Current and Magneto-Optical Kerr Effect in Multiferroic Altermagnet Fe2Mo3O8

Altermagnetism has recently emerged as a compelling frontier in spintronics, seamlessly merging the agile tunability of ferromagnets with the hallmark merits of antiferromagnets. As a prototypical polar multiferroic featuring distinctive altermagnetism, Fe2Mo3O8 hosts an ideal playground for exploring the intricate interplay among ferroelectric polarization, altermagnetic order, and spin-dependent responses. Here, employing first-principles calculations, we systematically investigate the coupling among polarization, spin splitting, shift current, and magneto-optical responses in Fe2Mo3O8. Our findings reveal that switching the ferroelectric polarization not only inverts the sign of the shift current but also comprehensively reshapes the momentum-space spin-splitting texture. Furthermore, the shift current and magneto-optical spectrum exhibits strong tunability under mechanical strain. Remarkably, the application of a-axis uniaxial strain breaks the crystalline symmetry, thereby activating a finite magneto-optical Kerr effect that is otherwise forbidden in the pristine phase.

cond-mat.mtrl-sci

From Experience to Skill: Multi-Agent Generative Engine Optimization via Reusable Strategy Learning

Generative engines (GEs) are reshaping information access by replacing ranked links with citation-grounded answers, yet current Generative Engine Optimization (GEO) methods optimize each instance in isolation, unable to accumulate or transfer effective strategies across tasks and engines. We reframe GEO as a strategy learning problem and propose MAGEO, a multi-agent framework in which coordinated planning, editing, and fidelity-aware evaluation serve as the execution layer, while validated editing patterns are progressively distilled into reusable, engine-specific optimization skills. To enable controlled assessment, we introduce a Twin Branch Evaluation Protocol for causal attribution of content edits and DSV-CF, a dual-axis metric that unifies semantic visibility with attribution accuracy. We further release MSME-GEO-Bench, a multi-scenario, multi-engine benchmark grounded in real-world queries. Experiments on three mainstream engines show that MAGEO substantially outperforms heuristic baselines in both visibility and citation fidelity, with ablations confirming that engine-specific preference modeling and strategy reuse are central to these gains, suggesting a scalable learning-driven paradigm for trustworthy GEO. Code is available at https://github.com/Wu-beining/MAGEO

cs.AI

Medium-Throughput Evaluation of Quantum Geometry-Driven Topological Transports in Altermagnets

Altermagnets provide a promising platform for a wide spectrum of applications integrating advantages of conventional ferromagnets and antiferromagnets. In this work, we implement a medium-throughput first-principles workflow and evaluate topological transport properties driven by quantum geometry for 135 altermagnets in the MAGNDATA database. Based on automated Wannier construction, both linear and nonlinear responses, including the anomalous Hall effect, magneto-optical Kerr effect, and bulk photovoltaic effect, are evaluated with further symmetry verifications. Detailed analysis is done on representative cases like metallic VNb3S6 with enhanced anomalous Hall conductivity, CaIrO3 with giant MOKE, and CuFeS2 with large shift current in non-centrosymmetric. These results establish a symmetry-guided computational route for identifying experimentally accessible fingerprints and functional transport properties in altermagnets.

cond-mat.mtrl-sci

2D Ferroelectric Ruddlesden-Popper Perovskites: an Emerging Fully Electronically Controllable Shift Current and Persistent Spin Helix

Two-dimensional (2D) hybrid organic--inorganic perovskites (HOIPs) are promising candidates for next-generation optoelectronic and spintronic applications. This work systematically investigates the relationship between structural distortions and functional responses in three $C_{2v}$-symmetric Ruddlesden--Popper (RP) ferroelectric perovskites, $(4,4\text{-DFPD})_{2}\mathrm{PbI}_{4}$, $(\mathrm{DFCHA})_{2}\mathrm{PbI}_{4}$, and PEPI, using first-principles calculations combined with irreducible representation decomposition and wave-vector point-group symmetry (WPGS) analysis. The results reveal that the lead--iodide framework yields shift-current (SC) magnitudes comparable to, and in specific cases even an order of magnitude larger than, those of traditional ferroelectric oxides, with PEPI reaching a maximum of $69.16\ \mu\mathrm{A}/\mathrm{V}^{2}$. The SC magnitude correlates positively with the octahedral distortion index ($D_i$), while a competition mechanism is identified between covalent bond strength and structural asymmetry, where increased average bond lengths can offset the enhancement induced by $D_i$. Regarding spintronics, $C_{2v}$ symmetry-protected persistent spin textures (PST) are identified. A transition to $C_2$-protected quasi-PST occurs in monoclinic $(4,4\text{-DFHHA})_{2}\mathrm{PbI}_{4}$, leading to a persistent spin helix (PSH) with long-distance spin transport. The synergy among ferroelectricity, SC, and PST enables nonvolatile electrical control of both photocurrent direction and spin configurations. This work provides evaluation criteria and practical guidance for designing high-performance integrated spintronic--photovoltaic devices.

cond-mat.mtrl-sci

FoleyDirector: Fine-Grained Temporal Steering for Video-to-Audio Generation via Structured Scripts

Recent Video-to-Audio (V2A) methods have achieved remarkable progress, enabling the synthesis of realistic, high-quality audio. However, they struggle with fine-grained temporal control in multi-event scenarios or when visual cues are insufficient, such as small regions, off-screen sounds, or occluded or partially visible objects. In this paper, we propose FoleyDirector, a framework that, for the first time, enables precise temporal guidance in DiT-based V2A generation while preserving the base model's audio quality and allowing seamless switching between V2A generation and temporally controlled synthesis. FoleyDirector introduces Structured Temporal Scripts (STS), a set of captions corresponding to short temporal segments, to provide richer temporal information. These features are integrated via the Script-Guided Temporal Fusion Module, which employs Temporal Script Attention to fuse STS features coherently. To handle complex multi-event scenarios, we further propose Bi-Frame Sound Synthesis, enabling parallel in-frame and out-of-frame audio generation and improving controllability. To support training and evaluation, we construct the DirectorSound dataset and introduce VGGSoundDirector and DirectorBench. Experiments demonstrate that FoleyDirector substantially enhances temporal controllability while maintaining high audio fidelity, empowering users to act as Foley directors and advancing V2A toward more expressive and controllable generation.

cs.SD

Learning from Brain Topography: A Hierarchical Local-Global Graph-Transformer Network for EEG Emotion Recognition

Understanding how local neurophysiological patterns interact with global brain dynamics is essential for decoding human emotions from EEG signals. However, existing deep learning approaches often overlook the brain's intrinsic spatial organization, failing to simultaneously capture local topological relations and global dependencies. To address these challenges, we propose Neuro-HGLN, a Neurologically-informed Hierarchical Graph-Transformer Learning Network that integrates biologically grounded priors with hierarchical representation learning. Neuro-HGLN first constructs a spatial Euclidean prior graph based on physical electrode distances to serve as an anatomically grounded inductive bias. A learnable global dynamic graph is then introduced to model functional connectivity across the entire brain. In parallel, to capture fine-grained regional dependencies, Neuro-HGLN builds region-level local graphs using a multi-head self-attention mechanism. These graphs are processed synchronously through local-constrained parallel GCN layers to produce region-specific representations. Subsequently, an iTransformer encoder aggregates these features to capture cross-region dependencies under a dimension-as-token formulation. Extensive experiments demonstrate that Neuro-HGLN achieves state-of-the-art performance on multiple benchmarks, providing enhanced interpretability grounded in neurophysiological structure. These results highlight the efficacy of unifying local topological learning with cross-region dependency modeling for robust EEG emotion recognition.

cs.HC

DreamFoley: Scalable VLMs for High-Fidelity Video-to-Audio Generation

Recent advances in video generation have achieved remarkable improvements in visual content fidelity. However, the absence of synchronized audio severely undermines immersive experience and restricts practical applications of these technologies. To address this challenge, several pioneering works have explored diffusion transformer architectures for generating plausible video-synchronized audio, including Kling-foley, HunyuanVideo-foley and Thinksound. Distinct from existing works, we introduce an autoregressive audio generation architecture (DreamFoley) that harnesses the capabilities of large vision-language models (VLMs) to jointly model sequential interactions among video, audio, and text modalities. Our approach features a dual-visual encoder module that effectively captures both audio-aligned and text-aligned visual features. Additionally, we employ a Residual Vector Quantization audio tokenizer with a delay-pattern generation scheme to balance the trade-off between training efficiency and audio quality. Moreover, we introduce the classifier-free guidance strategy into VLMs to bootstrap generated audio quality. Furthermore, we establish an efficient data production pipeline to scale audio-video-text triple collection. Finally, extensive experiments are conducted to validate the effectiveness of our model, achieving promising performance across popular benchmarks. We hope that the findings in this study provide a strong foundation for future video-to-audio generation research. We also release the previously missing audio-visual textual descriptions from the public benchmark, aiming to facilitate subsequent researchers in conducting more convenient and effective evaluations and comparisons.

cs.SD

Ferroelectricity-driven altermagnetism in two-dimensional van der Waals multiferroics

Altermagnets (AMs) are a recently identified class of unconventional collinear compensated antiferromagnets that exhibit momentum-dependent spin splitting despite having zero net magnetization. This unconventional magnetic order gives rise to a range of phenomena, including the anomalous Hall effect, chiral magnons, and nonlinear photocurrents. Here, using spin space group (SSG) symmetry analysis and first-principles calculations, we demonstrate an efficient strategy to control altermagnetism in two-dimensional multiferroics through ferroelectric polarization and interlayer sliding. For material realization, we find that monolayer and bilayer FeCuP2S6 exhibit finite spin splitting when ferroelectric sublattices are connected by nonsymmorphic screw-axis operations rather than pure translation or inversion symmetry. Interlayer sliding further enables reversible switching or suppression of spin splitting through modifications of the SSG. Our calculations further reveal that the anomalous Hall response serves as a direct probe of these spin-split states. These findings establish two-dimensional van der Waals multiferroics as promising platforms for realizing electrically controllable altermagnetism and advancing next-generation spintronic and magnetoelectric technologies.

cond-mat.mtrl-sci

High-throughput screening of spin Hall conductivity in 2D materials

Two-dimensional (2D) materials with large spin Hall effect (SHE) have attracted significant attention due to their potential applications in next-generation spintronic devices. In this work, we perform high-throughput (HTP) calculations to obtain the spin Hall conductivity (SHC) of 4486 non-magnetic compounds in the \texttt{2Dmatpedia} database and identify six materials with SHC exceeding $500\,(\hbar/e)\,(\mathrm{S/cm})$, surpassing those of previously known materials. Detailed analysis reveals that the significant SHC can be attributed to spin-orbit coupling (SOC)-induced gap openings at Dirac-like band crossings. Additionally, the presence of mirror symmetry further enhances the SHC. Beyond the high-SHC materials, 57 topological insulators with quantized SHCs have also been identified. Our work enables rapid screening and paves the way for experimental validation, potentially accelerating the discovery of novel 2D materials optimized for spintronics applications.

cond-mat.mtrl-sci

Shift Current Anomalous Photovoltaics in a Double Perovskite Ferroelectric

Ferroelectric anomalous photovoltaic (APV) effect, as a fascinating physical conceptual phenomenon, holds significant potentials for new optoelectronic device applications. However, due to the knowledge lacking on the origin and underlying mechanism of ferroelectric APV effect, substantial challenges still remain in exploring new APV-active candidate materials. The emerging shift current model, involving the transfer of photogenerated charges through the displacement of wave functions, has attracted considerable attention for its unique insights into the bulk photovoltaic effect. Here, we present strong APV properties in a high-temperature double perovskite ferroelectric (cyclohexylmethylammonium)$_2$CsAgBiBr$_7$, showing an extremely large above-bandgap photovoltage up to about 40 V. This figure-of-merit is far beyond its bandgap of about 2.3 eV and comparable to the state-of-art molecular ferroelectrics. Strikingly, the shift current model reveals an intrinsic correlation with Cs$^{+}$ cation displacement and provides, for the first time, an explicit explanation for the structural origin of ferroelectric APV activities. Besides, its steady-state APV photocurrent exhibits the unique light-polarization dependence, which endows remarkable polarization-sensitivity with the highest polarization ratios of about 41 among the known 2D single-phase materials. As the unprecedented exploration of ferroelectric APV characteristics illuminated by the shift current mechanism, this finding paves a pathway to assemble new optoelectronic smart devices.

cond-mat.mtrl-sci

Request-Only Optimization for Recommendation Systems

Deep Learning Recommendation Models (DLRMs) represent one of the largest machine learning applications on the planet. Industry-scale DLRMs are trained with petabytes of recommendation data to serve billions of users every day. To utilize the rich user signals in the long user history, DLRMs have been scaled up to unprecedented complexity, up to trillions of floating-point operations (TFLOPs) per example. This scale, coupled with the huge amount of training data, necessitates new storage and training algorithms to efficiently improve the quality of these complex recommendation systems. In this paper, we present a Request-Only Optimizations (ROO) training and modeling paradigm. ROO simultaneously improves the storage and training efficiency as well as the model quality of recommendation systems. We holistically approach this challenge through co-designing data (i.e., request-only data), infrastructure (i.e., request-only based data processing pipeline), and model architecture (i.e., request-only neural architectures). Our ROO training and modeling paradigm treats a user request as a unit of the training data. Compared with the established practice of treating a user impression as a unit, our new design achieves native feature deduplication in data logging, consequently saving data storage. Second, by de-duplicating computations and communications across multiple impressions in a request, this new paradigm enables highly scaled-up neural network architectures to better capture user interest signals, such as Generative Recommenders (GRs) and other request-only friendly architectures.

cs.IR

Diffusion-driven SpatioTemporal Graph KANsformer for Medical Examination Recommendation

Recommendation systems in AI-based medical diagnostics and treatment constitute a critical component of AI in healthcare. Although some studies have explored this area and made notable progress, healthcare recommendation systems remain in their nascent stage. And these researches mainly target the treatment process such as drug or disease recommendations. In addition to the treatment process, the diagnostic process, particularly determining which medical examinations are necessary to evaluate the condition, also urgently requires intelligent decision support. To bridge this gap, we first formalize the task of medical examination recommendations. Compared to traditional recommendations, the medical examination recommendation involves more complex interactions. This complexity arises from two folds: 1) The historical medical records for examination recommendations are heterogeneous and redundant, which makes the recommendation results susceptible to noise. 2) The correlation between the medical history of patients is often irregular, making it challenging to model spatiotemporal dependencies. Motivated by the above observation, we propose a novel Diffusion-driven SpatioTemporal Graph KANsformer for Medical Examination Recommendation (DST-GKAN) with a two-stage learning paradigm to solve the above challenges. In the first stage, we exploit a task-adaptive diffusion model to distill recommendation-oriented information by reducing the noises in heterogeneous medical data. In the second stage, a spatiotemporal graph KANsformer is proposed to simultaneously model the complex spatial and temporal relationships. Moreover, to facilitate the medical examination recommendation research, we introduce a comprehensive dataset. The experimental results demonstrate the state-of-the-art performance of the proposed method compared to various competitive baselines.

cs.IR

CoCoDiff: Diversifying Skeleton Action Features via Coarse-Fine Text-Co-Guided Latent Diffusion

In action recognition tasks, feature diversity is essential for enhancing model generalization and performance. Existing methods typically promote feature diversity by expanding the training data in the sample space, which often leads to inefficiencies and semantic inconsistencies. To overcome these problems, we propose a novel Coarse-fine text co-guidance Diffusion model (CoCoDiff). CoCoDiff generates diverse yet semantically consistent features in the latent space by leveraging diffusion and multi-granularity textual guidance. Specifically, our approach feeds spatio-temporal features extracted from skeleton sequences into a latent diffusion model to generate diverse action representations. Meanwhile, we introduce a coarse-fine text co-guided strategy that leverages textual information from large language models (LLMs) to ensure semantic consistency between the generated features and the original inputs. It is noted that CoCoDiff operates as a plug-and-play auxiliary module during training, incurring no additional inference cost. Extensive experiments demonstrate that CoCoDiff achieves SOTA performance on skeleton-based action recognition benchmarks, including NTU RGB+D, NTU RGB+D 120 and Kinetics-Skeleton.

cs.CV

Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning

Image captioning has long been a pivotal task in visual understanding, with recent advancements in vision-language models (VLMs) significantly enhancing the ability to generate detailed image captions. However, the evaluation of detailed image captioning remains underexplored due to outdated evaluation metrics and coarse annotations. In this paper, we introduce DeCapBench along with a novel metric, DCScore, specifically designed for detailed captioning tasks. DCScore evaluates hallucinations and fine-grained comprehensiveness by deconstructing responses into the smallest self-sufficient units, termed primitive information units, and assessing them individually. Our evaluation shows that DCScore aligns more closely with human judgment than other rule-based or model-based metrics. Concurrently, DeCapBench exhibits a high correlation with VLM arena results on descriptive tasks, surpassing existing benchmarks for vision-language models. Additionally, we present an automatic fine-grained feedback collection method, FeedQuill, for preference optimization based on our advanced metric, showing robust generalization capabilities across auto-generated preference data. Extensive experiments on multiple VLMs demonstrate that our method not only significantly reduces hallucinations but also enhances performance across various benchmarks, achieving superior detail captioning performance while surpassing GPT-4o.

cs.CV

WVEmbs with its Masking: A Method For Radar Signal Sorting

Our study proposes a novel embedding method, Wide-Value-Embeddings (WVEmbs), for processing Pulse Descriptor Words (PDWs) as normalized inputs to neural networks. This method adapts to the distribution of interleaved radar signals, ranking original signal features from trivial to useful and stabilizing the learning process. To address the imbalance in radar signal interleaving, we introduce a value dimension masking method on WVEmbs, which automatically and efficiently generates challenging samples, and constructs interleaving scenarios, thereby compelling the model to learn robust features. Experimental results demonstrate that our method is an efficient end-to-end approach, achieving high-granularity, sample-level pulse sorting for high-density interleaved radar pulse sequences in complex and non-ideal environments.

eess.SP

Learned Correction Methods for Ultrasound Computed Tomography Imaging Using Simplified Physics Models

Ultrasound computed tomography (USCT) is an emerging modality for breast imaging. Image reconstruction methods that incorporate accurate wave physics produce high resolution quantitative images of acoustic properties but are computationally expensive. The use of a simplified linear model in reconstruction reduces computational expense at the cost of reduced accuracy. This work aims to systematically compare different learning approaches for USCT reconstruction utilizing simplified linear models. This work considered various learning approaches to compensate for errors stemming from a linearized wave propagation model: correction in the data and image domains. The resulting image reconstruction methods are systematically assessed, alongside data-driven and model-based methods, in four virtual imaging studies utilizing anatomically realistic numerical phantoms. Image quality was assessed utilizing relative root mean square error (RRMSE), structural similarity index measure (SSIM), and a task-based assessment for tumor detection. Correction in the measurement domain resulted in images with minor visual artifacts and highly accurate task performance. Correction in the image domain demonstrated a heavy bias on training data, resulting in hallucinations, but greater robustness to measurement noise. Combining both forms of correction performed best in terms of RRMSE and SSIM, at the cost of task performance. This work systematically assessed learned reconstruction methods incorporating an approximated physical model for USCT imaging. Results demonstrated the importance of incorporating physics, compared to data-driven methods. Learning a correction in the data domain led to better task performance and robust out-of-distribution generalization compared to correction in the image domain.

eess.IV

Goku: Flow Based Video Generative Foundation Models

This paper introduces Goku, a state-of-the-art family of joint image-and-video generation models leveraging rectified flow Transformers to achieve industry-leading performance. We detail the foundational elements enabling high-quality visual generation, including the data curation pipeline, model architecture design, flow formulation, and advanced infrastructure for efficient and robust large-scale training. The Goku models demonstrate superior performance in both qualitative and quantitative evaluations, setting new benchmarks across major tasks. Specifically, Goku achieves 0.76 on GenEval and 83.65 on DPG-Bench for text-to-image generation, and 84.85 on VBench for text-to-video tasks. We believe that this work provides valuable insights and practical advancements for the research community in developing joint image-and-video generation models.

cs.CV