arXiv subjects

Zhe Li

Publications and source records attributed to Zhe Li.

At least 181 records · Page 10Linked to original sources

arXiv2025

Demonstration of Time-reversal Symmetric Two-Dimensional Photonic Topological Anderson Insulator

Recently, the impact of disorder on topological properties has attracted significant attention in photonics, especially the intriguing disorder-induced topological phase transitions in photonic topological Anderson insulators (PTAIs). However, the reported PTAIs are based on time-reversal symmetry broken systems or quasi-three-dimensional time-reversal invariant system, both of which would limit the applications in integrated optics. Here, we realize a time-reversal symmetric two-dimensional PTAI on silicon platform within the near-IR wavelength range, taking the advantageous valley degree of freedom of photonic crystal. A low-threshold topological Anderson phase transition is observed by applying disorder to the critical topologically trivial phase. Conversely, we have also realized extremely robust topologically protected edge states based on the stable topological phase. Both two phenomena are validated through theoretical Dirac Hamiltonian analysis, numerical simulations, and experimental measurements. Our proposed structure holds promise to achieve near-zero topological phase transition thresholds, which breaks the conventional cognition that strong disorder is required to induce the phase transition. It significantly alleviates the difficulty of manipulating disorder and could be extended to other systems, such as condensed matter systems where strong disorder is hard to implement. This work is also beneficial to construct highly robust photonic integrated circuits serving for on-chip photonic and quantum optic information processing. Moreover, this work also provides an outstanding platform to investigate on-chip integrated disordered systems.

physics.optics↗

arXiv2025

Subtractive Training for Music Stem Insertion using Latent Diffusion Models

We present Subtractive Training, a simple and novel method for synthesizing individual musical instrument stems given other instruments as context. This method pairs a dataset of complete music mixes with 1) a variant of the dataset lacking a specific stem, and 2) LLM-generated instructions describing how the missing stem should be reintroduced. We then fine-tune a pretrained text-to-audio diffusion model to generate the missing instrument stem, guided by both the existing stems and the text instruction. Our results demonstrate Subtractive Training's efficacy in creating authentic drum stems that seamlessly blend with the existing tracks. We also show that we can use the text instruction to control the generation of the inserted stem in terms of rhythm, dynamics, and genre, allowing us to modify the style of a single instrument in a full song while keeping the remaining instruments the same. Lastly, we extend this technique to MIDI formats, successfully generating compatible bass, drum, and guitar parts for incomplete arrangements.

cs.SD↗

arXiv2025

Designing Guidance for Multiple Valley-based Topological States Driven by Magnetic Substrates: Potential Applications at High Temperatures

Valley-based topological phases offer a wealth of exotic quantum states with tunable functionalities, driven by the valley degree of freedom. In this work, by constructing heterostructures of germanene (silicene, stanene) on various magnetic substrates, we address key tuning factors such as the spin-orbit coupling (SOC) strength of the substrate, magnetic orientations, and stacking orders, all of which govern multiple valley-based topological features. We present a comprehensive guiding principle for the efficient manipulation of these features, achieved simply by designing and modulating the magnetic properties of the underlying substrates. Specifically, increasing the SOC strength of the magnetic substrate acilitates a range of topological phase transitions characterized by different Chern numbers, with many systems exhibiting a transition from quantum valley Hall to quantum anomalous Hall (QAH) states. Additionally, rotating the in-plane magnetic orientation of the substrate enables tunability of the Chern number and chirality, within a moderate range of SOC strength. Furthermore, the antiferromagnetic coupling of the magnetic substrate can induce valley-based QAH states with substantial valley gaps, leveraging its high Curie temperature (TC) to enable the realization of multiple tunable magnetic topologies at elevated temperatures. Our findings provide a straightforward strategy for the design and manipulation of spintronic and valleytronic devices that can potentially operate under high-temperature conditions.

cond-mat.mtrl-sci↗

arXiv2024

Decoupling of carbonate-organic carbon isotope during the Carnian Pluvial Episode

The Carnian Pluvial Episode (CPE) was a major global climate change event in the early Late Triassic that significantly affected marine ecosystems and carbon cycles. One of the most prominent features of the CPE is the coupled multiple negative carbonate-organic carbon isotope excursions. However, at Erguan and Xiashulao from eastern Tethys, a decoupling between carbonate-organic carbon isotope during CPE was observed. At the end of early Carnian (Julian), the carbonate carbon isotope showed a negative excursion of 2-3 per-mille, while the organic carbon isotope exhibited a positive excursion of about 3-4 per-mille. In addition, increased terrestrial inputs is indicated by the rising C/N (3 to 10) and decreasing Y/Ho (42 to 27) that coexist with this decoupling. The coupling of carbon isotope negative excursions is from the shallow shelves and the deep slopes, whereas the decoupling occurs from the deep shelf to the shallow slope. In the deep shelf to the shallow slope, sedimentary organic matter is mainly sourced from pelagic before the CPE as evidenced by low C/N (3) and high Y/Ho (36-42). During the CPE, the increased fresh water flux (Sr/Ba <1) enhanced terrestrial input in organic matter, which may cause positive excursions in the carbon isotope record with elevated TOC content. As a result, the carbonate-organic carbon isotope decoupled. In contrast, organic matter in sediments from the shallow shelf and deep slope are mainly from terrestrial and pelagic sources, respectively. This study reveals the significant impact of terrestrial inputs on marine carbon cycling during the Carnian Pluvial Episode, highlighting the crucial role of climate events in modifying the carbon isotope record.

physics.ao-ph↗

arXiv2024

Do Influence Functions Work on Large Language Models?

Influence functions are important for quantifying the impact of individual training data points on a model's predictions. Although extensive research has been conducted on influence functions in traditional machine learning models, their application to large language models (LLMs) has been limited. In this work, we conduct a systematic study to address a key question: do influence functions work on LLMs? Specifically, we evaluate influence functions across multiple tasks and find that they consistently perform poorly in most settings. Our further investigation reveals that their poor performance can be attributed to: (1) inevitable approximation errors when estimating the iHVP component due to the scale of LLMs, (2) uncertain convergence during fine-tuning, and, more fundamentally, (3) the definition itself, as changes in model parameters do not necessarily correlate with changes in LLM behavior. Thus, our study suggests the need for alternative approaches for identifying influential samples.

cs.CL↗

arXiv2024

Unleashing the Unseen: Harnessing Benign Datasets for Jailbreaking Large Language Models

Despite significant ongoing efforts in safety alignment, large language models (LLMs) such as GPT-4 and LLaMA 3 remain vulnerable to jailbreak attacks that can induce harmful behaviors, including through the use of adversarial suffixes. Building on prior research, we hypothesize that these adversarial suffixes are not mere bugs but may represent features that can dominate the LLM's behavior. To evaluate this hypothesis, we conduct several experiments. First, we demonstrate that benign features can be effectively made to function as adversarial suffixes, i.e., we develop a feature extraction method to extract sample-agnostic features from benign dataset in the form of suffixes and show that these suffixes may effectively compromise safety alignment. Second, we show that adversarial suffixes generated from jailbreak attacks may contain meaningful features, i.e., appending the same suffix to different prompts results in responses exhibiting specific characteristics. Third, we show that such benign-yet-safety-compromising features can be easily introduced through fine-tuning using only benign datasets. As a result, we are able to completely eliminate GPT's safety alignment in a blackbox setting through finetuning with only benign data. Our code and data is available at \url{https://github.com/suffix-maybe-feature/adver-suffix-maybe-features}.

cs.CR↗

arXiv2024

Bridging the User-side Knowledge Gap in Knowledge-aware Recommendations with Large Language Models

In recent years, knowledge graphs have been integrated into recommender systems as item-side auxiliary information, enhancing recommendation accuracy. However, constructing and integrating structural user-side knowledge remains a significant challenge due to the improper granularity and inherent scarcity of user-side features. Recent advancements in Large Language Models (LLMs) offer the potential to bridge this gap by leveraging their human behavior understanding and extensive real-world knowledge. Nevertheless, integrating LLM-generated information into recommender systems presents challenges, including the risk of noisy information and the need for additional knowledge transfer. In this paper, we propose an LLM-based user-side knowledge inference method alongside a carefully designed recommendation framework to address these challenges. Our approach employs LLMs to infer user interests based on historical behaviors, integrating this user-side information with item-side and collaborative data to construct a hybrid structure: the Collaborative Interest Knowledge Graph (CIKG). Furthermore, we propose a CIKG-based recommendation framework that includes a user interest reconstruction module and a cross-domain contrastive learning module to mitigate potential noise and facilitate knowledge transfer. We conduct extensive experiments on three real-world datasets to validate the effectiveness of our method. Our approach achieves state-of-the-art performance compared to competitive baselines, particularly for users with sparse interactions.

cs.IR↗

arXiv2024

MCMat: Multiview-Consistent and Physically Accurate PBR Material Generation

Existing 2D methods utilize UNet-based diffusion models to generate multi-view physically-based rendering (PBR) maps but struggle with multi-view inconsistency, while some 3D methods directly generate UV maps, encountering generalization issues due to the limited 3D data. To address these problems, we propose a two-stage approach, including multi-view generation and UV materials refinement. In the generation stage, we adopt a Diffusion Transformer (DiT) model to generate PBR materials, where both the specially designed multi-branch DiT and reference-based DiT blocks adopt a global attention mechanism to promote feature interaction and fusion between different views, thereby improving multi-view consistency. In addition, we adopt a PBR-based diffusion loss to ensure that the generated materials align with realistic physical principles. In the refinement stage, we propose a material-refined DiT that performs inpainting in empty areas and enhances details in UV space. Except for the normal condition, this refinement also takes the material map from the generation stage as an additional condition to reduce the learning difficulty and improve generalization. Extensive experiments show that our method achieves state-of-the-art performance in texturing 3D objects with PBR materials and provides significant advantages for graphics relighting applications. Project Page: https://lingtengqiu.github.io/2024/MCMat/

cs.CV↗

arXiv2024

Movable Antenna Aided NOMA: Joint Antenna Positioning, Precoding, and Decoding Design

This paper investigates movable antenna (MA) aided non-orthogonal multiple access (NOMA) for multi-user downlink communication, where the base station (BS) is equipped with a fixed-position antenna (FPA) array to serve multiple MA-enabled users. An optimization problem is formulated to maximize the minimum achievable rate among all the users by jointly optimizing the MA positioning of each user, the precoding matrix at the BS, and the successive interference cancellation (SIC) decoding indicator matrix at the users, subject to a set of constraints including the limited movement area of the MAs, the maximum transmit power of the BS, and the SIC decoding condition. To solve this non-convex problem, we propose a two-loop iterative optimization algorithm that combines the hippopotamus optimization (HO) method with the alternating optimization (AO) method to obtain a suboptimal solution efficiently. Specifically, in the inner loop, the complex-valued precoding matrix and the binary decoding indicator matrix are optimized alternatively by the successive convex approximation (SCA) technique with customized greedy search to maximize the minimum achievable rate for the given positions of the MAs. In the outer loop, each user's antenna position is updated using the HO algorithm, following a novel nature-inspired intelligent optimization framework. Simulation results show that the proposed algorithms can effectively avoid local optimum for highly coupled variables and significantly improve the rate performance of the NOMA system compared to the conventional FPA system as well as other benchmark schemes.

cs.IT↗

arXiv2024

Mixed QCD-EW corrections to $W$-pair production at electron-positron colliders

The discrepancy between the CDF measurement and the Standard Model theoretical prediction for the $W$-boson mass underscores the importance of conducting high-precision studies on the $W$ boson, which is one of the predominant objectives of proposed future $e^+e^-$ colliders. We investigate in detail the production of $W$-boson pairs at $e^+e^-$ colliders, and compute the next-to-next-to-leading order mixed QCD-EW corrections to both the integrated cross section and various kinematic distributions. By employing the method of differential equations, we analytically calculate the two-loop master integrals for the mixed QCD-EW virtual corrections to $e^+e^- \rightarrow W^+W^-$. Utilizing the Magnus transformation, we derive a set of canonical master integrals for each integral family. This canonical basis satisfies a system of differential equations in which the dependence on the dimensional regulator is linearly factorized from the kinematics. We then express all these canonical master integrals as Taylor series in $ε$ up to $ε^4$, with coefficients articulated in terms of Goncharov polylogarithms up to weight four. Upon applying our analytic expressions of these master integrals to the phenomenological analysis of $W$-pair production, we observe that the $\mathcal{O}(αα_s)$ corrections are significantly impactful in the $α(0)$ scheme, particularly in certain phase-space regions. However, these mixed QCD-EW corrections can be heavily suppressed by adopting the $G_μ$ scheme.

hep-ph↗

arXiv2024

AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction

Generating animatable human avatars from a single image is essential for various digital human modeling applications. Existing 3D reconstruction methods often struggle to capture fine details in animatable models, while generative approaches for controllable animation, though avoiding explicit 3D modeling, suffer from viewpoint inconsistencies in extreme poses and computational inefficiencies. In this paper, we address these challenges by leveraging the power of generative models to produce detailed multi-view canonical pose images, which help resolve ambiguities in animatable human reconstruction. We then propose a robust method for 3D reconstruction of inconsistent images, enabling real-time rendering during inference. Specifically, we adapt a transformer-based video generation model to generate multi-view canonical pose images and normal maps, pretraining on a large-scale video dataset to improve generalization. To handle view inconsistencies, we recast the reconstruction problem as a 4D task and introduce an efficient 3D modeling approach using 4D Gaussian Splatting. Experiments demonstrate that our method achieves photorealistic, real-time animation of 3D human avatars from in-the-wild images, showcasing its effectiveness and generalization capability.

cs.CV↗

arXiv2024

A Compact Hybrid Battery Thermal Management System for Enhanced Cooling

Hybrid battery thermal management systems (HBTMS) combining active liquid cooling and passive phase change materials (PCM) cooling have shown a potential for the thermal management of lithium-ion batteries. However, the fill volume of coolant and PCM in hybrid cooling systems is limited by the size and weight of the HBTMS at high charge/discharge rates. These limitations result in reduced convective heat transfer from the coolant during discharge. The liquefaction rate of PCM is accelerated and the passive cooling effect is reduced. In this paper, we propose a compact hybrid cooling system with multi-inlet U-shaped microchannels for which the gap between channels is embedded by PCM/aluminum foam for compactness. Nanofluid cooling (NC) technology with better thermal conductivity is used. A pulsed flow function is further developed for enhanced cooling (EC) with reduced power consumption. An experimentally validated thermal-fluid dynamics model is developed to optimize operating conditions including coolant type, cooling direction, channel height, inlet flow rate, and cooling scheme. The results show that the hybrid cooling solution of NC+PCM+EC adopted by HBTMS further reduces the maximum temperature of the Li-ion battery by 3.44°C under a discharge rate of 1C at room temperature of 25°C with only a 5% increase in power consumption, compared to the conventional liquid cooling method for electric vehicles (EV). The average number of battery charges has increased by about 6 to 15 percent. The results of this study can help improve the range as well as driving safety of new energy EV.

eess.SY↗

arXiv2024

HHAvatar: Gaussian Head Avatar with Dynamic Hairs

Creating high-fidelity 3D head avatars has always been a research hotspot, but it remains a great challenge under lightweight sparse view setups. In this paper, we propose HHAvatar represented by controllable 3D Gaussians for high-fidelity head avatar with dynamic hair modeling. We first use 3D Gaussians to represent the appearance of the head, and then jointly optimize neutral 3D Gaussians and a fully learned MLP-based deformation field to capture complex expressions. The two parts benefit each other, thereby our method can model fine-grained dynamic details while ensuring expression accuracy. Furthermore, we devise a well-designed geometry-guided initialization strategy based on implicit SDF and Deep Marching Tetrahedra for the stability and convergence of the training procedure. To address the problem of dynamic hair modeling, we introduce a hybrid head model into our avatar representation based Gaussian Head Avatar and a training method that considers timing information and an occlusion perception module to model the non-rigid motion of hair. Experiments show that our approach outperforms other state-of-the-art sparse-view methods, achieving ultra high-fidelity rendering quality at 2K resolution even under exaggerated expressions and driving hairs reasonably with the motion of the head

cs.CV↗

arXiv2024

Two-loop planar master integrals for NNLO QCD corrections to W-pair production in quark-antiquark annihilation

The planar two-loop scalar Feynman integrals contributing to the massive NNLO QCD corrections for $W$-boson pair production via quark-antiquark annihilation can be classified into three family branches, each of which is reduced to a distinct set of master integrals (MIs), totaling $27$, $45$ and $15$, respectively. These MIs are analytically calculated using the method of differential equations, with solutions expanded as Taylor series in the dimensional regulator $ε$. For the first two family branches, the differential systems can be successfully transformed into canonical form by adopting appropriate bases of MIs. This enables the MIs of these family branches to be expressed either as Goncharov polylogarithms (GPLs) or as one-fold integrals over GPLs, up to $\mathcal{O}(ε^4)$. In contrast, the differential system for the third family branch can only be cast into a form linear in $ε$ due to the presence of elliptic integrals. The solution to this linear-form differential system is expressed in an iterated form owing to the strictly lower-triangular structure of the coefficient matrices at $ε= 0$. Our analytic expressions for these MIs are verified with high accuracy against the numerical results from the \texttt{AMFlow} package.

hep-ph↗

arXiv2024

Data-Efficient Generation for Dataset Distillation

While deep learning techniques have proven successful in image-related tasks, the exponentially increased data storage and computation costs become a significant challenge. Dataset distillation addresses these challenges by synthesizing only a few images for each class that encapsulate all essential information. Most current methods focus on matching. The problems lie in the synthetic images not being human-readable and the dataset performance being insufficient for downstream learning tasks. Moreover, the distillation time can quickly get out of bounds when the number of synthetic images per class increases even slightly. To address this, we train a class conditional latent diffusion model capable of generating realistic synthetic images with labels. The sampling time can be reduced to several tens of images per seconds. We demonstrate that models can be effectively trained using only a small set of synthetic images and evaluated on a large real test set. Our approach achieved rank $1$ in The First Dataset Distillation Challenge at ECCV 2024 on the CIFAR100 and TinyImageNet datasets.

cs.CV↗

arXiv2024

All Robots in One: A New Standard and Unified Dataset for Versatile, General-Purpose Embodied Agents

Embodied AI is transforming how AI systems interact with the physical world, yet existing datasets are inadequate for developing versatile, general-purpose agents. These limitations include a lack of standardized formats, insufficient data diversity, and inadequate data volume. To address these issues, we introduce ARIO (All Robots In One), a new data standard that enhances existing datasets by offering a unified data format, comprehensive sensory modalities, and a combination of real-world and simulated data. ARIO aims to improve the training of embodied AI agents, increasing their robustness and adaptability across various tasks and environments. Building upon the proposed new standard, we present a large-scale unified ARIO dataset, comprising approximately 3 million episodes collected from 258 series and 321,064 tasks. The ARIO standard and dataset represent a significant step towards bridging the gaps of existing data resources. By providing a cohesive framework for data collection and representation, ARIO paves the way for the development of more powerful and versatile embodied AI agents, capable of navigating and interacting with the physical world in increasingly complex and diverse ways. The project is available on https://imaei.github.io/project_pages/ario/

cs.RO↗

arXiv2024

Next-to-next-to-leading order $\text{QCD} \otimes \text{EW}$ corrections to $Z$-boson pair production at electron-positron colliders

We present a comprehensive analytic calculation of the next-to-next-to-leading order $\text{QCD} \otimes \text{EW}$ corrections to $Z$-boson pair production at electron-positron colliders. The two-loop master integrals essential to this calculation are evaluated using the differential equation method. In this work, we detail the formulation and solution of the canonical differential equations for the two-loop three-point master integrals with two on-shell $Z$-boson external legs and a massive internal quark in the loops. These canonical master integrals are systematically expanded as Taylor series in the dimensional regulator, $ε= (4-d)/2$, up to the order of $ε^4$, with coefficients expressed in terms of Goncharov polylogarithms up to weight four. Upon applying our analytic expressions of these master integrals to the phenomenological analysis of $Z$-pair production, we observe that the $\mathcal{O}(αα_s)$ corrections manifest at a level of approximately one percent compared to the leading-order predictions, underscoring their significance for comparisons with future high-precision experimental data.

hep-ph↗

arXiv2024

Orca: Ocean Significant Wave Height Estimation with Spatio-temporally Aware Large Language Models

Significant wave height (SWH) is a vital metric in marine science, and accurate SWH estimation is crucial for various applications, e.g., marine energy development, fishery, early warning systems for potential risks, etc. Traditional SWH estimation methods that are based on numerical models and physical theories are hindered by computational inefficiencies. Recently, machine learning has emerged as an appealing alternative to improve accuracy and reduce computational time. However, due to limited observational technology and high costs, the scarcity of real-world data restricts the potential of machine learning models. To overcome these limitations, we propose an ocean SWH estimation framework, namely Orca. Specifically, Orca enhances the limited spatio-temporal reasoning abilities of classic LLMs with a novel spatiotemporal aware encoding module. By segmenting the limited buoy observational data temporally, encoding the buoys' locations spatially, and designing prompt templates, Orca capitalizes on the robust generalization ability of LLMs to estimate significant wave height effectively with limited data. Experimental results on the Gulf of Mexico demonstrate that Orca achieves state-of-the-art performance in SWH estimation.

cs.LG↗