arXiv subjects

Jie Zhu

Publications and source records attributed to Jie Zhu.

At least 109 records · Page 6Linked to original sources

arXiv2025

Association of 220 PeV Neutrino KM3-230213A with Gamma-Ray Bursts

Recently, the KM3NeT Collaboration announced the detection of a 220 PeV neutrino from the celestial coordinates RA=94.3\degree~ and Dec=-7.8\degree~ on 13 February 2023 at 01:16:47 UTC \cite{KM3NeT:2025npi}. The source for this extra-ordinary cosmic neutrino, designated KM3-230213A, is not identified yet but there has been speculation that it might be associated with a gamma-ray burst GRB~090401B \cite{Amelino-Camelia:2025lqn}. The purpose of this report is to search the association of this 220 PeV neutrino with potential GRB sources from a more general consideration of Lorentz invariance violation (LV) without predefined LV scale. We try to associate this extra-ordinary neutrino with potential GRBs within angular separation of 1\degree, 3\degree~ and 5\degree~ respectively and the results are listed in Table 1. We find the constraints $E_{\rm{LV}}\leq 5.3\times 10^{18}$~GeV for subluminal LV violation and $E_{\rm{LV}}\leq 5.6\times 10^{19}$~GeV for superluminal LV violation if KM3-230213A is a GRB neutrino.

astro-ph.HE↗

arXiv2025

Commenting Higher-level Code Unit: Full Code, Reduced Code, or Hierarchical Code Summarization

Commenting code is a crucial activity in software development, as it aids in facilitating future maintenance and updates. To enhance the efficiency of writing comments and reduce developers' workload, researchers has proposed various automated code summarization (ACS) techniques to automatically generate comments/summaries for given code units. However, these ACS techniques primarily focus on generating summaries for code units at the method level. There is a significant lack of research on summarizing higher-level code units, such as file-level and module-level code units, despite the fact that summaries of these higher-level code units are highly useful for quickly gaining a macro-level understanding of software components and architecture. To fill this gap, in this paper, we conduct a systematic study on how to use LLMs for commenting higher-level code units, including file level and module level. These higher-level units are significantly larger than method-level ones, which poses challenges in handling long code inputs within LLM constraints and maintaining efficiency. To address these issues, we explore various summarization strategies for ACS of higher-level code units, which can be divided into three types: full code summarization, reduced code summarization, and hierarchical code summarization. The experimental results suggest that for summarizing file-level code units, using the full code is the most effective approach, with reduced code serving as a cost-efficient alternative. However, for summarizing module-level code units, hierarchical code summarization becomes the most promising strategy. In addition, inspired by the research on method-level ACS, we also investigate using the LLM as an evaluator to evaluate the quality of summaries of higher-level code units. The experimental results demonstrate that the LLM's evaluation results strongly correlate with human evaluations.

cs.SE↗

arXiv2025

Clustering-based Low Rank Approximation Method

We propose a clustering-based generalized low rank approximation method, which takes advantage of appealing features from both the generalized low rank approximation of matrices (GLRAM) and cluster analysis. It exploits a more general form of clustering generators and similarity metrics so that it is more suitable for matrix-structured data relative to conventional partitioning methods. In our approach, we first pre-classify the initial matrix collection into several small subset clusters and then sequentially compress the matrices within the clusters. This strategy enhances the numerical precision of the low-rank approximation. In essence, we combine the ideas of GLRAM and clustering into a hybrid algorithm for dimensionality reduction. The proposed algorithm can be viewed as the generalization of both techniques. Theoretical analysis and numerical experiments are established to validate the feasibility and effectiveness of the proposed algorithm.

math.OC↗

arXiv2025

SimulPL: Aligning Human Preferences in Simultaneous Machine Translation

Simultaneous Machine Translation (SiMT) generates translations while receiving streaming source inputs. This requires the SiMT model to learn a read/write policy, deciding when to translate and when to wait for more source input. Numerous linguistic studies indicate that audiences in SiMT scenarios have distinct preferences, such as accurate translations, simpler syntax, and no unnecessary latency. Aligning SiMT models with these human preferences is crucial to improve their performances. However, this issue still remains unexplored. Additionally, preference optimization for SiMT task is also challenging. Existing methods focus solely on optimizing the generated responses, ignoring human preferences related to latency and the optimization of read/write policy during the preference optimization phase. To address these challenges, we propose Simultaneous Preference Learning (SimulPL), a preference learning framework tailored for the SiMT task. In the SimulPL framework, we categorize SiMT human preferences into five aspects: \textbf{translation quality preference}, \textbf{monotonicity preference}, \textbf{key point preference}, \textbf{simplicity preference}, and \textbf{latency preference}. By leveraging the first four preferences, we construct human preference prompts to efficiently guide GPT-4/4o in generating preference data for the SiMT task. In the preference optimization phase, SimulPL integrates \textbf{latency preference} into the optimization objective and enables SiMT models to improve the read/write policy, thereby aligning with human preferences more effectively. Experimental results indicate that SimulPL exhibits better alignment with human preferences across all latency levels in Zh$\rightarrow$En, De$\rightarrow$En and En$\rightarrow$Zh SiMT tasks. Our data and code will be available at https://github.com/EurekaForNLP/SimulPL.

cs.CL↗

arXiv2025

Speech Translation Refinement using Large Language Models

Recent advancements in large language models (LLMs) have demonstrated their remarkable capabilities across various language tasks. Inspired by the success of text-to-text translation refinement, this paper investigates how LLMs can improve the performance of speech translation by introducing a joint refinement process. Through the joint refinement of speech translation (ST) and automatic speech recognition (ASR) transcription via LLMs, the performance of the ST model is significantly improved in both training-free in-context learning and parameter-efficient fine-tuning scenarios. Additionally, we explore the effect of document-level context on refinement under the context-aware fine-tuning scenario. Experimental results on the MuST-C and CoVoST 2 datasets, which include seven translation tasks, demonstrate the effectiveness of the proposed approach using several popular LLMs including GPT-3.5-turbo, LLaMA3-8B, and Mistral-12B. Further analysis further suggests that jointly refining both transcription and translation yields better performance compared to refining translation alone. Meanwhile, incorporating document-level context significantly enhances refinement performance. We release our code and datasets on GitHub.

cs.CL↗

arXiv2025

Speech Enhancement with Overlapped-Frame Information Fusion and Causal Self-Attention

For time-frequency (TF) domain speech enhancement (SE) methods, the overlap-and-add operation in the inverse TF transformation inevitably leads to an algorithmic delay equal to the window size. However, typical causal SE systems fail to utilize the future speech information within this inherent delay, thereby limiting SE performance. In this paper, we propose an overlapped-frame information fusion scheme. At each frame index, we construct several pseudo overlapped-frames, fuse them with the original speech frame, and then send the fused results to the SE model. Additionally, we introduce a causal time-frequency-channel attention (TFCA) block to boost the representation capability of the neural network. This block parallelly processes the intermediate feature maps through self-attention-based operations in the time, frequency, and channel dimensions. Experiments demonstrate the superiority of these improvements, and the proposed SE system outperforms the current advanced methods.

eess.AS↗

arXiv2024

Seven-octave ultrabroadband metamaterial absorbers via Q-weighted mode density modulation

Absorption is a crucial parameter in shaping wave propagation dynamics, yet achieving ultra-broadband absorption remains highly challenging, particularly in balancing low-frequency and broad bandwidth. Here, we present a metamaterial absorber (MMA) capable of achieving simultaneous spectral coverage across a seven-octave range of near-perfect absorption from 100 Hz to 12,800 Hz by engineering the quality-factor-weighted (Q-weighted) mode density. The Q-weighted mode density considers mode density, resonant frequencies, radiative loss, and intrinsic loss of multiple resonant modes, providing a comprehensive approach to govern broadband absorption properties. By optimizing the number of resonant modes and managing intrinsic losses, our approach achieves an intensive Q-weighted mode density across an ultra-wide bandwidth, enabling ultra-broadband absorption with high efficiency. These findings significantly advance the bandwidth capabilities of state-of-the-art MMAs and pave the way for the development of ultra-broadband metamaterial devices across various wave systems.

physics.app-ph↗

arXiv2024

MoLE: Enhancing Human-centric Text-to-image Diffusion via Mixture of Low-rank Experts

Text-to-image diffusion has attracted vast attention due to its impressive image-generation capabilities. However, when it comes to human-centric text-to-image generation, particularly in the context of faces and hands, the results often fall short of naturalness due to insufficient training priors. We alleviate the issue in this work from two perspectives. 1) From the data aspect, we carefully collect a human-centric dataset comprising over one million high-quality human-in-the-scene images and two specific sets of close-up images of faces and hands. These datasets collectively provide a rich prior knowledge base to enhance the human-centric image generation capabilities of the diffusion model. 2) On the methodological front, we propose a simple yet effective method called Mixture of Low-rank Experts (MoLE) by considering low-rank modules trained on close-up hand and face images respectively as experts. This concept draws inspiration from our observation of low-rank refinement, where a low-rank module trained by a customized close-up dataset has the potential to enhance the corresponding image part when applied at an appropriate scale. To validate the superiority of MoLE in the context of human-centric image generation compared to state-of-the-art, we construct two benchmarks and perform evaluations with diverse metrics and human studies. Datasets, model, and code are released at https://sites.google.com/view/mole4diffuser/.

cs.CV↗

arXiv2024

Spin polarization of $Λ$ hyperons along beam direction in p+Pb collisions at $\sqrt{s_{NN}}=8.16$ TeV using hydrodynamic approaches

We have implemented the 3+1 dimensional CLVisc hydrodynamics model with TRENTO-3D initial conditions to investigate the spin polarization of $Λ$ hyperons along the beam direction in p+Pb collisions at $\sqrt{s_{NN}} = 8.16$ TeV. Following our previous theoretical framework based on quantum kinetic theory, we consider three different scenarios: $Λ$ equilibrium, $s$ quark equilibrium, and iso-thermal equilibrium scenarios. We have computed the second Fourier sine coefficients of spin polarization along the beam direction, denoted as $\left\langle P_{z} \sin 2(ϕ_{p} - Ψ_{2}) \right\rangle$, with $ϕ_{p} - Ψ_{2}$ being the azimuthal angle relative to the second-order event plane $Ψ_{2}$, as functions of multiplicity, transverse momentum and pseudo-rapidity in the three scenarios. Additionally, we have also computed the spin polarization along the beam direction, $P_{z}$, as a function of the azimuthal angle. We find that the spin polarization induced by thermal vorticity always provides an opposite contribution compared to the shear-induced polarization in p+Pb collisions. The total spin polarization computed by the current hydrodynamic model disagrees with the data measured by LHC-CMS experiments. Our findings imply that other non-flow effects may play a crucial role in p+Pb collisions.

hep-ph↗

arXiv2024

A Unified Membership Inference Method for Visual Self-supervised Encoder via Part-aware Capability

Self-supervised learning shows promise in harnessing extensive unlabeled data, but it also confronts significant privacy concerns, especially in vision. In this paper, we aim to perform membership inference on visual self-supervised models in a more realistic setting: self-supervised training method and details are unknown for an adversary when attacking as he usually faces a black-box system in practice. In this setting, considering that self-supervised model could be trained by completely different self-supervised paradigms, e.g., masked image modeling and contrastive learning, with complex training details, we propose a unified membership inference method called PartCrop. It is motivated by the shared part-aware capability among models and stronger part response on the training data. Specifically, PartCrop crops parts of objects in an image to query responses with the image in representation space. We conduct extensive attacks on self-supervised models with different training protocols and structures using three widely used image datasets. The results verify the effectiveness and generalization of PartCrop. Moreover, to defend against PartCrop, we evaluate two common approaches, i.e., early stop and differential privacy, and propose a tailored method called shrinking crop scale range. The defense experiments indicate that all of them are effective. Our code is available at https://github.com/JiePKU/PartCrop.

cs.CV↗

arXiv2024

The Radiation Gauge: When is it Valid?

In this paper, we shall show that the vector-scalar potential ($\mathbf{A}$-$Φ$) formulation, for many problems, can be further simplified by ignoring the scalar potential contribution and setting it to zero.

physics.optics↗

arXiv2024

Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Dataset

In light of recent breakthroughs in large language models (LLMs) that have revolutionized natural language processing (NLP), there is an urgent need for new benchmarks to keep pace with the fast development of LLMs. In this paper, we propose CFLUE, the Chinese Financial Language Understanding Evaluation benchmark, designed to assess the capability of LLMs across various dimensions. Specifically, CFLUE provides datasets tailored for both knowledge assessment and application assessment. In knowledge assessment, it consists of 38K+ multiple-choice questions with associated solution explanations. These questions serve dual purposes: answer prediction and question reasoning. In application assessment, CFLUE features 16K+ test instances across distinct groups of NLP tasks such as text classification, machine translation, relation extraction, reading comprehension, and text generation. Upon CFLUE, we conduct a thorough evaluation of representative LLMs. The results reveal that only GPT-4 and GPT-4-turbo achieve an accuracy exceeding 60\% in answer prediction for knowledge assessment, suggesting that there is still substantial room for improvement in current LLMs. In application assessment, although GPT-4 and GPT-4-turbo are the top two performers, their considerable advantage over lightweight LLMs is noticeably diminished. The datasets and scripts associated with CFLUE are openly accessible at https://github.com/aliyun/cflue.

cs.CL↗

arXiv2024

Shifting the Paradigm: Estimating Heterogeneous Treatment Effects in the Development of Walkable Cities Design

The transformation of urban environments to accommodate growing populations has profoundly impacted public health and well-being. This paper addresses the critical challenge of estimating the impact of urban design interventions on diverse populations. Traditional approaches, reliant on questionnaires and stated preference techniques, are limited by recall bias and capturing the complex dynamics between environmental attributes and individual characteristics. To address these challenges, we integrate Virtual Reality (VR) with observational causal inference methods to estimate heterogeneous treatment effects, specifically employing Targeted Maximum Likelihood Estimation (TMLE) for its robustness against model misspecification. Our innovative approach leverages VR-based experiment to collect data that reflects perceptual and experiential factors. The result shows the heterogeneous impacts of urban design elements on public health and underscore the necessity for personalized urban design interventions. This study not only extends the application of TMLE to built environment research but also informs public health policy by illuminating the nuanced effects of urban design on mental well-being and advocating for tailored strategies that foster equitable, health-promoting urban spaces.

stat.AP↗

arXiv2024

Constraint on Lorentz invariance violation from Vela pulsar

The High Energy Stereoscopic System (H.E.S.S) Collaboration reported the discovery of a novel radiation component from the Vela pulsar by their Cherenkov telescopes. It is of great importance that gamma rays with energies of at least 20~TeV are recorded unexpectedly. The H.E.S.S Collaboration argued that such results may challenge the state-of-the-art models for the high-energy emission of pulsars. We point out in this work that these results also provide a unique opportunity to constrain certain Lorentz invariance violation parameters, leading to the realization of studying Lorentz invariance violation by using gamma-ray pulsars. The Lorentz invariance violation scale is constrained at the level of $E_{\mathrm{LV,}1}> 1.66\times 10^{17} \rm GeV$ for the linear scenario, and $E_{\mathrm{LV,}2}>3.53\times 10^{10} \rm GeV$ for the quadratic scenario. We anticipate that digging into the detailed features of the data of the Vela pulsar and analyzing potentially more very-high-energy photon data from pulsars in the future would improve the constraints on Lorentz invariance violation.

astro-ph.HE↗

arXiv2024

Anisotropic flow, flow fluctuation and flow decorrelation in relativistic heavy-ion collisions: the roles of sub-nucleon structure and shear viscosity

We study the transverse momentum ($p_T$) differential anisotropic flow and flow fluctuation in Pb+Pb collisions at $\sqrt{s_{NN}}$=5.02 TeV at the LHC. A (3+1)-dimensional CLVisc hydrodynamics framework with fluctuating TRENTO (or AMPT) initial conditions is utilized to simulate the space-time evolution of the quark-gluon plasma (QGP) medium. The effects of shear viscosity and the sub-nucleon structure on anisotropic flow and flow fluctuation are analyzed. Our result shows that shear viscosity tends to suppress both flow coefficients (${v_2\{2}\}$, ${v_2\{4\}}$, ${\langle v_2\rangle}$) and flow fluctuation (${σ_{v_2}}$) due to its smearing effect on local density fluctuation. The flow coefficients appear to be insensitive to the sub-nucleon structure, whereas for flow fluctuation ${σ_{v_2}}$, it tends to be suppressed by the sub-nucleon structure in central collisions but enhanced in peripheral collisions. After taking into account the sub-nucleon structure effect, our numerical result can quantitatively describe the relative flow fluctuations (${v_2\{4\}/v_2\{2\}}$, $F({v_2})$) measured by the ALICE Collaboration at the LHC. We further investigate the effects of shear viscosity, sub-nucleon structure and initial condition model on the flow angle and flow magnitude decorrelations (${A_2^f}$, ${M_2^f}$) using the four-particle correlation method. We find that the flow decorrelation effect is typically stronger in central collisions than in peripheral collisions. The flow angle decorrelation is found to be insensitive to the shear viscosity and sub-nucleon structure, whereas the flow magnitude decorrelation shows quite different behavior when using TRENTO or AMPT initial condition model. Our study sheds light on the anisotropic flow, transport properties and initial structure of the QGP created in high-energy nuclear collisions.

hep-ph↗

arXiv2024

Understanding Self-Supervised Pretraining with Part-Aware Representation Learning

In this paper, we are interested in understanding self-supervised pretraining through studying the capability that self-supervised representation pretraining methods learn part-aware representations. The study is mainly motivated by that random views, used in contrastive learning, and random masked (visible) patches, used in masked image modeling, are often about object parts. We explain that contrastive learning is a part-to-whole task: the projection layer hallucinates the whole object representation from the object part representation learned from the encoder, and that masked image modeling is a part-to-part task: the masked patches of the object are hallucinated from the visible patches. The explanation suggests that the self-supervised pretrained encoder is required to understand the object part. We empirically compare the off-the-shelf encoders pretrained with several representative methods on object-level recognition and part-level recognition. The results show that the fully-supervised model outperforms self-supervised models for object-level recognition, and most self-supervised contrastive learning and masked image modeling methods outperform the fully-supervised method for part-level recognition. It is observed that the combination of contrastive learning and masked image modeling further improves the performance.

cs.CV↗

arXiv2024

A Two-Stage Framework in Cross-Spectrum Domain for Real-Time Speech Enhancement

Two-stage pipeline is popular in speech enhancement tasks due to its superiority over traditional single-stage methods. The current two-stage approaches usually enhance the magnitude spectrum in the first stage, and further modify the complex spectrum to suppress the residual noise and recover the speech phase in the second stage. The above whole process is performed in the short-time Fourier transform (STFT) spectrum domain. In this paper, we re-implement the above second sub-process in the short-time discrete cosine transform (STDCT) spectrum domain. The reason is that we have found STDCT performs greater noise suppression capability than STFT. Additionally, the implicit phase of STDCT ensures simpler and more efficient phase recovery, which is challenging and computationally expensive in the STFT-based methods. Therefore, we propose a novel two-stage framework called the STFT-STDCT spectrum fusion network (FDFNet) for speech enhancement in cross-spectrum domain. Experimental results demonstrate that the proposed FDFNet outperforms the previous two-stage methods and also exhibits superior performance compared to other advanced systems.

eess.AS↗

arXiv2024

A full-time scale energy management and battery size optimization for off-grid renewable power to hydrogen systems: A battery energy storage-based grid-forming case in Inner Mongolian

Hydrogen plays an important role in the context of global carbon reduction. For an off-grid renewable power to hydrogen system (OReP2HS), a grid-forming (GFM) source is essential to provide frequency and voltage references. Here, we take battery works as a GFM source, and the OReP2HS we focus on is comprised of solar photovoltaic, wind turbines, and alkaline electrolyzers for hydrogen generation. An elaborative full-time scale energy management strategy (EMS) covers GFM control to system scheduling (from milliseconds to hours) and is proposed to support high-precision production simulations. Loads of electrolysers are designed to track the renewable power closely to partly replace the energy balancing requirement of the battery. A continuous operation strategy during an emergency like a unit drop is also included in the presented EMS. An off-line simulation-based iterative searching algorithm is developed to find the most suitable size of the battery with the minimum levelized cost of hydrogen (LCOH). A practical OReP2H project located in Inner Mongolian, China is taken as a case study. Simulation results demonstrate the feasibility of the proposed method, and the optimized capacity of the battery (3.4MWh) only accounts for 13.6% of the total installed capacity of the sources with the proposed EMS. Sensitivity analysis shows that LOCH rises from 28.829 CYN/kg to 37.814 CYN/kg, with the time-step for fast power regulation of electrolysers changing from 4s to 1 min with a ramp rate of 0.05MW/s.

eess.SY↗