arXiv subjects

Xin Lu

Publications and source records attributed to Xin Lu.

At least 127 records · Page 7Linked to original sources

arXiv2025

Tuning competition between charge order and superconductivity in the square-lattice $t$-$t'$-$J$ model

Recently, a flurry of works have found strong competition between charge density wave (CDW) and superconductivity (SC) in the doped Hubbard and $t$-$J$ models on the square lattice. Interestingly, some recent results suggest that the electron-phonon coupling may suppress CDW order and enhance SC. In this work, we consider the square-lattice Hubbard model with the Holstein or Su-Schrieffer-Heeger electron-phonon coupling at the large-$U$ and antiadiabatic (infinite phonon frequency) limit, which gives an effective $t$-$J$ model with either a density attractive interaction $V$ or a $J_P$ term that contributes a larger spin exchange and a density repulsive interaction. To explore how these effective couplings may suppress CDW and give a SC, we implement the density matrix renormalization group simulation on the $t$-$t'$-$J$ model with $V$ or $J_P$ coupling. We focus on the {\it six-leg} cylinder system with the next-nearest-neighbor hopping $t'$, which hosts partially filled stripe and $d$-wave SC in phase diagram. By tuning $t'/t > 0$ and $V$ or $J_P$, we establish two quantum phase diagrams. In the SC phases, the increased $V$ or $J_P$ coupling can enhance the quasi-long-range SC order, consistent with some previous findings. Nonetheless, no SC emerges when the partially filled stripe phase disappears with increased $V$ or $J_P$. Instead, the system has a transition to either a phase-separation-like regime or a filled stripe phase. On the other hand, with increased $t'/t$, not only the partially filled stripe but the phase separation and filled stripe can also be tuned to SC phase. Our results suggest that although $V$ and $J_P$ couplings may strengthen hole binding, the hole dynamics controlled by $t'/t$ appears to play more crucial role for obtaining a SC in $t$-$J$ model.

cond-mat.str-el↗

arXiv2025

Promoting Shared Energy Storage Aggregation among High Price-Tolerance Prosumer: An Incentive Deposit and Withdrawal Service

Many residential prosumers exhibit a high price-tolerance for household electricity bills and a low response to price incentives. This is because the household electricity bills are not inherently high, and the potential for saving on electricity bills through participation in conventional Shared Energy Storage (SES) is limited, which diminishes their motivation to actively engage in SES. Additionally, existing SES models often require prosumers to take additional actions, such as optimizing rental capacity and bidding prices, which happen to be capabilities that typical household prosumers do not possess. To incentivize these high price-tolerance residential prosumers to participate in SES, a novel SES aggregation framework is proposed, which does not require prosumers to take additional actions and allows them to maintain existing energy storage patterns. Compared to conventional long-term operation of SES, the proposed framework introduces an additional short-term construction step during which the energy service provider (ESP) acquires control of the energy storage systems (ESS) and offers electricity deposit and withdrawal services (DWS) with dynamic coefficients, enabling prosumers to withdraw more electricity than they deposit without additional actions. Additionally, a matching mechanism is proposed to align prosumers' electricity consumption behaviors with ESP's optimization strategies. Finally, the dynamic coefficients in DWS and trading strategies are optimized by an improved deep reinforcement learning (DRL) algorithm. Case studies are conducted to verify the effectiveness of the proposed SES aggregation framework with DWS and the matching mechanism.

eess.SY↗

arXiv2025

Prediction Interval Construction Method for Electricity Prices

Accurate prediction of electricity prices plays an essential role in the electricity market. To reflect the uncertainty of electricity prices, price intervals are predicted. This paper proposes a novel prediction interval construction method. A conditional generative adversarial network is first presented to generate electricity price scenarios, with which the prediction intervals can be constructed. Then, different generated scenarios are stacked to obtain the probability densities, which can be applied to accurately reflect the uncertainty of electricity prices. Furthermore, a reinforced prediction mechanism based on the volatility level of weather factors is introduced to address the spikes or volatile prices. A case study is conducted to verify the effectiveness of the proposed novel prediction interval construction method. The method can also provide the probability density of each price scenario within the prediction interval and has the superiority to address the volatile prices and price spikes with a reinforced prediction mechanism.

cs.LG↗

arXiv2025

Strong superconducting pairing strength and pseudogap features in a putative multiphase heavy-fermion superconductor CeRh2As2 by soft point-contact spectroscopy

CeRh2As2 is a newly discovered candidate of multiphase heavy-fermion superconductor (Tc=0.3 K) with intriguing physical properties. Here, we employ soft point-contact spectroscopy to investigate its energy gap behaviors in both the normal and superconducting states. The differential conductance below Tc reveals an estimated superconducting energy gap of 2ΔSC=0.24 meV and thus an extremely strong superconducting pairing strength 2ΔSC/kBTc=8.8, which is comparable to those of cuprates and iron-based high-Tc superconductors as well as infinite-layer nickelates. Above Tc, a well-defined pseudogap feature is manifested as a V-shaped dip in the differential conductance spanning an energy scale of 2Δg=0.95-3.0 meV. The pseudogap feature persists to the highest characteristic temperature of Tg=8-9 K and is gradually suppressed by magnetic field of Bg=9.0T regardless of its direction relative to the crystallographic axes. The observation of pseudogap features prior to the superconducting phase transition enriches the phase diagram of CeRh2As2 and provides a novel platform to study the interplay of unconventional superconductivity and pseudogap phenomena.

cond-mat.supr-con↗

arXiv2024

Enhanced Polarizability and Tunable Diamagnetic Shifts from Charged Localized Emitters in WSe2 on a Relaxor Ferroelectric

Strain modulation is a crucial way in engineering nanoscale materials. It is even more important for single photon emitters in layered materials, where strain can create quantum emitters and control their energies. Here we report the localized, charge-enhanced coupling between the charged localized emitters in monolayer tungsten diselenide (WSe2) to the piezoelectric relaxor ferroelectric substrate. In addition to the strain effect, we observe a gigantic polarizability volume with the enhancement factor up to 1010. The enormous polarizability leads to a large Quantum-confined Stark shift under a small variation of electric field, indicating the potential of integrating layered materials with functional substrates for quantum sensing. We further demonstrate the tunable diamagnetic shift and g-factor with strain varying by ~0.05%, which confirms the existence of enhanced interaction between the localized oscillating dipoles and the ferroelectric domains. Our results signify the prospect of charged quantum emitters in layered materials for quantum sciences and technology.

cond-mat.mes-hall↗

arXiv2024

Prompt-Guided Mask Proposal for Two-Stage Open-Vocabulary Segmentation

We tackle the challenge of open-vocabulary segmentation, where we need to identify objects from a wide range of categories in different environments, using text prompts as our input. To overcome this challenge, existing methods often use multi-modal models like CLIP, which combine image and text features in a shared embedding space to bridge the gap between limited and extensive vocabulary recognition, resulting in a two-stage approach: In the first stage, a mask generator takes an input image to generate mask proposals, and the in the second stage the target mask is picked based on the query. However, the expected target mask may not exist in the generated mask proposals, which leads to an unexpected output mask. In our work, we propose a novel approach named Prompt-guided Mask Proposal (PMP) where the mask generator takes the input text prompts and generates masks guided by these prompts. Compared with mask proposals generated without input prompts, masks generated by PMP are better aligned with the input prompts. To realize PMP, we designed a cross-attention mechanism between text tokens and query tokens which is capable of generating prompt-guided mask proposals after each decoding. We combined our PMP with several existing works employing a query-based segmentation backbone and the experiments on five benchmark datasets demonstrate the effectiveness of this approach, showcasing significant improvements over the current two-stage models (1% ~ 3% absolute performance gain in terms of mIOU). The steady improvement in performance across these benchmarks indicates the effective generalization of our proposed lightweight prompt-aware method.

cs.CV↗

arXiv2024

Adjusting auxiliary variables under approximate neighborhood interference

Randomized experiments are the gold standard for causal inference. However, traditional assumptions, such as the Stable Unit Treatment Value Assumption (SUTVA), often fail in real-world settings where interference between units is present. Network interference, in particular, has garnered significant attention. Structural models, like the linear-in-means model, are commonly used to describe interference; but they rely on the correct specification of the model, which can be restrictive. Recent advancements in the literature, such as the Approximate Neighborhood Interference (ANI) framework, offer more flexible approaches by assuming negligible interference from distant units. In this paper, we introduce a general framework for regression adjustment for the network experiments under the ANI assumption. This framework expands traditional regression adjustment by accounting for imbalances in network-based covariates, ensuring precision improvement, and providing shorter confidence intervals. We establish the validity of our approach using a design-based inference framework, which relies solely on randomization of treatment assignments for inference without requiring correctly specified outcome models.

stat.ME↗

arXiv2024

How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers

Pre-trained language models have been proven to possess strong base capabilities, which not only excel in in-distribution language modeling but also show powerful abilities in out-of-distribution language modeling, transfer learning and few-shot learning. Unlike existing work focusing on the influence of scale on base capabilities, our work examines the influence of architecture on those. Specifically, our concern is: How does architecture influence the base capabilities of pre-trained language models? In this work, we attempt to explain and reverse the decline in base capabilities caused by the architecture of FFN-Wider Transformers, seeking to provide some insights. Through analysis, we found the contribution ratio of Multi-Head Attention (a combination function) to pre-trained language modeling is a key factor affecting base capabilities. FFN-Wider Transformers reduce the contribution ratio of this combination function, leading to a decline in base capabilities. We confirmed this by experiments and proposed Combination Enhanced Architecture (CEA) to address the decline in base capabilities of such models. Significantly, we extended our explanation and CEA to Mixture of Experts (MoE) Transformers. We successfully achieved significant improvements in base capabilities on a 14B parameter MoE model, demonstrating the practical application value of our work. This also indicates that our analysis has a certain guiding significance for architecture analysis, architecture improvement and architecture design.

cs.CL↗

arXiv2024

New bounds of two hypergraph Ramsey problems

We focus on two hypergraph Ramsey problems. First, we consider the Erdős-Hajnal function $r_k(k+1,t;n)$. In 1972, Erdős and Hajnal conjectured that the tower growth rate of $r_k(k+1,t;n)$ is $t-1$ for each $2\le t\le k$. To finish this conjecture, it remains to show that the tower growth rate of $r_4(5,4;n)$ is three. We prove a superexponential lower bound for $r_4(5,4;n)$, which improves the previous best lower bound $r_4(5,4;n)\geq 2^{Ω(n^2)}$ from Mubayi and Suk (\emph{J. Eur. Math. Soc., 2020}). Second, we prove an upper bound for the hypergraph Erdős-Rogers function $f^{(k)}_{k+1,k+2}(N)$ that is an iterated $(k-3)$-fold logarithm in $N$ for each $k\geq 5$. This improves the previous upper bound that is an iterated $(k-13)$-fold logarithm in $N$ for $k\ge14$ due to Mubayi and Suk (\emph{J. London Math. Soc., 2018}), in which they conjectured that $f^{(k)}_{k+1,k+2}(N)$ is an iterated $(k-2)$-fold logarithm in $N$ for each $k\ge3$.

math.CO↗

arXiv2024

Sign structure of the $t$-$t^\prime$-$J$ model and its physical consequences

Understanding the doped Mott insulator is a central challenge in condensed matter physics. In this work, we first explicitly identify a new sign structure in the $t$-$t'$-$J$ model on the square lattice that replaces the conventional Fermi statistics for weakly interacting electrons. Then we show that the singular, i.e., the phase-string part of the sign structure in the partition function can be precisely turned off in a modified model. The density matrix renormalization group method is then employed to study these two models comparatively on finite-size systems, which is designed to unveil the consequences of the phase-string component. We find that the hole pairing is present not only in the quasi-long-range superconducting phase but also in the stripe phase of the $t$-$t'$-$J$ model. However, once the phase-string is switched off, both the superconducting and stripe orders together with the underlying hole pairing disappear. The corresponding ground state reduces to a trivial Fermi-liquid-like state with small hole Fermi pockets that is decoupled from the antiferromagnetic spin background. It is in sharp contrast to the original $t$-$t'$-$J$ model where large Fermi surfaces can be restored in the stripe phase found at $t'/t<0$ or the superconducting phase at $t'/t>0$ in the six-leg ladder calculation. Our study clearly demonstrates that the strong correlation effect in doped Mott insulator should be mainly attributed to the long-range quantum entanglement between the spin and charge, which is, non-perturbatively, beyond a simple spin-charge separation under the no double occupancy constraint.

cond-mat.str-el↗

arXiv2024

PEAR: Position-Embedding-Agnostic Attention Re-weighting Enhances Retrieval-Augmented Generation with Zero Inference Overhead

Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to enhance context awareness are often inefficient, incurring time or memory overhead during inference, and many are tailored to specific position embeddings. In this paper, we propose Position-Embedding-Agnostic attention Re-weighting (PEAR), which enhances the context awareness of LLMs with zero inference overhead. Specifically, on a proxy task focused on context copying, we first detect heads which suppress the models' context awareness thereby diminishing RAG performance. To weaken the impact of these heads, we re-weight their outputs with learnable coefficients. The LLM (with frozen parameters) is optimized by adjusting these coefficients to minimize loss on the proxy task. As a result, the coefficients are optimized to values less than one, thereby reducing their tendency to suppress RAG performance. During inference, the optimized coefficients are fixed to re-weight these heads, regardless of the specific task at hand. Our proposed PEAR offers two major advantages over previous approaches: (1) It introduces zero additional inference overhead in terms of memory usage or inference time, while outperforming competitive baselines in accuracy and efficiency across various RAG tasks. (2) It is independent of position embedding algorithms, ensuring broader applicability.

cs.CL↗

arXiv2024

Network Structure Governs Drosophila Brain Functionality

How intelligence emerges from living beings has been a fundamental question in neuroscience. However, it remains largely unanswered due to the complex neuronal dynamics and intricate connections between neurons in real neural systems. To address this challenge, we leveraged the largest available adult Drosophila connectome data set, and constructed a comprehensive computational framework based on simplified neuronal activation mechanisms to simulate the observed activation behavior within the connectome. The results revealed that even with rudimentary neuronal activation mechanisms, models grounded in real neural network structures can generate activation patterns strikingly similar to those observed in the actual brain. A significant discovery was the consistency of activation patterns across various neuronal dynamic models. This consistency, achieved with the same network structure, underscores the pivotal role of network topology in neural information processing. These results challenge the prevailing view that solely relies on neuron count or complex individual neuron dynamics. Further analysis demonstrated a near-complete separation of the visual and olfactory systems at the network level. Moreover, we found that the network distance, rather than spatial distance, is the primary determinant of activation patterns. Additionally, our experiments revealed that a reconnect rate of at least 0.1% was sufficient to disrupt the previously observed activation patterns. We also observed synergistic effects between the brain hemispheres: Even with unilateral input stimuli, visual-related neurons in both hemispheres were activated, highlighting the importance of interhemispheric communication. These findings emphasize the crucial role of network structure in neural activation and offer novel insights into the fundamental principles governing brain functionality.

q-bio.NC↗

arXiv2024

GSpect: Spectral Filtering for Cross-Scale Graph Classification

Identifying structures in common forms the basis for networked systems design and optimization. However, real structures represented by graphs are often of varying sizes, leading to the low accuracy of traditional graph classification methods. These graphs are called cross-scale graphs. To overcome this limitation, in this study, we propose GSpect, an advanced spectral graph filtering model for cross-scale graph classification tasks. Compared with other methods, we use graph wavelet neural networks for the convolution layer of the model, which aggregates multi-scale messages to generate graph representations. We design a spectral-pooling layer which aggregates nodes to one node to reduce the cross-scale graphs to the same size. We collect and construct the cross-scale benchmark data set, MSG (Multi Scale Graphs). Experiments reveal that, on open data sets, GSpect improves the performance of classification accuracy by 1.62% on average, and for a maximum of 3.33% on PROTEINS. On MSG, GSpect improves the performance of classification accuracy by 15.55% on average. GSpect fills the gap in cross-scale graph classification studies and has potential to provide assistance in application research like diagnosis of brain disease by predicting the brain network's label and developing new drugs with molecular structures learned from their counterparts in other systems.

cs.LG↗

arXiv2024

Estimation and inference of average treatment effects under heterogeneous additive treatment effect model

Randomized experiments are the gold standard for estimating treatment effects, yet network interference challenges the validity of traditional estimators by violating the stable unit treatment value assumption and introducing bias. While cluster randomized experiments mitigate this bias, they encounter limitations in handling network complexity and fail to distinguish between direct and indirect effects. To address these challenges, we develop a design-based asymptotic theory for the existing Horvitz--Thompson estimators of the direct, indirect, and global average treatment effects under Bernoulli trials. We assume the heterogeneous additive treatment effect model with a hidden network that drives interference. Observing that these estimators are inconsistent in dense networks, we introduce novel eigenvector-based regression adjustment estimators to ensure consistency. We establish the asymptotic normality of the proposed estimators and provide conservative variance estimators under the design-based inference framework, offering robust conclusions independent of the underlying stochastic processes of the network and model parameters. Our method's adaptability is demonstrated across various interference structures, including partial interference and local interference in a two-sided marketplace. Numerical studies further illustrate the efficacy of the proposed estimators, offering practical insights into handling network interference.

stat.ME↗

arXiv2024

PriorMapNet: Enhancing Online Vectorized HD Map Construction with Priors

Online vectorized High-Definition (HD) map construction is crucial for subsequent prediction and planning tasks in autonomous driving. Following MapTR paradigm, recent works have made noteworthy achievements. However, reference points are randomly initialized in mainstream methods, leading to unstable matching between predictions and ground truth. To address this issue, we introduce PriorMapNet to enhance online vectorized HD map construction with priors. We propose the PPS-Decoder, which provides reference points with position and structure priors. Fitted from the map elements in the dataset, prior reference points lower the learning difficulty and achieve stable matching. Furthermore, we propose the PF-Encoder to enhance the image-to-BEV transformation with BEV feature priors. Besides, we propose the DMD cross-attention, which decouples cross-attention along multi-scale and multi-sample respectively to achieve efficiency. Our proposed PriorMapNet achieves state-of-the-art performance in the online vectorized HD map construction task on nuScenes and Argoverse2 datasets. The code will be released publicly soon.

cs.CV↗

arXiv2024

Kagome materials $A$V$_3$Sb$_5$ ($A$=K,Rb,Cs): pairing symmetry and pressure-tuning studies

The vanadium-based kagome metals $A$V$_3$Sb$_5$ ($A$ = K, Rb, and Cs) host a superconducting ground state that coexists with an unconventional charge density wave (CDW). The CDW state exhibits experimental signatures of chirality, electronic nematicity, and time-reversal-symmetry-breaking, raising the questions whether the superconductivity (SC) in $A$V$_3$Sb$_5$ may also be unconventional, how SC interplays with CDW, and how the two orders evolve upon tuning. This article reviews studies of the superconducting pairing symmetry, and the tuning of SC and CDW in the $A$V$_3$Sb$_5$ compounds. Various experimental techniques consistently find that CsV$_3$Sb$_5$ exhibits nodeless SC, which remains robust regardless whether the CDW is present. Under hydrostatic pressure, SC in $A$V$_3$Sb$_5$ becomes enhanced as the CDW is gradually suppressed, revealing a competition between the two orders. In CsV$_3$Sb$_5$, a new CDW state emerges under pressure that competes more strongly with SC relative to the CDW at ambient pressure, and results in two superconducting domes that coexist with CDW. After the CDW in $A$V$_3$Sb$_5$ is fully suppressed with hydrostatic pressure, a further increase in pressure leads to a nonmonotonic evolution of the superconducting transition temperature driven by lattice modulations. Thickness is shown to be a powerful tuning parameter in $A$V$_3$Sb$_5$ thin flakes, revealing the evolution of CDW and SC upon dimensional reduction, and can be combined with hydrostatic pressure to shed light on the interplay between SC and CDW. Based on results reviewed in this article, we discuss outstanding issues to be addressed in the $A$V$_3$Sb$_5$ systems.

cond-mat.supr-con↗

arXiv2024

PCAC-GAN: A Sparse-Tensor-Based Generative Adversarial Network for 3D Point Cloud Attribute Compression

Learning-based methods have proven successful in compressing geometric information for point clouds. For attribute compression, however, they still lag behind non-learning-based methods such as the MPEG G-PCC standard. To bridge this gap, we propose a novel deep learning-based point cloud attribute compression method that uses a generative adversarial network (GAN) with sparse convolution layers. Our method also includes a module that adaptively selects the resolution of the voxels used to voxelize the input point cloud. Sparse vectors are used to represent the voxelized point cloud, and sparse convolutions process the sparse tensors, ensuring computational efficiency. To the best of our knowledge, this is the first application of GANs to compress point cloud attributes. Our experimental results show that our method outperforms existing learning-based techniques and rivals the latest G-PCC test model (TMC13v23) in terms of visual quality.

eess.IV↗

arXiv2024

Enhancing context models for point cloud geometry compression with context feature residuals and multi-loss

In point cloud geometry compression, context models usually use the one-hot encoding of node occupancy as the label, and the cross-entropy between the one-hot encoding and the probability distribution predicted by the context model as the loss function. However, this approach has two main weaknesses. First, the differences between contexts of different nodes are not significant, making it difficult for the context model to accurately predict the probability distribution of node occupancy. Second, as the one-hot encoding is not the actual probability distribution of node occupancy, the cross-entropy loss function is inaccurate. To address these problems, we propose a general structure that can enhance existing context models. We introduce the context feature residuals into the context model to amplify the differences between contexts. We also add a multi-layer perception branch, that uses the mean squared error between its output and node occupancy as a loss function to provide accurate gradients in backpropagation. We validate our method by showing that it can improve the performance of an octree-based model (OctAttention) and a voxel-based model (VoxelDNN) on the object point cloud datasets MPEG 8i and MVUB, as well as the LiDAR point cloud dataset SemanticKITTI.

eess.IV↗