arXiv Science⌕ Search

arXiv subjects

Di Fan

Publications and source records attributed to Di Fan.

16 recordsLinked to original sources
arXiv2026

Jointly Optimizing Debiased CTR and Uplift for Coupons Marketing: A Unified Causal Framework

In online advertising, marketing interventions such as coupons introduce significant confounding bias into Click-Through Rate (CTR) prediction. Observed clicks reflect a mixture of users' intrinsic preferences and the uplift induced by these interventions. This causes conventional models to miscalibrate base CTRs, which distorts downstream ranking and billing decisions. Furthermore, marketing interventions often operate as multi-valued treatments with varying magnitudes, introducing additional complexity to CTR prediction. To address these issues, we propose the Unified Multi-Valued Treatment Network (UniMVT). Specifically, UniMVT disentangles confounding factors from treatment-sensitive representations, enabling a full-space counterfactual inference module to jointly reconstruct the debiased base CTR and intensity-response curves. To handle the complexity of multi-valued treatments, UniMVT employs an auxiliary intensity estimation task to capture treatment propensities and devise a unit uplift objective that normalizes the intervention effect. This ensures comparable estimation across the continuous coupon-value spectrum. UniMVT simultaneously achieves debiased CTR prediction for accurate system calibration and precise uplift estimation for incentive allocation. Extensive experiments on synthetic and industrial datasets demonstrate UniMVT's superiority in both predictive accuracy and calibration. Furthermore, real-world A/B tests confirm that UniMVT significantly improves business metrics through more effective coupon distribution.

cs.SI↗
arXiv2025

Rippled Moire Superlattices for Decoupled Ferroelectric Bits

Symmetry considerations suggest that moire superlattices formed by twisted two-dimensional materials should preserve overall inversion symmetry. However, experiments consistently report robust ferroelectricity in systems such as twisted bilayer h-BN, posing a fundamental discrepancy between theory and experiment regarding its microscopic origin. Here, using large-scale finite-field molecular dynamics simulations, we challenge the prevailing defect-pinning hypothesis and instead identify an out-of-plane bending field, induced by in-plane compressive strain, as the key symmetry-breaking mechanism. This strain-induced rippling drives spatially heterogeneous interlayer sliding and distorts the moire domain wall network, resulting in a four-state ferroelectric system. Remarkably, we show this mechanism can be harnessed at the nanoscale, where localized nanobubbles designate the moire lattice's fundamental hexagonal domain clusters as the smallest individually addressable ferroelectric bits, thereby imposing local control on an otherwise globally defined structure. Our findings establish a geometry-driven framework for understanding and engineering moire ferroelectrics, offering not only a route toward ultra-high-density, rewritable memory, but also a strategy for locally tuning the moire potential itself, a critical step for manipulating emergent correlated and topological quantum phases.

physics.comp-ph↗
arXiv2025

LILI clustering algorithm: Limit Inferior Leaf Interval Integrated into Causal Forest for Causal Interference

Causal forest methods are powerful tools in causal inference. Similar to traditional random forest in machine learning, causal forest independently considers each causal tree. However, this independence consideration increases the likelihood that classification errors in one tree are repeated in others, potentially leading to significant bias in causal e ect estimation. In this paper, we propose a novel approach that establishes connections between causal trees through the Limit Inferior Leaf Interval (LILI) clustering algorithm. LILIs are constructed based on the leaves of all causal trees, emphasizing the similarity of dataset confounders. When two instances with di erent treatments are grouped into the same leaf across a su cient number of causal trees, they are treated as counterfactual outcomes of each other. Through this clustering mechanism, LILI clustering reduces bias present in traditional causal tree methods and enhances the prediction accuracy for the average treatment e ect (ATE). By integrating LILIs into a causal forest, we develop an e cient causal inference method. Moreover, we explore several key properties of LILI by relating it to the concepts of limit inferior and limit superior in the set theory. Theoretical analysis rigorously proves the convergence of the estimated ATE using LILI clustering. Empirically, extensive comparative experiments demonstrate the superior performance of LILI clustering.

stat.ML↗
arXiv2025

PDSE: A Multiple Lesion Detector for CT Images using PANet and Deformable Squeeze-and-Excitation Block

Detecting lesions in Computed Tomography (CT) scans is a challenging task in medical image processing due to the diverse types, sizes, and locations of lesions. Recently, various one-stage and two-stage framework networks have been developed to focus on lesion localization. We introduce a one-stage lesion detection framework, PDSE, by redesigning Retinanet to achieve higher accuracy and efficiency for detecting lesions in multimodal CT images. Specifically, we enhance the path aggregation flow by incorporating a low-level feature map. Additionally, to improve model representation, we utilize the adaptive Squeeze-and-Excitation (SE) block and integrate channel feature map attention. This approach has resulted in achieving new state-of-the-art performance. Our method significantly improves the detection of small and multiscaled objects. When evaluated against other advanced algorithms on the public DeepLesion benchmark, our algorithm achieved an mAP of over 0.20.

cs.CV↗
arXiv2025

Input-to-state stability-based chemical reaction networks composition for molecular computations

Molecular computation based on chemical reaction networks (CRNs) has emerged as a promising paradigm for designing programmable biochemical systems. However, the implementation of complex computations still requires excessively large and intricate network structures, largely due to the limited understanding of composability, that is, how multiple subsystems can be coupled while preserving computational functionality. Existing composability frameworks primarily focus on rate-independent CRNs, whose computational capabilities are severely restricted. This article aims to establish a systematic framework for composable CRNs governed by mass-action kinetics, a common type of rate-dependent CRNs. Drawing upon the concepts of composable rate-independent CRNs, we introduce the notions of mass-action chemical reaction computers (msCRCs), dynamic computation and dynamic composability to establish a rigorous mathematical framework for composing two or more msCRCs to achieve layer-by-layer computation of composite functions. Further, we derive several sufficient conditions based on the notions of input-to-state stability (ISS) to characterize msCRCs that can be composed to implement desired molecular computations, thereby providing theoretical support for this framework. Some examples are presented to illustrate the efficiency of our method. Finally, comparative results demonstrate that the proposed method exhibits notable advantages in both computational ability and accuracy over the state-of-the-art methods.

q-bio.MN↗
arXiv2025

Unexpected Density Functional Dependence of the Antipolar $Pbcn$ Phase in HfO$_2$

The antipolar $Pbcn$ phase of HfO$_2$ has been suggested to play an important role in the phase transition and polarization switching mechanisms in ferroelectric hafnia. In this study, we perform a comprehensive benchmark of density functional theory (DFT) calculations and deep potential molecular dynamics (DPMD) simulations to investigate the thermodynamic stability and phase transition behavior of hafnia, with a particular focus on the relationship between the $Pbcn$ and ferroelectric $Pca2_1$ phases. Our results reveal significant discrepancies in the predicted stability of the $Pbcn$ phase relative to the $Pca2_1$ phase across different exchange-correlation functionals. Notably, the PBE and hybrid HSE06 functionals exhibit consistent trends, which diverge from the predictions of the PBEsol and SCAN functionals. For a given density functional, temperature-driven phase transitions predicted by DFT-based quasi-harmonic free energy calculations aligns with finite-temperature MD simulations using a deep potential trained on the same density functional. Specifically, the PBE functional predicts a transition from $Pca2_1$ to $Pbcn$ with increasing temperature, while PBEsol predicts a transition from $Pca2_1$ to $P4_2/nmc$. A particularly striking and reassuring finding is that under fixed mechanical boundary conditions defined by the ground-state structure of $Pca2_1$, all functionals predict consistent relative phase stabilities and comparable switching barriers as well as domain wall energies. These findings underscore the unique characteristics of the $Pbcn$ phase in influencing phase transitions and switching mechanisms in ferroelectric hafnia.

cond-mat.mtrl-sci↗
arXiv2024

Disentangled Graph Autoencoder for Treatment Effect Estimation

Treatment effect estimation from observational data has attracted significant attention across various research fields. However, many widely used methods rely on the unconfoundedness assumption, which is often unrealistic due to the inability to observe all confounders, thereby overlooking the influence of latent confounders. To address this limitation, recent approaches have utilized auxiliary network information to infer latent confounders, relaxing this assumption. However, these methods often treat observed variables and networks as proxies only for latent confounders, which can result in inaccuracies when certain variables influence treatment without affecting outcomes, or vice versa. This conflation of distinct latent factors undermines the precision of treatment effect estimation. To overcome this challenge, we propose a novel disentangled variational graph autoencoder for treatment effect estimation on networked observational data. Our graph encoder disentangles latent factors into instrumental, confounding, adjustment, and noisy factors, while enforcing factor independence using the Hilbert-Schmidt Independence Criterion. Extensive experiments on multiple networked datasets demonstrate that our method outperforms state-of-the-art approaches.

cs.LG↗
arXiv2024

Explainable AI Integrated Feature Engineering for Wildfire Prediction

Wildfires present intricate challenges for prediction, necessitating the use of sophisticated machine learning techniques for effective modeling\cite{jain2020review}. In our research, we conducted a thorough assessment of various machine learning algorithms for both classification and regression tasks relevant to predicting wildfires. We found that for classifying different types or stages of wildfires, the XGBoost model outperformed others in terms of accuracy and robustness. Meanwhile, the Random Forest regression model showed superior results in predicting the extent of wildfire-affected areas, excelling in both prediction error and explained variance. Additionally, we developed a hybrid neural network model that integrates numerical data and image information for simultaneous classification and regression. To gain deeper insights into the decision-making processes of these models and identify key contributing features, we utilized eXplainable Artificial Intelligence (XAI) techniques, including TreeSHAP, LIME, Partial Dependence Plots (PDP), and Gradient-weighted Class Activation Mapping (Grad-CAM). These interpretability tools shed light on the significance and interplay of various features, highlighting the complex factors influencing wildfire predictions. Our study not only demonstrates the effectiveness of specific machine learning models in wildfire-related tasks but also underscores the critical role of model transparency and interpretability in environmental science applications.

cs.LG↗
arXiv2024

Learning Network Representations with Disentangled Graph Auto-Encoder

The (variational) graph auto-encoder is widely used to learn representations for graph-structured data. However, the formation of real-world graphs is a complicated and heterogeneous process influenced by latent factors. Existing encoders are fundamentally holistic, neglecting the entanglement of latent factors. This reduces the effectiveness of graph analysis tasks, while also making it more difficult to explain the learned representations. As a result, learning disentangled graph representations with the (variational) graph auto-encoder poses significant challenges and remains largely unexplored in the current research. In this paper, we introduce the Disentangled Graph Auto-Encoder (DGA) and the Disentangled Variational Graph Auto-Encoder (DVGA) to learn disentangled representations. Specifically, we first design a disentangled graph convolutional network with multi-channel message-passing layers to serve as the encoder. This allows each channel to aggregate information about each latent factor. The disentangled variational graph auto-encoder's expressive capability is then enhanced by applying a component-wise flow to each channel. In addition, we construct a factor-wise decoder that takes into account the characteristics of disentangled representations. We improve the independence of representations by imposing independence constraints on the mapping channels for distinct latent factors. Empirical experiments on both synthetic and real-world datasets demonstrate the superiority of our proposed method compared to several state-of-the-art baselines.

cs.LG↗
arXiv2023

Human Emotion Recognition Based On Galvanic Skin Response signal Feature Selection and SVM

A novel human emotion recognition method based on automatically selected Galvanic Skin Response (GSR) signal features and SVM is proposed in this paper. GSR signals were acquired by e-Health Sensor Platform V2.0. Then, the data is de-noised by wavelet function and normalized to get rid of the individual difference. 30 features are extracted from the normalized data, however, directly using of these features will lead to a low recognition rate. In order to gain the optimized features, a covariance based feature selection is employed in our method. Finally, a SVM with input of the optimized features is utilized to achieve the human emotion recognition. The experimental results indicate that the proposed method leads to good human emotion recognition, and the recognition accuracy is more than 66.67%.

eess.SP↗
arXiv2023

Causal Flow-based Variational Auto-Encoder for Disentangled Causal Representation Learning

Disentangled representation learning aims to learn low-dimensional representations where each dimension corresponds to an underlying generative factor. While the Variational Auto-Encoder (VAE) is widely used for this purpose, most existing methods assume independence among factors, a simplification that does not hold in many real-world scenarios where factors are often interdependent and exhibit causal relationships. To overcome this limitation, we propose the Disentangled Causal Variational Auto-Encoder (DCVAE), a novel supervised VAE framework that integrates causal flows into the representation learning process, enabling the learning of more meaningful and interpretable disentangled representations. We evaluate DCVAE on both synthetic and real-world datasets, demonstrating its superior ability in causal disentanglement and intervention experiments. Furthermore, DCVAE outperforms state-of-the-art methods in various downstream tasks, highlighting its potential for learning true causal structures among factors.

cs.LG↗
arXiv2023

Domain Knowledge integrated for Blast Furnace Classifier Design

Blast furnace modeling and control is one of the important problems in the industrial field, and the black-box model is an effective mean to describe the complex blast furnace system. In practice, there are often different learning targets, such as safety and energy saving in industrial applications, depending on the application. For this reason, this paper proposes a framework to design a domain knowledge integrated classification model that yields a classifier for industrial application. Our knowledge incorporated learning scheme allows the users to create a classifier that identifies "important samples" (whose misclassifications can lead to severe consequences) more correctly, while keeping the proper precision of classifying the remaining samples. The effectiveness of the proposed method has been verified by two real blast furnace datasets, which guides the operators to utilize their prior experience for controlling the blast furnace systems better.

cs.LG↗
arXiv2022

GPU-Net: Lightweight U-Net with more diverse features

Image segmentation is an important task in the medical image field and many convolutional neural networks (CNNs) based methods have been proposed, among which U-Net and its variants show promising performance. In this paper, we propose GP-module and GPU-Net based on U-Net, which can learn more diverse features by introducing Ghost module and atrous spatial pyramid pooling (ASPP). Our method achieves better performance with more than 4 times fewer parameters and 2 times fewer FLOPs, which provides a new potential direction for future research. Our plug-and-play module can also be applied to existing segmentation methods to further improve their performance.

eess.IV↗
arXiv2021

On the Fairness of Swarm Learning in Skin Lesion Classification

in healthcare. However, the existing AI model may be biased in its decision marking. The bias induced by data itself, such as collecting data in subgroups only, can be mitigated by including more diversified data. Distributed and collaborative learning is an approach to involve training models in massive, heterogeneous, and distributed data sources, also known as nodes. In this work, we target on examining the fairness issue in Swarm Learning (SL), a recent edge-computing based decentralized machine learning approach, which is designed for heterogeneous illnesses detection in precision medicine. SL has achieved high performance in clinical applications, but no attempt has been made to evaluate if SL can improve fairness. To address the problem, we present an empirical study by comparing the fairness among single (node) training, SL, centralized training. Specifically, we evaluate on large public available skin lesion dataset, which contains samples from various subgroups. The experiments demonstrate that SL does not exacerbate the fairness problem compared to centralized training and improves both performance and fairness compared to single training. However, there still exists biases in SL model and the implementation of SL is more complex than the alternative two strategies.

cs.DC↗
arXiv2018

Inverse Spin Hall Effect Induced by Asymmetric Illumination of Light on Topological Insulator Bi$_2$Se$_3$

Using circularly polarized light is an alternative to electronic ways for spin injection into materials. Spins are injected at a point of the light illumination, and then diffuse and spread radially due to the in-plane gradient of the spin density. This diffusion is converted into a circular charge current by the inverse spin Hall effect (ISHE). With shining the circularly polarized light at asymmetric parts of the sample, such as near edges, we detected this current as a helicity-dependent component in the photocurrent. We present a model for this ISHE based on the experimental results and the finite-element-method (FEM) simulation of the potential distribution induced by spin injection. Our model shows that the ISHE photocurrent generates an electric dipole at the edge of the sample, causing the measured charge current. The asymmetric light-illumination shown here is a simple way to inject and manipulate spins, opening up a door for novel spintronic devices.

cond-mat.mes-hall↗