arXiv subjects

Fei Wang

Publications and source records attributed to Fei Wang.

At least 307 records · Page 17Linked to original sources

arXiv2025

Salvaging Forbidden Treasure in Medical Data: Utilizing Surrogate Outcomes and Single Records for Rare Event Modeling

The vast repositories of Electronic Health Records (EHR) and medical claims hold untapped potential for studying rare but critical events, such as suicide attempt. Conventional setups often model suicide attempt as a univariate outcome and also exclude any ``single-record'' patients with a single documented encounter due to a lack of historical information. However, patients who were diagnosed with suicide attempts at the only encounter could, to some surprise, represent a substantial proportion of all attempt cases in the data, as high as 70--80%. We innovate a hybrid and integrative learning framework to leverage concurrent outcomes as surrogates and harness the forbidden yet precious information from single-record data. Our approach employs a supervised learning component to learn the latent variables that connect primary (e.g., suicide) and surrogate outcomes (e.g., mental disorders) to historical information. It simultaneously employs an unsupervised learning component to utilize the single-record data, through the shared latent variables. As such, our approach offers a general strategy for information integration that is crucial to modeling rare conditions and events. With hospital inpatient data from Connecticut, we demonstrate that single-record data and concurrent diagnoses indeed carry valuable information, and utilizing them can substantially improve suicide risk modeling.

stat.ME↗

arXiv2025

DASKT: A Dynamic Affect Simulation Method for Knowledge Tracing

Knowledge Tracing (KT) predicts future performance by modeling students' historical interactions, and understanding students' affective states can enhance the effectiveness of KT, thereby improving the quality of education. Although traditional KT values students' cognition and learning behaviors, efficient evaluation of students' affective states and their application in KT still require further exploration due to the non-affect-oriented nature of the data and budget constraints. To address this issue, we propose a computation-driven approach, Dynamic Affect Simulation Knowledge Tracing (DASKT), to explore the impact of various student affective states (such as frustration, concentration, boredom, and confusion) on their knowledge states. In this model, we first extract affective factors from students' non-affect-oriented behavioral data, then use clustering and spatiotemporal sequence modeling to accurately simulate students' dynamic affect changes when dealing with different problems. Subsequently, {\color{blue}we incorporate affect with time-series analysis to improve the model's ability to infer knowledge states over time and space.} Extensive experimental results on two public real-world educational datasets show that DASKT can achieve more reasonable knowledge states under the effect of students' affective states. Moreover, DASKT outperforms the most advanced KT methods in predicting student performance. Our research highlights a promising avenue for future KT studies, focusing on achieving high interpretability and accuracy.

cs.CY↗

arXiv2025

Snake Learning: A Communication- and Computation-Efficient Distributed Learning Framework for 6G

In the evolution towards 6G, integrating Artificial Intelligence (AI) with advanced network infrastructure emerges as a pivotal strategy for enhancing network intelligence and resource utilization. Existing distributed learning frameworks like Federated Learning and Split Learning often struggle with significant challenges in dynamic network environments including high synchronization demands, costly communication overhead, severe computing resource consumption, and data heterogeneity across network nodes. These obstacles hinder the applications of ubiquitous computing capabilities of 6G networks, especially in light of the trend of escalating model parameters and training data volumes. To address these challenges effectively, this paper introduces ``Snake Learning", a cost-effective distributed learning framework. Specifically, Snake Learning respects the heterogeneity of inter-node computing capability and local data distribution in 6G networks, and sequentially trains the designated part of model layers on individual nodes. This layer-by-layer serpentine update mechanism contributes to significantly reducing the requirements for storage, memory and communication during the model training phase, and demonstrates superior adaptability and efficiency for both classification and fine-tuning tasks across homogeneous and heterogeneous data distributions.

cs.NI↗

arXiv2024

Enhanced Polarizability and Tunable Diamagnetic Shifts from Charged Localized Emitters in WSe2 on a Relaxor Ferroelectric

Strain modulation is a crucial way in engineering nanoscale materials. It is even more important for single photon emitters in layered materials, where strain can create quantum emitters and control their energies. Here we report the localized, charge-enhanced coupling between the charged localized emitters in monolayer tungsten diselenide (WSe2) to the piezoelectric relaxor ferroelectric substrate. In addition to the strain effect, we observe a gigantic polarizability volume with the enhancement factor up to 1010. The enormous polarizability leads to a large Quantum-confined Stark shift under a small variation of electric field, indicating the potential of integrating layered materials with functional substrates for quantum sensing. We further demonstrate the tunable diamagnetic shift and g-factor with strain varying by ~0.05%, which confirms the existence of enhanced interaction between the localized oscillating dipoles and the ferroelectric domains. Our results signify the prospect of charged quantum emitters in layered materials for quantum sciences and technology.

cond-mat.mes-hall↗

arXiv2024

Overlapping Schwarz Preconditioners for Randomized Neural Networks with Domain Decomposition

Randomized neural networks (RaNNs), in which hidden layers remain fixed after random initialization, provide an efficient alternative for parameter optimization compared to fully parameterized networks. In this paper, RaNNs are integrated with overlapping Schwarz domain decomposition in two (main) ways: first, to formulate the least-squares problem with localized basis functions, and second, to construct overlapping preconditioners for the resulting linear systems. In particular, neural networks are initialized randomly in each subdomain based on a uniform distribution and linked through a partition of unity, forming a global solution that approximates the solution of the partial differential equation. Boundary conditions are enforced through a constraining operator, eliminating the need for a penalty term to handle them. Principal component analysis (PCA) is employed to reduce the number of basis functions in each subdomain, yielding a linear system with a lower condition number. By constructing additive and restricted additive Schwarz preconditioners, the least-squares problem is solved efficiently using the Conjugate Gradient (CG) and Generalized Minimal Residual (GMRES) methods, respectively. Our numerical results demonstrate that the proposed approach significantly reduces computational time for multi-scale and time-dependent problems. Additionally, a three-dimensional problem is presented to demonstrate the efficiency of using the CG method with an AS preconditioner, compared to an QR decomposition, in solving the least-squares problem.

math.NA↗

arXiv2024

Temporal-Frequency State Space Duality: An Efficient Paradigm for Speech Emotion Recognition

Speech Emotion Recognition (SER) plays a critical role in enhancing user experience within human-computer interaction. However, existing methods are overwhelmed by temporal domain analysis, overlooking the valuable envelope structures of the frequency domain that are equally important for robust emotion recognition. To overcome this limitation, we propose TF-Mamba, a novel multi-domain framework that captures emotional expressions in both temporal and frequency dimensions.Concretely, we propose a temporal-frequency mamba block to extract temporal- and frequency-aware emotional features, achieving an optimal balance between computational efficiency and model expressiveness. Besides, we design a Complex Metric-Distance Triplet (CMDT) loss to enable the model to capture representative emotional clues for SER. Extensive experiments on the IEMOCAP and MELD datasets show that TF-Mamba surpasses existing methods in terms of model size and latency, providing a more practical solution for future SER applications.

cs.SD↗

arXiv2024

Local Causal Discovery for Structural Evidence of Direct Discrimination

Identifying the causal pathways of unfairness is a critical objective for improving policy design and algorithmic decision-making. Prior work in causal fairness analysis often requires knowledge of the causal graph, hindering practical applications in complex or low-knowledge domains. Moreover, global discovery methods that learn causal structure from data can display unstable performance on finite samples, preventing robust fairness conclusions. To mitigate these challenges, we introduce local discovery for direct discrimination (LD3): a method that uncovers structural evidence of direct unfairness by identifying the causal parents of an outcome variable. LD3 performs a linear number of conditional independence tests relative to variable set size, and allows for latent confounding under the sufficient condition that all parents of the outcome are observed. We show that LD3 returns a valid adjustment set (VAS) under a new graphical criterion for the weighted controlled direct effect, a qualitative indicator of direct discrimination. LD3 limits unnecessary adjustment, providing interpretable VAS for assessing unfairness. We use LD3 to analyze causal fairness in two complex decision systems: criminal recidivism prediction and liver transplant allocation. LD3 was more time-efficient and returned more plausible results on real-world data than baselines, which took 46$\times$ to 5870$\times$ longer to execute.

stat.ML↗

arXiv2024

Is AI Robust Enough for Scientific Research?

We uncover a phenomenon largely overlooked by the scientific community utilizing AI: neural networks exhibit high susceptibility to minute perturbations, resulting in significant deviations in their outputs. Through an analysis of five diverse application areas -- weather forecasting, chemical energy and force calculations, fluid dynamics, quantum chromodynamics, and wireless communication -- we demonstrate that this vulnerability is a broad and general characteristic of AI systems. This revelation exposes a hidden risk in relying on neural networks for essential scientific computations, calling further studies on their reliability and security.

cs.LG↗

arXiv2024

MPQ-DM: Mixed Precision Quantization for Extremely Low Bit Diffusion Models

Diffusion models have received wide attention in generation tasks. However, the expensive computation cost prevents the application of diffusion models in resource-constrained scenarios. Quantization emerges as a practical solution that significantly saves storage and computation by reducing the bit-width of parameters. However, the existing quantization methods for diffusion models still cause severe degradation in performance, especially under extremely low bit-widths (2-4 bit). The primary decrease in performance comes from the significant discretization of activation values at low bit quantization. Too few activation candidates are unfriendly for outlier significant weight channel quantization, and the discretized features prevent stable learning over different time steps of the diffusion model. This paper presents MPQ-DM, a Mixed-Precision Quantization method for Diffusion Models. The proposed MPQ-DM mainly relies on two techniques:(1) To mitigate the quantization error caused by outlier severe weight channels, we propose an Outlier-Driven Mixed Quantization (OMQ) technique that uses $Kurtosis$ to quantify outlier salient channels and apply optimized intra-layer mixed-precision bit-width allocation to recover accuracy performance within target efficiency.(2) To robustly learn representations crossing time steps, we construct a Time-Smoothed Relation Distillation (TRD) scheme between the quantized diffusion model and its full-precision counterpart, transferring discrete and continuous latent to a unified relation space to reduce the representation inconsistency. Comprehensive experiments demonstrate that MPQ-DM achieves significant accuracy gains under extremely low bit-widths compared with SOTA quantization methods. MPQ-DM achieves a 58\% FID decrease under W2A4 setting compared with baseline, while all other methods even collapse.

cs.CV↗

arXiv2024

Relational Diffusion Distillation for Efficient Image Generation

Although the diffusion model has achieved remarkable performance in the field of image generation, its high inference delay hinders its wide application in edge devices with scarce computing resources. Therefore, many training-free sampling methods have been proposed to reduce the number of sampling steps required for diffusion models. However, they perform poorly under a very small number of sampling steps. Thanks to the emergence of knowledge distillation technology, the existing training scheme methods have achieved excellent results at very low step numbers. However, the current methods mainly focus on designing novel diffusion model sampling methods with knowledge distillation. How to transfer better diffusion knowledge from teacher models is a more valuable problem but rarely studied. Therefore, we propose Relational Diffusion Distillation (RDD), a novel distillation method tailored specifically for distilling diffusion models. Unlike existing methods that simply align teacher and student models at pixel level or feature distributions, our method introduces cross-sample relationship interaction during the distillation process and alleviates the memory constraints induced by multiple sample interactions. Our RDD significantly enhances the effectiveness of the progressive distillation framework within the diffusion model. Extensive experiments on several datasets (e.g., CIFAR-10 and ImageNet) demonstrate that our proposed RDD leads to 1.47 FID decrease under 1 sampling step compared to state-of-the-art diffusion distillation methods and achieving 256x speed-up compared to DDIM strategy. Code is available at https://github.com/cantbebetter2/RDD.

cs.CV↗

arXiv2024

MID: A Comprehensive Shore-Based Dataset for Multi-Scale Dense Ship Occlusion and Interaction Scenarios

This paper introduces the Maritime Ship Navigation Behavior Dataset (MID), designed to address challenges in ship detection within complex maritime environments using Oriented Bounding Boxes (OBB). MID contains 5,673 images with 135,884 finely annotated target instances, supporting both supervised and semi-supervised learning. It features diverse maritime scenarios such as ship encounters under varying weather, docking maneuvers, small target clustering, and partial occlusions, filling critical gaps in datasets like HRSID, SSDD, and NWPU-10. MID's images are sourced from high-definition video clips of real-world navigation across 43 water areas, with varied weather and lighting conditions (e.g., rain, fog). Manually curated annotations enhance the dataset's variety, ensuring its applicability to real-world demands in busy ports and dense maritime regions. This diversity equips models trained on MID to better handle complex, dynamic environments, supporting advancements in maritime situational awareness. To validate MID's utility, we evaluated 10 detection algorithms, providing an in-depth analysis of the dataset, detection results from various models, and a comparative study of baseline algorithms, with a focus on handling occlusions and dense target clusters. The results highlight MID's potential to drive innovation in intelligent maritime traffic monitoring and autonomous navigation systems. The dataset will be made publicly available at https://github.com/VirtualNew/MID_DataSet.

cs.CV↗

arXiv2024

Light-induced ultrafast glide-mirror symmetry breaking in black phosphorus

Symmetry breaking plays an important role in fields of physics, ranging from particle physics to condensed matter physics. In solid-state materials, phase transitions are deeply linked to the underlying symmetry breakings, resulting in a rich variety of emergent phases. Such symmetry breakings are often induced by controlling the chemical composition and temperature or applying an electric field and strain, etc. In this work, we demonstrate an ultrafast glide-mirror symmetry breaking in black phosphorus through Floquet engineering. Upon near-resonance pumping, a light-induced full gap opening is observed at the glide-mirror symmetry protected nodal ring, suggesting light-induced breaking of the glide-mirror symmetry. Moreover, the full gap is observed only in the presence of the light-field and disappears almost instantaneously ($\ll$100 fs) when the light-field is turned off, suggesting the ultrafast manipulation of the symmetry and its Floquet engineering origin. This work not only demonstrates light-matter interaction as an effective way to realize ultrafast symmetry breaking in solid-state materials, but also moves forward towards the long-sought Floquet topological phases.

cond-mat.mes-hall↗

arXiv2024

Manipulating the symmetry of photon-dressed electronic states

Strong light-matter interaction provides opportunities for tailoring the physical properties of quantum materials on the ultrafast timescale by forming photon-dressed electronic states, i.e., Floquet-Bloch states. While the light field can in principle imprint its symmetry properties onto the photon-dressed electronic states, so far, how to experimentally detect and further engineer the symmetry of photon-dressed electronic states remains elusive. Here by utilizing time- and angle-resolved photoemission spectroscopy (TrARPES) with polarization-dependent study, we directly visualize the parity symmetry of Floquet-Bloch states in black phosphorus. The photon-dressed sideband exhibits opposite photoemission intensity to the valence band at the $Γ$ point,suggesting a switch of the parity induced by the light field. Moreover, a "hot spot" with strong intensity confined near $Γ$ is observed, indicating a momentum-dependent modulation beyond the parity switch. Combining with theoretical calculations, we reveal the light-induced engineering of the wave function of the Floquet-Bloch states as a result of the hybridization between the conduction and valence bands with opposite parities, and show that the "hot spot" is intrinsically dictated by the symmetry properties of black phosphorus. Our work suggests TrARPES as a direct probe for the parity of the photon-dressed electronic states with energy- and momentum-resolved information, providing an example for engineering the wave function and symmetry of such photon-dressed electronic states via Floquet engineering.

cond-mat.mes-hall↗

arXiv2024

CCS: Continuous Learning for Customized Incremental Wireless Sensing Services

Wireless sensing has made significant progress in tasks ranging from action recognition, vital sign estimation, pose estimation, etc. After over a decade of work, wireless sensing currently stands at the tipping point transitioning from proof-of-concept systems to the large-scale deployment. We envision a future service scenario where wireless sensing service providers distribute sensing models to users. During usage, users might request new sensing capabilities. For example, if someone is away from home on a business trip or vacation for an extended period, they may want a new sensing capability that can detect falls in elderly parents or grandparents and promptly alert them. In this paper, we propose CCS (continuous customized service), enabling model updates on users' local computing resources without data transmission to the service providers. To address the issue of catastrophic forgetting in model updates where updating model parameters to implement new capabilities leads to the loss of existing capabilities we design knowledge distillation and weight alignment modules. These modules enable the sensing model to acquire new capabilities while retaining the existing ones. We conducted extensive experiments on the large-scale XRF55 dataset across Wi-Fi, millimeter-wave radar, and RFID modalities to simulate scenarios where four users sequentially introduced new customized demands. The results affirm that CCS excels in continuous model services across all the above wireless modalities, significantly outperforming existing approaches like OneFi.

cs.LG↗

arXiv2024

Rethink Deep Learning with Invariance in Data Representation

Integrating invariance into data representations is a principled design in intelligent systems and web applications. Representations play a fundamental role, where systems and applications are both built on meaningful representations of digital inputs (rather than the raw data). In fact, the proper design/learning of such representations relies on priors w.r.t. the task of interest. Here, the concept of symmetry from the Erlangen Program may be the most fruitful prior -- informally, a symmetry of a system is a transformation that leaves a certain property of the system invariant. Symmetry priors are ubiquitous, e.g., translation as a symmetry of the object classification, where object category is invariant under translation. The quest for invariance is as old as pattern recognition and data mining itself. Invariant design has been the cornerstone of various representations in the era before deep learning, such as the SIFT. As we enter the early era of deep learning, the invariance principle is largely ignored and replaced by a data-driven paradigm, such as the CNN. However, this neglect did not last long before they encountered bottlenecks regarding robustness, interpretability, efficiency, and so on. The invariance principle has returned in the era of rethinking deep learning, forming a new field known as Geometric Deep Learning (GDL). In this tutorial, we will give a historical perspective of the invariance in data representations. More importantly, we will identify those research dilemmas, promising works, future directions, and web applications.

cs.AI↗

arXiv2024

Variational quantum algorithm for non-Markovian quantum dynamics

The simulation of non-Markovian quantum dynamics plays an important role in the understanding of charge and exciton dynamics in the condensed phase environment, and yet it remains computationally expensive on classical computers. We have developed a variational quantum algorithm that is capable of simulating non-Markovian quantum dynamics. The algorithm captures the non-Markovian effect by employing the Ehrenfect trajectories in the path integral formulation and the Monte Carlo sampling of the thermal distribution. We tested the algorithm with the spin-boson model on the quantum simulator and the results match well with the exact ones. The algorithm naturally fits into the parallel computing platform of the NISQ devices and is well suited for anharmonic system-bath interactions and multi-state systems.

quant-ph↗

arXiv2024

Exact decomposition of non-Markovian dynamics in open quantum systems

In this work, we developed a rigorous procedure for mapping the exact non-Markovian propagator to the generalized Lindblad form. It allows us to extract the negative decay rate that is the indicator of the non-Markovian effect. As a consequence, we can investigate the influence of the non-Markovian bath on the system's properties such as coherence and equilibrium state distribution. The understanding of the non-Markovian contribution to the dynamical process points to the possibility of leveraging non-Markovianity for quantum control.

quant-ph↗

arXiv2024

Polynomial time and space quantum algorithm for the simulation of non-Markovian quantum dynamics

In this work, we developed an efficient quantum algorithm for the simulation of non-Markovian quantum dynamics, based on the Feynman path integral formulation. The algorithm scales polynomially with the number of native gates and the number of qubits, and has no classical overhead. It demonstrates the quantum advantage by overcoming the exponential cost on classical computers. In addition, the algorithm is efficient regardless of whether the temporal entanglement due to non-Markovianity is low or high, making it a unified framework for simulating non-Markovian dynamics in open quantum system.

quant-ph↗