arXiv subjects

Fan Zhang

Publications and source records attributed to Fan Zhang.

At least 595 records · Page 33Linked to original sources

arXiv2023

Age Prediction Performance Varies Across Deep, Superficial, and Cerebellar White Matter Connections

The brain's white matter (WM) undergoes developmental and degenerative processes during the human lifespan. To investigate the relationship between WM anatomical regions and age, we study diffusion magnetic resonance imaging tractography that is finely parcellated into fiber clusters in the deep, superficial, and cerebellar WM. We propose a deep-learning-based age prediction model that leverages large convolutional kernels and inverted bottlenecks. We improve performance using novel discrete multi-faceted mix data augmentation and a novel prior-knowledge-based loss function that encourages age predictions in the expected range. We study a dataset of 965 healthy young adults (22-37 years) derived from the Human Connectome Project (HCP). Experimental results demonstrate that the proposed model achieves a mean absolute error of 2.59 years and outperforms compared methods. We find that the deep WM is the most informative for age prediction in this cohort, while the superficial WM is the least informative. Overall, the most predictive WM tracts are the thalamo-frontal tract from the deep WM and the intracerebellar input and Purkinje tract from the cerebellar WM.

q-bio.NC↗

arXiv2023

OpenClinicalAI: An Open and Dynamic Model for Alzheimer's Disease Diagnosis

Although Alzheimer's disease (AD) cannot be reversed or cured, timely diagnosis can significantly reduce the burden of treatment and care. Current research on AD diagnosis models usually regards the diagnosis task as a typical classification task with two primary assumptions: 1) All target categories are known a priori; 2) The diagnostic strategy for each patient is consistent, that is, the number and type of model input data for each patient are the same. However, real-world clinical settings are open, with complexity and uncertainty in terms of both subjects and the resources of the medical institutions. This means that diagnostic models may encounter unseen disease categories and need to dynamically develop diagnostic strategies based on the subject's specific circumstances and available medical resources. Thus, the AD diagnosis task is tangled and coupled with the diagnosis strategy formulation. To promote the application of diagnostic systems in real-world clinical settings, we propose OpenClinicalAI for direct AD diagnosis in complex and uncertain clinical settings. This is the first powerful end-to-end model to dynamically formulate diagnostic strategies and provide diagnostic results based on the subject's conditions and available medical resources. OpenClinicalAI combines reciprocally coupled deep multiaction reinforcement learning (DMARL) for diagnostic strategy formulation and multicenter meta-learning (MCML) for open-set recognition. The experimental results show that OpenClinicalAI achieves better performance and fewer clinical examinations than the state-of-the-art model. Our method provides an opportunity to embed the AD diagnostic system into the current health care system to cooperate with clinicians to improve current health care.

cs.LG↗

arXiv2023

Identification of Causal Relationship between Amyloid-beta Accumulation and Alzheimer's Disease Progression via Counterfactual Inference

Alzheimer's disease (AD) is a neurodegenerative disorder that is beginning with amyloidosis, followed by neuronal loss and deterioration in structure, function, and cognition. The accumulation of amyloid-beta in the brain, measured through 18F-florbetapir (AV45) positron emission tomography (PET) imaging, has been widely used for early diagnosis of AD. However, the relationship between amyloid-beta accumulation and AD pathophysiology remains unclear, and causal inference approaches are needed to uncover how amyloid-beta levels can impact AD development. In this paper, we propose a graph varying coefficient neural network (GVCNet) for estimating the individual treatment effect with continuous treatment levels using a graph convolutional neural network. We highlight the potential of causal inference approaches, including GVCNet, for measuring the regional causal connections between amyloid-beta accumulation and AD pathophysiology, which may serve as a robust tool for early diagnosis and tailored care.

cs.LG↗

arXiv2023

SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills

Traditional multitask learning methods basically can only exploit common knowledge in task- or language-wise, which lose either cross-language or cross-task knowledge. This paper proposes a general multilingual multitask model, named SkillNet-X, which enables a single model to tackle many different tasks from different languages. To this end, we define several language-specific skills and task-specific skills, each of which corresponds to a skill module. SkillNet-X sparsely activates parts of the skill modules which are relevant either to the target task or the target language. Acting as knowledge transit hubs, skill modules are capable of absorbing task-related knowledge and language-related knowledge consecutively. Based on Transformer, we modify the multi-head attention layer and the feed forward network layer to accommodate skill modules. We evaluate SkillNet-X on eleven natural language understanding datasets in four languages. Results show that SkillNet-X performs better than task-specific baselines and two multitask learning baselines (i.e., dense joint model and Mixture-of-Experts model). Furthermore, skill pre-training further improves the performance of SkillNet-X on almost all datasets. To investigate the generalization of our model, we conduct experiments on two new tasks and find that SkillNet-X significantly outperforms baselines.

cs.CL↗

arXiv2023

Ferroelectric and anomalous quantum Hall states in bare rhombohedral trilayer graphene

Nontrivial interacting phases can emerge in elementary materials. As a prime example, continuing advances in device quality have facilitated the observation of a variety of spontaneous quantum Hall-like states, a cascade of Stoner-like magnets, and an unconventional superconductor in bilayer graphene. Its natural extension, rhombohedral trilayer graphene is predicted to be even more susceptible to interactions given its even flatter low-energy bands and larger winding number. Theoretically, five spontaneous quantum Hall phases have been proposed to be candidate ground states. Here, we provide transport evidence for observing four of the five competing ordered states in interaction-maximized, dually-gated, rhombohedral trilayer graphene. In particular, at vanishing but finite magnetic fields, two states with Chern numbers 3 and 6 can be stabilized at elevated and low electric fields, respectively, and both exhibit clear magnetic hysteresis. We also reveal that the quantum Hall ferromagnets of the zeroth Landau level are ferroelectrics with spontaneous layer polarizations even at zero electric field, as evidenced by electric hysteresis. Our findings exemplify the possible birth of rich interacting electron physics in a simple elementary material.

cond-mat.mes-hall↗

arXiv2023

FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoation

Video frame interpolation (VFI) serves as a useful tool for many video processing applications. Recently, it has also been applied in the video compression domain for enhancing both conventional video codecs and learning-based compression architectures. While there has been an increased focus on the development of enhanced frame interpolation algorithms in recent years, the perceptual quality assessment of interpolated content remains an open field of research. In this paper, we present a bespoke full reference video quality metric for VFI, FloLPIPS, that builds on the popular perceptual image quality metric, LPIPS, which captures the perceptual degradation in extracted image feature space. In order to enhance the performance of LPIPS for evaluating interpolated content, we re-designed its spatial feature aggregation step by using the temporal distortion (through comparing optical flows) to weight the feature difference maps. Evaluated on the BVI-VFI database, which contains 180 test sequences with various frame interpolation artefacts, FloLPIPS shows superior correlation performance (with statistical significance) with subjective ground truth over 12 popular quality assessors. To facilitate further research in VFI quality assessment, our code is publicly available at https://danier97.github.io/FloLPIPS.

eess.IV↗

arXiv2023

A Subjective Quality Study for Video Frame Interpolation

Video frame interpolation (VFI) is one of the fundamental research areas in video processing and there has been extensive research on novel and enhanced interpolation algorithms. The same is not true for quality assessment of the interpolated content. In this paper, we describe a subjective quality study for VFI based on a newly developed video database, BVI-VFI. BVI-VFI contains 36 reference sequences at three different frame rates and 180 distorted videos generated using five conventional and learning based VFI algorithms. Subjective opinion scores have been collected from 60 human participants, and then employed to evaluate eight popular quality metrics, including PSNR, SSIM and LPIPS which are all commonly used for assessing VFI methods. The results indicate that none of these metrics provide acceptable correlation with the perceived quality on interpolated content, with the best-performing metric, LPIPS, offering a SROCC value below 0.6. Our findings show that there is an urgent need to develop a bespoke perceptual quality metric for VFI. The BVI-VFI dataset is publicly available and can be accessed at https://danier97.github.io/BVI-VFI/.

eess.IV↗

arXiv2023

Enhancing Deformable Convolution based Video Frame Interpolation with Coarse-to-fine 3D CNN

This paper presents a new deformable convolution-based video frame interpolation (VFI) method, using a coarse to fine 3D CNN to enhance the multi-flow prediction. This model first extracts spatio-temporal features at multiple scales using a 3D CNN, and estimates multi-flows using these features in a coarse-to-fine manner. The estimated multi-flows are then used to warp the original input frames as well as context maps, and the warped results are fused by a synthesis network to produce the final output. This VFI approach has been fully evaluated against 12 state-of-the-art VFI methods on three commonly used test databases. The results evidently show the effectiveness of the proposed method, which offers superior interpolation performance over other state of the art algorithms, with PSNR gains up to 0.19dB.

cs.CV↗

arXiv2023

Urban Visual Intelligence: Studying Cities with AI and Street-level Imagery

The visual dimension of cities has been a fundamental subject in urban studies, since the pioneering work of scholars such as Sitte, Lynch, Arnheim, and Jacobs. Several decades later, big data and artificial intelligence (AI) are revolutionizing how people move, sense, and interact with cities. This paper reviews the literature on the appearance and function of cities to illustrate how visual information has been used to understand them. A conceptual framework, Urban Visual Intelligence, is introduced to systematically elaborate on how new image data sources and AI techniques are reshaping the way researchers perceive and measure cities, enabling the study of the physical environment and its interactions with socioeconomic environments at various scales. The paper argues that these new approaches enable researchers to revisit the classic urban theories and themes, and potentially help cities create environments that are more in line with human behaviors and aspirations in the digital age.

cs.CV↗

arXiv2023

Reconstructing the somatotopic organization of the corticospinal tract remains a challenge for modern tractography methods

The corticospinal tract (CST) is a critically important white matter fiber tract in the human brain that enables control of voluntary movements of the body. Diffusion MRI tractography is the only method that enables the study of the anatomy and variability of the CST pathway in human health. In this work, we explored the performance of six widely used tractography methods for reconstructing the CST and its somatotopic organization. We perform experiments using diffusion MRI data from the Human Connectome Project. Four quantitative measurements including reconstruction rate, the WM-GM interface coverage, anatomical distribution of streamlines, and correlation with cortical volumes to assess the advantages and limitations of each method. Overall, we conclude that while current tractography methods have made progress toward the well-known challenge of improving the reconstruction of the lateral projections of the CST, the overall problem of performing a comprehensive CST reconstruction, including clinically important projections in the lateral (hand and face area) and medial portions (leg area), remains an important challenge for diffusion MRI tractography.

cs.CV↗

arXiv2023

The role of plasma beta in global coronal models: Bringing balance back to the force

COCONUT is a global coronal magnetohydrodynamic model recently developed. In order to achieve robustness and fast convergence to steady-state, several assumptions have been made during its development, such as prescribing filtered photospheric magnetic maps for representing the magnetic field in the lower corona. This filtering leads to smoothing and lower magnetic field values at the inner boundary, resulting in an unrealistically high plasma beta.In this paper, we examine the effects of prescribing such filtered magnetograms and formulate a method for achieving more realistic plasma beta values without losing computational performance. We demonstrate the effects of the highly pre-processed magnetic maps and the resulting high plasma beta on the features in the domain. Then, in our new approach, we shift the inner boundary to 2 Rs and preserve the prescribed highly filtered magnetic map. This effectively reduces the prescribed plasma beta and leads to a more realistic setup. The method is applied on a magnetic dipole, a minimum (2008) and a maximum (2012) solar activity case, to demonstrate its effects. The results obtained with the proposed approach show significant improvements in the resolved density and radial velocity profiles, and far more realistic values of the plasma \{beta} at the boundary and inside the computational domain. This is also demonstrated via synthetic white light imaging and with the validation against tomography. The computational performance comparison shows similar convergence to a limit residual on the same grid when compared to the original setup. Considering that the grid can be further coarsened with this new setup, the operational performance can be additionally increased if needed. The newly developed method is thus deemed as a good potential replacement of the original setup for operational purposes.

astro-ph.SR↗

arXiv2023

Fed-CBS: A Heterogeneity-Aware Client Sampling Mechanism for Federated Learning via Class-Imbalance Reduction

Due to limited communication capacities of edge devices, most existing federated learning (FL) methods randomly select only a subset of devices to participate in training for each communication round. Compared with engaging all the available clients, the random-selection mechanism can lead to significant performance degradation on non-IID (independent and identically distributed) data. In this paper, we show our key observation that the essential reason resulting in such performance degradation is the class-imbalance of the grouped data from randomly selected clients. Based on our key observation, we design an efficient heterogeneity-aware client sampling mechanism, i.e., Federated Class-balanced Sampling (Fed-CBS), which can effectively reduce class-imbalance of the group dataset from the intentionally selected clients. In particular, we propose a measure of class-imbalance and then employ homomorphic encryption to derive this measure in a privacy-preserving way. Based on this measure, we also design a computation-efficient client sampling strategy, such that the actively selected clients will generate a more class-balanced grouped dataset with theoretical guarantees. Extensive experimental results demonstrate Fed-CBS outperforms the status quo approaches. Furthermore, it achieves comparable or even better performance than the ideal setting where all the available clients participate in the FL training.

cs.LG↗

arXiv2023

Ground calibration of Gamma-Ray Detectors of GECAM-C

As a new member of GECAM mission, GECAM-C (also named High Energy Burst Searcher, HEBS) was launched onboard the SATech-01 satellite on July 27th, 2022, which is capable to monitor gamma-ray transients from $\sim$ 6 keV to 6 MeV. As the main detector, there are 12 gamma-ray detectors (GRDs) equipped for GECAM-C. In order to verify the GECAM-C GRD detector performance and to validate the Monte Carlo simulations of detector response, comprehensive on-ground calibration experiments have been performed using X-ray beam and radioactive sources, including Energy-Channel relation, energy resolution, detection efficiency, SiPM voltage-gain relation and the non-uniformity of positional response. In this paper, the detailed calibration campaigns and data analysis results for GECAM-C GRDs are presented, demonstrating the excellent performance of GECAM-C GRD detectors.

astro-ph.IM↗

arXiv2023

Co-GRU Enhanced End-to-End Design for Long-haul Coherent Transmission Systems

In recent years, the end-to-end (E2E) scheme based on deep learning (DL) has been proposed as a potential scheme to jointly optimize the encoder and the decoder parameters of the optical communication system. Compared with conventional deep neural network (DNN) adopted in E2E design, center-oriented Gated Recurrent Unit (Co-GRU) network has the ability to learn and compensate for inter-symbol interference (ISI) with low computation cost while satisfying the gradient backpropagation (BP) condition. In this paper, the Co-GRU structure is adopted for both channel modeling and decoder implementation in E2E design for long-haul coherent wavelength division multiplexing (WDM) transmission systems, which can enhance the performance of general mutual information (GMI) and Q2-factor. For the E2E system with Co-GRU based decoder, the gain of GMI and Q2-factor are respectively improved 0.2 bits/sym and 0.48dB, compared to that of the conventional QAM system, for a 5-channel dual-polarization coherent system transmitting over 960km standard single mode fiber (SSMF). This work paves the way for further study of the application of the Co-GRU structure for both the data-driven channel modeling and the decoder performance improvement in E2E design.

eess.SP↗

arXiv2023

MISO: Legacy-compatible Privacy-preserving Single Sign-on using Trusted Execution Environments

Single sign-on (SSO) allows users to authenticate to third-party applications through a central identity provider. Despite their wide adoption, deployed SSO systems suffer from privacy problems such as user tracking by the identity provider. While numerous solutions have been proposed by academic papers, none were adopted because they require modifying identity providers, a significant adoption barrier in practice. Solutions do get deployed, however, fail to eliminate major privacy issues. Leveraging Trusted Execution Environments (TEEs), we propose MISO, the first privacy-preserving SSO system that is completely compatible with existing identity providers (such as Google and Facebook). This means MISO can be easily integrated into existing SSO ecosystem today and benefit end users. MISO also enables new functionality that standard SSO cannot offer: MISO allows users to leverage multiple identity providers in a single SSO workflow, potentially in a threshold fashion, to better protect user accounts. We fully implemented MISO based on Intel SGX. Our evaluation shows that MISO can handle high user concurrency with practical performance.

cs.CR↗

arXiv2023

FGAM:Fast Adversarial Malware Generation Method Based on Gradient Sign

Malware detection models based on deep learning have been widely used, but recent research shows that deep learning models are vulnerable to adversarial attacks. Adversarial attacks are to deceive the deep learning model by generating adversarial samples. When adversarial attacks are performed on the malware detection model, the attacker will generate adversarial malware with the same malicious functions as the malware, and make the detection model classify it as benign software. Studying adversarial malware generation can help model designers improve the robustness of malware detection models. At present, in the work on adversarial malware generation for byte-to-image malware detection models, there are mainly problems such as large amount of injection perturbation and low generation efficiency. Therefore, this paper proposes FGAM (Fast Generate Adversarial Malware), a method for fast generating adversarial malware, which iterates perturbed bytes according to the gradient sign to enhance adversarial capability of the perturbed bytes until the adversarial malware is successfully generated. It is experimentally verified that the success rate of the adversarial malware deception model generated by FGAM is increased by about 84\% compared with existing methods.

cs.CR↗

arXiv2023

Fiber Tract Shape Measures Inform Prediction of Non-Imaging Phenotypes

Neuroimaging measures of the brain's white matter connections can enable the prediction of non-imaging phenotypes, such as demographic and cognitive measures. Existing works have investigated traditional microstructure and connectivity measures from diffusion MRI tractography, without considering the shape of the connections reconstructed by tractography. In this paper, we investigate the potential of fiber tract shape features for predicting non-imaging phenotypes, both individually and in combination with traditional features. We focus on three basic shape features: length, diameter, and elongation. Two different prediction methods are used, including a traditional regression method and a deep-learning-based prediction method. Experiments use an efficient two-stage fusion strategy for prediction using microstructure, connectivity, and shape measures. To reduce predictive bias due to brain size, normalized shape features are also investigated. Experimental results on the Human Connectome Project (HCP) young adult dataset (n=1065) demonstrate that individual shape features are predictive of non-imaging phenotypes. When combined with microstructure and connectivity features, shape features significantly improve performance for predicting the cognitive score TPVT (NIH Toolbox picture vocabulary test). Overall, this study demonstrates that the shape of fiber tracts contains useful information for the description and study of the living human brain using machine learning.

cs.CV↗

arXiv2023

Doppler-Resilient Design of CAZAC Sequences for mmWave/THz Sensing Applications

Ultra-high-resolution target sensing has emerged as a key enabler for various cutting-edge applications, which can be realized by utilizing the millimeter wave/terahertz frequencies. However, the extremely high operating frequency inevitably leads to significant Doppler shift effects, especially for high-mobility applications, causing the degradation of sensing performance with high false alarm rate. To this end, this paper proposes a parameter design methodology of the well-known constant amplitude zero auto correlation (CAZAC) sequences, which aims at enhancing their resilience to Doppler shifts. Specifically, we suppress the sidelobes incurred by Doppler shifts for the peak-to-sidelobe ratio (PSLR) improvement within the range of interest (RoI) of the radar range profile. The Zadoff-Chu (ZC) sequence, as a representative member in the CAZAC family, is firstly considered. The impacts of its root index on range sidelobes are investigated based on number theory. For an arbitrary-length ZC sequence, a feasible range of the root index is derived to satisfy the requirement of PSLR within the scope of RoI. Furthermore, these design guidelines are extended to a general form of CAZAC sequences, where a low-complexity heuristic algorithm is developed for PSLR improvement. Simulation results demonstrate that under severe Doppler shifts, our proposed methodology could enhance the sensing performance by lowering the false alarm rate while maintaining the same detection rate, compared with its classical counterpart.

eess.SP↗