arXiv subjects

Fan Zhang

Publications and source records attributed to Fan Zhang.

At least 757 records · Page 42Linked to original sources

arXiv2021

Individually Fair Gradient Boosting

We consider the task of enforcing individual fairness in gradient boosting. Gradient boosting is a popular method for machine learning from tabular data, which arise often in applications where algorithmic fairness is a concern. At a high level, our approach is a functional gradient descent on a (distributionally) robust loss function that encodes our intuition of algorithmic fairness for the ML task at hand. Unlike prior approaches to individual fairness that only work with smooth ML models, our approach also works with non-smooth models such as decision trees. We show that our algorithm converges globally and generalizes. We also demonstrate the efficacy of our algorithm on three ML problems susceptible to algorithmic bias.

cs.LG↗

arXiv2021

A Subjective Study on Videos at Various Bit Depths

Bit depth adaptation, where the bit depth of a video sequence is reduced before transmission and up-sampled during display, can potentially reduce data rates with limited impact on perceptual quality. In this context, we conducted a subjective study on a UHD video database, BVI-BD, to explore the relationship between bit depth and visual quality. In this work, three bit depth adaptation methods are investigated, including linear scaling, error diffusion, and a novel adaptive Gaussian filtering approach. The results from a subjective experiment indicate that above a critical bit depth, bit depth adaptation has no significant impact on perceptual quality, while reducing the amount information that is required to be transmitted. Below the critical bit depth, advanced adaptation methods can be used to retain `good' visual quality (on average) down to around 2 bits per color channel for the outlined experimental setup - a large reduction compared to the typically used 8 bits per color channel. A selection of image quality metrics were subsequently bench-marked on the subjective data, and analysis indicates that a bespoke quality metric is required for bit depth adaptation.

eess.IV↗

arXiv2021

VMAF-based Bitrate Ladder Estimation for Adaptive Streaming

In HTTP Adaptive Streaming, video content is conventionally encoded by adapting its spatial resolution and quantization level to best match the prevailing network state and display characteristics. It is well known that the traditional solution, of using a fixed bitrate ladder, does not result in the highest quality of experience for the user. Hence, in this paper, we consider a content-driven approach for estimating the bitrate ladder, based on spatio-temporal features extracted from the uncompressed content. The method implements a content-driven interpolation. It uses the extracted features to train a machine learning model to infer the curvature points of the Rate-VMAF curves in order to guide a set of initial encodings. We employ the VMAF quality metric as a means of perceptually conditioning the estimation. When compared to exhaustive encoding that produces the reference ladder, the estimated ladder is composed by 74.3% of identical Rate-VMAF points with the reference ladder. The proposed method offers a significant reduction of the number of encodes required, 77.4%, at a small average Bjøntegaard Delta Rate cost, 1.12%.

eess.IV↗

arXiv2021

AIBench Training: Balanced Industry-Standard AI Training Benchmarking

Earlier-stage evaluations of a new AI architecture/system need affordable benchmarks. Only using a few AI component benchmarks like MLPerfalone in the other stages may lead to misleading conclusions. Moreover, the learning dynamics are not well understood, and the benchmarks' shelf-life is short. This paper proposes a balanced benchmarking methodology. We use real-world benchmarks to cover the factors space that impacts the learning dynamics to the most considerable extent. After performing an exhaustive survey on Internet service AI domains, we identify and implement nineteen representative AI tasks with state-of-the-art models. For repeatable performance ranking (RPR subset) and workload characterization (WC subset), we keep two subsets to a minimum for affordability. We contribute by far the most comprehensive AI training benchmark suite. The evaluations show: (1) AIBench Training (v1.1) outperforms MLPerfTraining (v0.7) in terms of diversity and representativeness of model complexity, computational cost, convergent rate, computation, and memory access patterns, and hotspot functions; (2) Against the AIBench full benchmarks, its RPR subset shortens the benchmarking cost by 64%, while maintaining the primary workload characteristics; (3) The performance ranking shows the single-purpose AI accelerator like TPU with the optimized TensorFlowframework performs better than that of GPUs while losing the latter's general support for various AI models. The specification, source code, and performance numbers are available from the AIBench homepage https://www.benchcouncil.org/aibench-training/index.html.

cs.AI↗

arXiv2021

Enhancing VMAF through New Feature Integration and Model Combination

VMAF is a machine learning based video quality assessment method, originally designed for streaming applications, which combines multiple quality metrics and video features through SVM regression. It offers higher correlation with subjective opinions compared to many conventional quality assessment methods. In this paper we propose enhancements to VMAF through the integration of new video features and alternative quality metrics (selected from a diverse pool) alongside multiple model combination. The proposed combination approach enables training on multiple databases with varying content and distortion characteristics. Our enhanced VMAF method has been evaluated on eight HD video databases, and consistently outperforms the original VMAF model (0.6.1) and other benchmark quality metrics, exhibiting higher correlation with subjective ground truth data.

eess.IV↗

arXiv2021

Sensing population distribution from satellite imagery via deep learning: model selection, neighboring effect, and systematic biases

The rapid development of remote sensing techniques provides rich, large-coverage, and high-temporal information of the ground, which can be coupled with the emerging deep learning approaches that enable latent features and hidden geographical patterns to be extracted. This study marks the first attempt to cross-compare performances of popular state-of-the-art deep learning models in estimating population distribution from remote sensing images, investigate the contribution of neighboring effect, and explore the potential systematic population estimation biases. We conduct an end-to-end training of four popular deep learning architectures, i.e., VGG, ResNet, Xception, and DenseNet, by establishing a mapping between Sentinel-2 image patches and their corresponding population count from the LandScan population grid. The results reveal that DenseNet outperforms the other three models, while VGG has the worst performances in all evaluating metrics under all selected neighboring scenarios. As for the neighboring effect, contradicting existing studies, our results suggest that the increase of neighboring sizes leads to reduced population estimation performance, which is found universal for all four selected models in all evaluating metrics. In addition, there exists a notable, universal bias that all selected deep learning models tend to overestimate sparsely populated image patches and underestimate densely populated image patches, regardless of neighboring sizes. The methodological, experimental, and contextual knowledge this study provides is expected to benefit a wide range of future studies that estimate population distribution via remote sensing imagery.

cs.CV↗

arXiv2021

Towards Understanding and Demystifying Bitcoin Mixing Services

One reason for the popularity of Bitcoin is due to its anonymity. Although several heuristics have been used to break the anonymity, new approaches are proposed to enhance its anonymity at the same time. One of them is the mixing service. Unfortunately, mixing services have been abused to facilitate criminal activities, e.g., money laundering. As such, there is an urgent need to systematically understand Bitcoin mixing services. In this paper, we take the first step to understand state-of-the-art Bitcoin mixing services. Specifically, we propose a generic abstraction model for mixing services and observe that there are two mixing mechanisms in the wild, i.e. {swapping} and {obfuscating}. Based on this model, we conduct a transaction-based analysis and successfully reveal the mixing mechanisms of four representative services. Besides, we propose a method to identify mixing transactions that leverage the obfuscating mechanism. The proposed approach is able to identify over $92$\% of the mixing transactions. Based on identified transactions, we then estimate the profit of mixing services and provide a case study of tracing the money flow of stolen Bitcoins.

cs.CR↗

arXiv2021

Two-chip power-scalable THz-generating semiconductor disk laser

We demonstrate a compact two-chip terahertz-emitting vertical-external-cavity surface-emitting laser (TECSEL) source, which provides 1-THz output based on intracavity frequency conversion of dual-wavelength emission in a periodically-poled lithium niobate crystal. The type-I frequency conversion scheme at room temperature highly benefits from the power-scaling possibilities in a multichip cavity with intracavity powers in excess of 500 W.

physics.optics↗

arXiv2021

CellTrack R-CNN: A Novel End-To-End Deep Neural Network for Cell Segmentation and Tracking in Microscopy Images

Cell segmentation and tracking in microscopy images are of great significance to new discoveries in biology and medicine. In this study, we propose a novel approach to combine cell segmentation and cell tracking into a unified end-to-end deep learning based framework, where cell detection and segmentation are performed with a current instance segmentation pipeline and cell tracking is implemented by integrating Siamese Network with the pipeline. Besides, tracking performance is improved by incorporating spatial information into the network and fusing spatial and visual prediction. Our approach was evaluated on the DeepCell benchmark dataset. Despite being simple and efficient, our method outperforms state-of-the-art algorithms in terms of both cell segmentation and cell tracking accuracies.

cs.CV↗

arXiv2021

Speech Emotion Recognition with Multiscale Area Attention and Data Augmentation

In Speech Emotion Recognition (SER), emotional characteristics often appear in diverse forms of energy patterns in spectrograms. Typical attention neural network classifiers of SER are usually optimized on a fixed attention granularity. In this paper, we apply multiscale area attention in a deep convolutional neural network to attend emotional characteristics with varied granularities and therefore the classifier can benefit from an ensemble of attentions with different scales. To deal with data sparsity, we conduct data augmentation with vocal tract length perturbation (VTLP) to improve the generalization capability of the classifier. Experiments are carried out on the Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset. We achieved 79.34% weighted accuracy (WA) and 77.54% unweighted accuracy (UA), which, to the best of our knowledge, is the state of the art on this dataset.

cs.SD↗

arXiv2021

Full counting statistics of the currents through a Kitaev chain and the exchange fluctuation theorem

Exchange fluctuation theorems (XFTs) describe a fundamental symmetry relation for particle and energy exchange between several systems. Here we study the XFTs of a Kitaev chain connected to two reservoirs in the same temperature but different bias. By varying the parameters in the Kitaev chain model, we calculate analytically the full counting statistics of the transport current and formulate the corresponding XFTs for multiple current components. We also demonstrate the XFTs with numerical results. We find that due to the presence of the U(1) symmetry breaking terms in the Hamiltonian of the Kitaev chain, various forms of the XFTs emerge, and they can be interpreted in terms of various well-known transport processes.

quant-ph↗

arXiv2021

Video Compression with CNN-based Post Processing

In recent years, video compression techniques have been significantly challenged by the rapidly increased demands associated with high quality and immersive video content. Among various compression tools, post-processing can be applied on reconstructed video content to mitigate visible compression artefacts and to enhance overall perceptual quality. Inspired by advances in deep learning, we propose a new CNN-based post-processing approach, which has been integrated with two state-of-the-art coding standards, VVC and AV1. The results show consistent coding gains on all tested sequences at various spatial resolutions, with average bit rate savings of 4.0% and 5.8% against original VVC and AV1 respectively (based on the assessment of PSNR). This network has also been trained with perceptually inspired loss functions, which have further improved reconstruction quality based on perceptual quality assessment (VMAF), with average coding gains of 13.9% over VVC and 10.5% against AV1.

eess.IV↗

arXiv2021

Low-cost and high-performance data augmentation for deep-learning-based skin lesion classification

Although deep convolutional neural networks (DCNNs) have achieved significant accuracy in skin lesion classification comparable or even superior to those of dermatologists, practical implementation of these models for skin cancer screening in low resource settings is hindered by their limitations in computational cost and training dataset. To overcome these limitations, we propose a low-cost and high-performance data augmentation strategy that includes two consecutive stages of augmentation search and network search. At the augmentation search stage, the augmentation strategy is optimized in the search space of Low-Cost-Augment (LCA) under the criteria of balanced accuracy (BACC) with 5-fold cross validation. At the network search stage, the DCNNs are fine-tuned with the full training set in order to select the model with the highest BACC. The efficiency of the proposed data augmentation strategy is verified on the HAM10000 dataset using EfficientNets as a baseline. With the proposed strategy, we are able to reduce the search space to 60 and achieve a high BACC of 0.853 by using a single DCNN model without external database, suitable to be implemented in mobile devices for DCNN-based skin lesion detection in low resource settings.

cs.CV↗

arXiv2020

Moiré Band Topology in Twisted Bilayer Graphene

Recently twisted bilayer graphene (t-BLG) emerges as a new strongly correlated physical platform near a magic twist angle, which hosts many exciting phenomena such as the Mott-like insulating phases, unconventional superconducting behavior and emergent ferromagnetism. Besides the apparent significance of band flatness, band topology may be another critical element in determining strongly correlated twistronics yet receives much less attention. Here we report compelling evidence for nontrivial noninteracting band topology of t-BLG moiré Dirac bands through a systematic nonlocal transport study, in conjunction with an examination rooted in $K$-theory. The moiré band topology of t-BLG manifests itself as two pronounced nonlocal responses in the electron and hole superlattice gaps. We further show that the nonlocal responses are robust to the interlayer electric field, twist angle, and edge termination, exhibiting a universal scaling law. While an unusual symmetry of t-BLG trivializes Berry curvature, we elucidate that two $Z_2$ invariants characterize the topology of the moiré Dirac bands, validating the topological edge origin of the observed nonlocal responses. Our findings not only provide a new perspective for understanding the emerging strongly correlated phenomena in twisted van der Waals heterostructures, but also suggest a potential strategy to achieve topologically nontrivial metamaterials from topologically trivial quantum materials based on twist engineering.

cond-mat.str-el↗

arXiv2020

Room-Temperature Superconductivity in Boron-Nitrogen Doped Lanthanum Superhydride

Recent theoretical and experimental studies of hydrogen-rich materials at megabar pressures (i.e., >100 GPa) have led to the discovery of very high-temperature superconductivity in these materials. Lanthanum superhydride LaH$_{10}$ has been of particular focus as the first material to exhibit a superconducting critical temperature (T$_c$) near room temperature. Experiments indicate that the use of ammonia borane as the hydrogen source can increase the conductivity onset temperatures of lanthanum superhydride to as high as 290 K. Here we examine the doping effects of B and N atoms on the superconductivity of LaH$_{10}$ in its fcc (Fm-3m) clathrate structure at megabar pressures. Doping at H atomic positions strengthens the H$_{32}$ cages of the structure to give higher phonon frequencies that enhance the Debye frequency and thus the calculated T$_c$. The predicted T$_c$ can reach 288 K in LaH$_{9.985}$N$_{0.015}$ within the average high-symmetry structure at 240 GPa.

cond-mat.supr-con↗

arXiv2020

Strong mid-infrared photoresponse in small-twist-angle bilayer graphene

Recently the small-twist-angle (< 2°) bilayer graphene has received extraordinary attentions due to its exciting physical properties. Compared with monolayer graphene, the Brillouin zone folding in twisted bilayer graphene (TBG) leads to the formation of superlattice bandgap and significant modification of density of states. However, these emerging properties have rarely been leveraged for the realization of new optoelectronic devices. Here we demonstrate the strong, gate-tunable photoresponse in mid-infrared wavelength range of 5 to 12 um. A maximum extrinsic photoresponsivity of 26 mA/W has been achieved at 12 um when the Fermi level in a 1.81° TBG is tuned to its superlattice bandgap. Moreover, the strong photoresponse critically depends on the formation of superlattice bandgap, and it vanishes in the gapless case with ultrasmall twist angle (< 0.5°). Our demonstration reveals the promising optical properties of TBG and provides an alternative material platform for tunable mid-infrared optoelectronics.

cond-mat.mes-hall↗

arXiv2020

Hole-Doped Room-Temperature Superconductivity in H$_{3}$S$_{1-x}$Z$_x$ (Z=C, Si)

We examine the effects of the low-level substitution of S atoms by C and Si atoms on the superconductivity of H$_3$S with the $Im\bar{3}m$ structure at megabar pressure. The hole doping can fine-tune the Fermi energy to reach the electronic density-of-states peak maximizing the electron-phonon coupling. This can boost the critical temperature from the original 203 K to 289 K and 283 K, respectively, for H$_3$S$_{0.962}$C$_{0.038}$ at 260 GPa and H$_3$S$_{0.960}$Si$_{0.040}$ at 230 GPa. The former may provide an explanation for the recent experimental observation of room-temperature superconductivity in a highly compressed C-S-H system [Nature 586, 373-377 (2020)]. Our work opens a new avenue for substantially raising the critical temperatures of hydrogen-rich materials.

cond-mat.supr-con↗

arXiv2020

MFRNet: A New CNN Architecture for Post-Processing and In-loop Filtering

In this paper, we propose a novel convolutional neural network (CNN) architecture, MFRNet, for post-processing (PP) and in-loop filtering (ILF) in the context of video compression. This network consists of four Multi-level Feature review Residual dense Blocks (MFRBs), which are connected using a cascading structure. Each MFRB extracts features from multiple convolutional layers using dense connections and a multi-level residual learning structure. In order to further improve information flow between these blocks, each of them also reuses high dimensional features from the previous MFRB. This network has been integrated into PP and ILF coding modules for both HEVC (HM 16.20) and VVC (VTM 7.0), and fully evaluated under the JVET Common Test Conditions using the Random Access configuration. The experimental results show significant and consistent coding gains over both anchor codecs (HEVC HM and VVC VTM) and also over other existing CNN-based PP/ILF approaches based on Bjontegaard Delta measurements using both PSNR and VMAF for quality assessment. When MFRNet is integrated into HM 16.20, gains up to 16.0% (BD-rate VMAF) are demonstrated for ILF, and up to 21.0% (BD-rate VMAF) for PP. The respective gains for VTM 7.0 are up to 5.1% for ILF and up to 7.1% for PP.

eess.IV↗