arXiv subjects

Zheng Wang

Publications and source records attributed to Zheng Wang.

At least 379 records · Page 21Linked to original sources

arXiv2021

Detecting Mitosis against Domain Shift using a Fused Detector and Deep Ensemble Classification Model for MIDOG Challenge

Mitotic figure count is an important marker of tumor proliferation and has been shown to be associated with patients' prognosis. Deep learning based mitotic figure detection methods have been utilized to automatically locate the cell in mitosis using hematoxylin \& eosin (H\&E) stained images. However, the model performance deteriorates due to the large variation of color tone and intensity in H\&E images. In this work, we proposed a two stage mitotic figure detection framework by fusing a detector and a deep ensemble classification model. To alleviate the impact of color variation in H\&E images, we utilize both stain normalization and data augmentation, aiding model to learn color irrelevant features. The proposed model obtains an F1 score of 0.7550 on the preliminary testing set released by the MIDOG challenge.

cs.CV↗

arXiv2021

Spectrum Gaussian Processes Based On Tunable Basis Functions

Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions, such as eigenvectors in the Hilbert space, in the spectrum method, or decoupled orthogonal components in the variational framework. In this paper, inspired by quantum physics, we introduce a novel basis function, which is tunable, local and bounded, to approximate the kernel function in the Gaussian process. There are two adjustable parameters in these functions, which control their orthogonality to each other and limit their boundedness. And we conduct extensive experiments on open-source datasets to testify its performance. Compared to several state-of-the-art methods, it turns out that the proposed method can obtain satisfactory or even better results, especially with poorly chosen kernel functions.

stat.ML↗

arXiv2021

Zero-Shot Feature Selection via Transferring Supervised Knowledge

Feature selection, an effective technique for dimensionality reduction, plays an important role in many machine learning systems. Supervised knowledge can significantly improve the performance. However, faced with the rapid growth of newly emerging concepts, existing supervised methods might easily suffer from the scarcity and validity of labeled data for training. In this paper, the authors study the problem of zero-shot feature selection (i.e., building a feature selection model that generalizes well to "unseen" concepts with limited training data of "seen" concepts). Specifically, they adopt class-semantic descriptions (i.e., attributes) as supervision for feature selection, so as to utilize the supervised knowledge transferred from the seen concepts. For more reliable discriminative features, they further propose the center-characteristic loss which encourages the selected features to capture the central characteristics of seen concepts. Extensive experiments conducted on various real-world datasets demonstrate the effectiveness of the method.

cs.CV↗

arXiv2021

Location Prediction via Bi-direction Speculation and Dual-level Association

Location prediction is of great importance in location-based applications for the construction of the smart city. To our knowledge, existing models for location prediction focus on users' preferences on POIs from the perspective of the human side. However, modeling users' interests from the historical trajectory is still limited by the data sparsity. Additionally, most of existing methods predict the next location according to the individual data independently, but the data sparsity makes it difficult to mine explicit mobility patterns or capture the casual behavior for each user. To address the issues above, we propose a novel Bi-direction Speculation and Dual-level Association method (BSDA), which considers both users' interests in POIs and POIs' appeal to users. Furthermore, we develop the cross-user and cross-POI association to alleviate the data sparsity by similar users and POIs to enrich the candidates. Experimental results on two public datasets demonstrate that BSDA achieves significant improvements over state-of-the-art methods.

cs.SI↗

arXiv2021

Moire Superlattice Modulations in Single-Unit-Cell FeTe Films Grown on NbSe2 Single Crystals

Interface can be a fertile ground for exotic quantum states, including topological superconductivity, Majorana mode, fractal quantum Hall effect, unconventional superconductivity, Mott insulator, etc. Here we grow single-unit-cell (1UC) FeTe film on NbSe2 single crystal by molecular beam epitaxy (MBE) and investigate the film in-situ with home-made cryogenic scanning tunneling microscopy (STM) and non-contact atomic force microscopy (AFM) combined system. We find different stripe-like superlattice modulations on grown FeTe film with different misorientation angles with respect to NbSe2 substrate. We show that these stripe-like superlattice modulations can be understood as moire pattern forming between FeTe film and NbSe2 substrate. Our results indicate that the interface between FeTe and NbSe2 is atomically sharp. By STM-AFM combined measurement, we suggest the moire superlattice modulations have an electronic origin when the misorientation angle is relatively small (<= 3 degree) and have structural relaxation when the misorientation angle is relatively large (>= 10 degree).

cond-mat.str-el↗

arXiv2021

Federated Learning with Fair Averaging

Fairness has emerged as a critical problem in federated learning (FL). In this work, we identify a cause of unfairness in FL -- conflicting gradients with large differences in the magnitudes. To address this issue, we propose the federated fair averaging (FedFV) algorithm to mitigate potential conflicts among clients before averaging their gradients. We first use the cosine similarity to detect gradient conflicts, and then iteratively eliminate such conflicts by modifying both the direction and the magnitude of the gradients. We further show the theoretical foundation of FedFV to mitigate the issue conflicting gradients and converge to Pareto stationary solutions. Extensive experiments on a suite of federated datasets confirm that FedFV compares favorably against state-of-the-art methods in terms of fairness, accuracy and efficiency. The source code is available at https://github.com/WwZzz/easyFL.

cs.LG↗

arXiv2021

Zero-shot Node Classification with Decomposed Graph Prototype Network

Node classification is a central task in graph data analysis. Scarce or even no labeled data of emerging classes is a big challenge for existing methods. A natural question arises: can we classify the nodes from those classes that have never been seen? In this paper, we study this zero-shot node classification (ZNC) problem which has a two-stage nature: (1) acquiring high-quality class semantic descriptions (CSDs) for knowledge transfer, and (2) designing a well generalized graph-based learning model. For the first stage, we give a novel quantitative CSDs evaluation strategy based on estimating the real class relationships, so as to get the "best" CSDs in a completely automatic way. For the second stage, we propose a novel Decomposed Graph Prototype Network (DGPN) method, following the principles of locality and compositionality for zero-shot model generalization. Finally, we conduct extensive experiments to demonstrate the effectiveness of our solutions.

cs.AI↗

arXiv2021

Unsupervised Video Person Re-identification via Noise and Hard frame Aware Clustering

Unsupervised video-based person re-identification (re-ID) methods extract richer features from video tracklets than image-based ones. The state-of-the-art methods utilize clustering to obtain pseudo-labels and train the models iteratively. However, they underestimate the influence of two kinds of frames in the tracklet: 1) noise frames caused by detection errors or heavy occlusions exist in the tracklet, which may be allocated with unreliable labels during clustering; 2) the tracklet also contains hard frames caused by pose changes or partial occlusions, which are difficult to distinguish but informative. This paper proposes a Noise and Hard frame Aware Clustering (NHAC) method. NHAC consists of a graph trimming module and a node re-sampling module. The graph trimming module obtains stable graphs by removing noise frame nodes to improve the clustering accuracy. The node re-sampling module enhances the training of hard frame nodes to learn rich tracklet information. Experiments conducted on two video-based datasets demonstrate the effectiveness of the proposed NHAC under the unsupervised re-ID setting.

cs.CV↗

arXiv2021

Effect of Adaptive and Fixed Shared Steering Control on Distracted Driver Behavior

Driver distraction is a well-known cause for traffic collisions worldwide. Studies have indicated that shared steering control, which actively provides haptic guidance torque on the steering wheel, effectively improves the performance of distracted drivers. Recently, adaptive shared steering control based on the physiological status of the driver has been developed, although its effect on distracted driver behavior remains unclear. To this end, a high-fidelity driving simulator experiment was conducted involving 18 participants performing double lane changes. The experimental conditions comprised two driver states: attentive and distracted. Under each condition, evaluations were performed on three types of haptic guidance: none (manual), fixed authority, and adaptive authority based on feedback from the forearm surface electromyography of the driver. Evaluation results indicated that, for both attentive and distracted drivers, haptic guidance with adaptive authority yielded lower driver workload and reduced lane departure risk than manual driving and fixed authority. Moreover, there was a tendency for distracted drivers to reduce grip strength on the steering wheel to follow the haptic guidance with fixed authority, resulting in a relatively shorter double lane change duration.

eess.SY↗

arXiv2021

Thermal dynamics of charge density wave pinning in ZrTe3

Impurity pinning has long been discussed to have a profound effect on the dynamics of an incommensurate charge density wave (CDW), which would otherwise slide through the lattice without resistance. Here we visualize the impurity pinning evolution of the CDW in ZrTe3 using the variable temperature scanning tunneling microscopy (STM). At low temperatures, we observe a quasi-1D incommensurate CDW modulation moderately correlated to the impurity positions, indicating a weak impurity pinning. As we raise the sample temperature, the CDW modulation gets progressively weakened and distorted, while the correlation with the impurities becomes stronger. Above the CDW transition temperature, short-range modulations persist with the phase almost all pinned by impurities. The evolution from weak to strong impurity pinning through the CDW transition can be understood as a result of losing phase rigidity.

cond-mat.str-el↗

arXiv2021

Analysis and Modeling of Driver Behavior with Integrated Feedback of Visual and Haptic Information Under Shared Control

The thesis presents contributions made to the evaluation and design of a haptic guidance system on improving driving performance in cases of normal and degraded visual information, which are based on behavior experiments, modeling and numerical simulations. The effect of shared control on driver behavior in cases of normal and degraded visual information has been successfully evaluated experimentally and numerically. The evaluation results indicate that the proposed haptic guidance system is capable of providing reliable haptic information, and is effective on improving lane following performance in the conditions of visual occlusion from road ahead and declined visual attention under fatigue driving. Moreover, the appropriate degree of haptic guidance is highly related to the reliability of visual information perceived by the driver, which suggests that designing the haptic guidance system based on the reliability of visual information would allow for greater driver acceptance. Furthermore, the parameterized driver model, which considers the integrated feedback of visual and haptic information, is capable of predicting driver behavior under shared control, and has the potential of being used for designing and evaluating the haptic guidance system.

cs.RO↗

arXiv2021

Antiferroelectric negative capacitance from a structural phase transition in zirconia

Crystalline materials with broken inversion symmetry can exhibit a spontaneous electric polarization, which originates from a microscopic electric dipole moment. Long-range polar or anti-polar order of such permanent dipoles gives rise to ferroelectricity or antiferroelectricity, respectively. However, the recently discovered antiferroelectrics of fluorite structure (HfO$_2$ and ZrO$_2$) are different: A non-polar phase transforms into a polar phase by spontaneous inversion symmetry breaking upon the application of an electric field. Here, we show that this structural transition in antiferroelectric ZrO$_2$ gives rise to a negative capacitance, which is promising for overcoming the fundamental limits of energy efficiency in electronics. Our findings provide insight into the thermodynamically 'forbidden' region of the antiferroelectric transition in ZrO$_2$ and extend the concept of negative capacitance beyond ferroelectricity. This shows that negative capacitance is a more general phenomenon than previously thought and can be expected in a much broader range of materials exhibiting structural phase transitions.

cond-mat.mtrl-sci↗

arXiv2021

Automated Conformance Testing for JavaScript Engines via Deep Compiler Fuzzing

JavaScript (JS) is a popular, platform-independent programming language. To ensure the interoperability of JS programs across different platforms, the implementation of a JS engine should conform to the ECMAScript standard. However, doing so is challenging as there are many subtle definitions of API behaviors, and the definitions keep evolving. We present COMFORT, a new compiler fuzzing framework for detecting JS engine bugs and behaviors that deviate from the ECMAScript standard. COMFORT leverages the recent advance in deep learning-based language models to automatically generate JS test code. As a departure from prior fuzzers, COMFORT utilizes the well-structured ECMAScript specifications to automatically generate test data along with the test programs to expose bugs that could be overlooked by the developers or manually written test cases. COMFORT then applies differential testing methodologies on the generated test cases to expose standard conformance bugs. We apply COMFORT to ten mainstream JS engines. In 200 hours of automated concurrent testing runs, we discover bugs in all tested JS engines. We had identified 158 unique JS engine bugs, of which 129 have been verified, and 115 have already been fixed by the developers. Furthermore, 21 of the Comfort-generated test cases have been added to Test262, the official ECMAScript conformance test suite.

cs.SE↗

arXiv2021

Expanding Semantic Knowledge for Zero-shot Graph Embedding

Zero-shot graph embedding is a major challenge for supervised graph learning. Although a recent method RECT has shown promising performance, its working mechanisms are not clear and still needs lots of training data. In this paper, we give deep insights into RECT, and address its fundamental limits. We show that its core part is a GNN prototypical model in which a class prototype is described by its mean feature vector. As such, RECT maps nodes from the raw-input feature space into an intermediate-level semantic space that connects the raw-input features to both seen and unseen classes. This mechanism makes RECT work well on both seen and unseen classes, which however also reduces the discrimination. To realize its full potentials, we propose two label expansion strategies. Specifically, besides expanding the labeled node set of seen classes, we can also expand that of unseen classes. Experiments on real-world datasets validate the superiority of our methods.

cs.LG↗

arXiv2021

Model Rectification via Unknown Unknowns Extraction from Deployment Samples

Model deficiency that results from incomplete training data is a form of structural blindness that leads to costly errors, oftentimes with high confidence. During the training of classification tasks, underrepresented class-conditional distributions that a given hypothesis space can recognize results in a mismatch between the model and the target space. To mitigate the consequences of this discrepancy, we propose Random Test Sampling and Cross-Validation (RTSCV) as a general algorithmic framework that aims to perform a post-training model rectification at deployment time in a supervised way. RTSCV extracts unknown unknowns (u.u.s), i.e., examples from the class-conditional distributions that a classifier is oblivious to, and works in combination with a diverse family of modern prediction models. RTSCV augments the training set with a sample of the test set (or deployment data) and uses this redefined class layout to discover u.u.s via cross-validation, without relying on active learning or budgeted queries to an oracle. We contribute a theoretical analysis that establishes performance guarantees based on the design bases of modern classifiers. Our experimental evaluation demonstrates RTSCV's effectiveness, using 7 benchmark tabular and computer vision datasets, by reducing a performance gap as large as 41% from the respective pre-rectification models. Last we show that RTSCV consistently outperforms state-of-the-art approaches.

cs.LG↗

arXiv2021

A Study on Universal Observation Control System And Its Application For LAMOST

{The observatory control system (OCS), a part of automated control of Large Sky Area Multi-Object Fibre Spectroscopic Telescope (LAMOST), runs on the CentOS6 platform and implements the communication between modules based on Common Object Request Broker Architecture (CORBA). However, CORBA is complicated and has limited development support; moreover, the official support for CentOS6 has ended. OCS inherently has some shortcomings such as the over-concentration of control and the blocking of device status processing, which hinder the realization of automated observation control of LAMOST. Therefore, this study designs and implements a universal observation control system (UOCS) for optical telescopes. The UOCS takes the device command as the basic execution unit, controls the device execution logic using observation script, controls the observation logic by event-driven messaging, and realizes mutual decoupling between modules via a distributed control mode, thereby ensuring high system robustness. The UOCS performs significantly better than OCS in terms of the observation performance, operator complexity, and communication error. Currently, UOCS is applied to the automated control of some devices and subsystems in LAMOST observation. It will be applied to the automated observation control of Multi-channel Photometric Survey Telescope by 2021.

astro-ph.IM↗

arXiv2021

Interaction-aware Kalman Neural Networks for Trajectory Prediction

Forecasting the motion of surrounding obstacles (vehicles, bicycles, pedestrians and etc.) benefits the on-road motion planning for intelligent and autonomous vehicles. Complex scenes always yield great challenges in modeling the patterns of surrounding traffic. For example, one main challenge comes from the intractable interaction effects in a complex traffic system. In this paper, we propose a multi-layer architecture Interaction-aware Kalman Neural Networks (IaKNN) which involves an interaction layer for resolving high-dimensional traffic environmental observations as interaction-aware accelerations, a motion layer for transforming the accelerations to interaction aware trajectories, and a filter layer for estimating future trajectories with a Kalman filter network. Attributed to the multiple traffic data sources, our end-to-end trainable approach technically fuses dynamic and interaction-aware trajectories boosting the prediction performance. Experiments on the NGSIM dataset demonstrate that IaKNN outperforms the state-of-the-art methods in terms of effectiveness for traffic trajectory prediction.

cs.RO↗

arXiv2020

Analysis of Truck Driver Behavior to Design Different Lane Change Styles in Automated Driving

Lane change is a very demanding driving task and number of traffic accidents are induced by mistaken maneuvers. An automated lane change system has the potential to reduce driver workload and to improve driving safety. One challenge is how to improve driver acceptance on the automated system. From the viewpoint of human factors, an automated system with different styles would improve user acceptance as the drivers can adapt the style to different driving situations. This paper proposes a method to design different lane change styles in automated driving by analysis and modeling of truck driver behavior. A truck driving simulator experiment with 12 participants was conducted to identify the driver model parameters and three lane change styles were classified as the aggressive, medium, and conservative ones. The proposed automated lane change system was evaluated by another truck driving simulator experiment with the same 12 participants. Moreover, the effect of different driving styles on driver experience and acceptance was evaluated. The evaluation results demonstrate that the different lane change styles could be distinguished by the drivers; meanwhile, the three styles were overall evaluated as acceptable on safety issues and reliable by the human drivers. This study provides insight into designing the automated driving system with different driving styles and the findings can be applied to commercial automated trucks.

cs.RO↗