arXiv subjects

Yue Zhou

Publications and source records attributed to Yue Zhou.

At least 163 records · Page 9Linked to original sources

arXiv2022

Network Pruning via Feature Shift Minimization

Channel pruning is widely used to reduce the complexity of deep network models. Recent pruning methods usually identify which parts of the network to discard by proposing a channel importance criterion. However, recent studies have shown that these criteria do not work well in all conditions. In this paper, we propose a novel Feature Shift Minimization (FSM) method to compress CNN models, which evaluates the feature shift by converging the information of both features and filters. Specifically, we first investigate the compression efficiency with some prevalent methods in different layer-depths and then propose the feature shift concept. Then, we introduce an approximation method to estimate the magnitude of the feature shift, since it is difficult to compute it directly. Besides, we present a distribution-optimization algorithm to compensate for the accuracy loss and improve the network compression efficiency. The proposed method yields state-of-the-art performance on various benchmark networks and datasets, verified by extensive experiments. Our codes are available at: https://github.com/lscgx/FSM.

cs.CV↗

arXiv2022

Detecting Rotated Objects as Gaussian Distributions and Its 3-D Generalization

Existing detection methods commonly use a parameterized bounding box (BBox) to model and detect (horizontal) objects and an additional rotation angle parameter is used for rotated objects. We argue that such a mechanism has fundamental limitations in building an effective regression loss for rotation detection, especially for high-precision detection with high IoU (e.g. 0.75). Instead, we propose to model the rotated objects as Gaussian distributions. A direct advantage is that our new regression loss regarding the distance between two Gaussians e.g. Kullback-Leibler Divergence (KLD), can well align the actual detection performance metric, which is not well addressed in existing methods. Moreover, the two bottlenecks i.e. boundary discontinuity and square-like problem also disappear. We also propose an efficient Gaussian metric-based label assignment strategy to further boost the performance. Interestingly, by analyzing the BBox parameters' gradients under our Gaussian-based KLD loss, we show that these parameters are dynamically updated with interpretable physical meaning, which help explain the effectiveness of our approach, especially for high-precision detection. We extend our approach from 2-D to 3-D with a tailored algorithm design to handle the heading estimation, and experimental results on twelve public datasets (2-D/3-D, aerial/text/face images) with various base detectors show its superiority.

cs.CV↗

arXiv2022

MMRotate: A Rotated Object Detection Benchmark using PyTorch

We present an open-source toolbox, named MMRotate, which provides a coherent algorithm framework of training, inferring, and evaluation for the popular rotated object detection algorithm based on deep learning. MMRotate implements 18 state-of-the-art algorithms and supports the three most frequently used angle definition methods. To facilitate future research and industrial applications of rotated object detection-related problems, we also provide a large number of trained models and detailed benchmarks to give insights into the performance of rotated object detection. MMRotate is publicly released at https://github.com/open-mmlab/mmrotate.

cs.CV↗

arXiv2022

Contrast mechanisms in pump-probe microscopy of melanin

Pump-probe microscopy of melanin in tumors has been proposed to improve diagnosis of malignant melanoma, based on the hypothesis that aggressive cancers disaggregate melanin structure. However, measured signals of melanin are complex superpositions of multiple nonlinear processes, which makes interpretation challenging. Polarization control during measurement and data fitting is used to decompose signals of melanin into their underlying molecular mechanisms. We then identify the molecular mechanisms that are most susceptible to melanin disaggregation and derive false-coloring schemes to highlight these processes in biological tissue. We exemplary demonstrate that false-colored images of a small set of melanoma tumors correlate with clinical concern. More generally, our systematic approach of decomposing pump-probe signals can be applied to a multitude of different samples.

physics.med-ph↗

arXiv2022

Multi-Robot Collaborative Perception with Graph Neural Networks

Multi-robot systems such as swarms of aerial robots are naturally suited to offer additional flexibility, resilience, and robustness in several tasks compared to a single robot by enabling cooperation among the agents. To enhance the autonomous robot decision-making process and situational awareness, multi-robot systems have to coordinate their perception capabilities to collect, share, and fuse environment information among the agents in an efficient and meaningful way such to accurately obtain context-appropriate information or gain resilience to sensor noise or failures. In this paper, we propose a general-purpose Graph Neural Network (GNN) with the main goal to increase, in multi-robot perception tasks, single robots' inference perception accuracy as well as resilience to sensor failures and disturbances. We show that the proposed framework can address multi-view visual perception problems such as monocular depth estimation and semantic segmentation. Several experiments both using photo-realistic and real data gathered from multiple aerial robots' viewpoints show the effectiveness of the proposed approach in challenging inference conditions including images corrupted by heavy noise and camera occlusions or failures.

cs.RO↗

arXiv2021

High Energy Irradiation Effects on Silicon Photonic Passive Devices

In this work, the radiation responses of silicon photonic passive devices built in silicon-on-insulator (SOI) technology are investigated through high energy neutron and 60Co gamma-ray irradiation. The wavelengths of both micro-ring resonators (MRRs) and Mach-Zehnder interferometers (MZIs) exhibit blue shifts after high-energy neutron irradiation to a fluence of 1*1012 n/cm2; the blue shift is smaller in MZI devices than in MRRs due to different waveguide widths. Devices with SiO2 upper cladding layer show strong tolerance to irradiation. Neutron irradiation leads to slight changes in the crystal symmetry in the Si cores of the optical devices and accelerated oxidization for devices without SiO2 cladding. A 2 um top cladding of SiO2 layer significantly improves the radiation tolerance of these passive photonic devices.

physics.optics↗

arXiv2021

Network Compression via Central Filter

Neural network pruning has remarkable performance for reducing the complexity of deep network models. Recent network pruning methods usually focused on removing unimportant or redundant filters in the network. In this paper, by exploring the similarities between feature maps, we propose a novel filter pruning method, Central Filter (CF), which suggests that a filter is approximately equal to a set of other filters after appropriate adjustments. Our method is based on the discovery that the average similarity between feature maps changes very little, regardless of the number of input images. Based on this finding, we establish similarity graphs on feature maps and calculate the closeness centrality of each node to select the Central Filter. Moreover, we design a method to directly adjust weights in the next layer corresponding to the Central Filter, effectively minimizing the error caused by pruning. Through experiments on various benchmark networks and datasets, CF yields state-of-the-art performance. For example, with ResNet-56, CF reduces approximately 39.7% of FLOPs by removing 47.1% of the parameters, with even 0.33% accuracy improvement on CIFAR-10. With GoogLeNet, CF reduces approximately 63.2% of FLOPs by removing 55.6% of the parameters, with only a small loss of 0.35% in top-1 accuracy on CIFAR-10. With ResNet-50, CF reduces approximately 47.9% of FLOPs by removing 36.9% of the parameters, with only a small loss of 1.07% in top-1 accuracy on ImageNet. The codes can be available at https://github.com/8ubpshLR23/Central-Filter.

cs.LG↗

arXiv2021

AlphaRotate: A Rotation Detection Benchmark using TensorFlow

AlphaRotate is an open-source Tensorflow benchmark for performing scalable rotation detection on various datasets. It currently provides more than 18 popular rotation detection models under a single, well-documented API designed for use by both practitioners and researchers. AlphaRotate regards high performance, robustness, sustainability and scalability as the core concept of design, and all models are covered by unit testing, continuous integration, code coverage, maintainability checks, and visual monitoring and analysis. AlphaRotate can be installed from PyPI and is released under the Apache-2.0 License. Source code is available at https://github.com/yangxue0827/RotationDetection.

cs.CV↗

arXiv2021

Privacy-Preserving Energy Storage Sharing with Blockchain and Secure Multi-Party Computation

Energy storage provides an effective way of shifting temporal energy demands and supplies, which enables significant cost reduction under time-of-use energy pricing plans. Despite its promising benefits, the cost of present energy storage remains expensive, presenting a major obstacle to practical deployment. A more viable solution to improve the cost-effectiveness is by sharing energy storage, such as community sharing, cloud energy storage and peer-to-peer sharing. However, revealing private energy demand data to an external energy storage operator may compromise user privacy, and is susceptible to data misuses and breaches. In this paper, we explore a novel approach to support energy storage sharing with privacy protection, based on privacy-preserving blockchain and secure multi-party computation. We present an integrated solution to enable privacy-preserving energy storage sharing, such that energy storage service scheduling and cost-sharing can be attained without the knowledge of individual users' demands. It also supports auditing and verification by the grid operator via blockchain. Furthermore, our privacy-preserving solution can safeguard against a dishonest majority of users, who may collude in cheating, without requiring a trusted third-party. We implemented our solution as a smart contract on real-world Ethereum blockchain platform, and provide empirical evaluation in this paper.

cs.CR↗

arXiv2021

A large family of maximum scattered linear sets of $\mathrm{PG}(1,q^n)$ and their associated MRD codes

The concept of linear set in projective spaces over finite fields was introduced by Lunardon in 1999 and it plays central roles in the study of blocking sets, semifields, rank-distance codes and etc. A linear set with the largest possible cardinality and rank is called maximum scattered. Despite two decades of study, there are only a limited number of maximum scattered linear sets of a line $\mathrm{PG}(1,q^n)$. In this paper, we provide a large family of new maximum scattered linear sets over $\mathrm{PG}(1,q^n)$ for any even $n\geq 6$ and odd $q$. In particular, the relevant family contains at least \[ \begin{cases} \left\lfloor\frac{q^t+1}{8rt}\right\rfloor,& \text{ if }t\not\equiv 2\pmod{4};\\[8pt] \left\lfloor\frac{q^t+1}{4rt(q^2+1)}\right\rfloor,& \text{ if }t\equiv 2\pmod{4}, \end{cases} \] inequivalent members for given $q=p^r$ and $n=2t>8$, where $p=\mathrm{char}(\mathbb{F}_q)$. This is a great improvement of previous results: for given $q$ and $n>8$, the number of inequivalent maximum scattered linear sets of $\mathrm{PG}(1,q^n)$ in all classes known so far, is smaller than $q^2$. Moreover, we show that there are a large number of new maximum rank-distance codes arising from the constructed linear sets.

math.CO↗

arXiv2021

Deformation-Aware Robotic 3D Ultrasound

Tissue deformation in ultrasound (US) imaging leads to geometrical errors when measuring tissues due to the pressure exerted by probes. Such deformation has an even larger effect on 3D US volumes as the correct compounding is limited by the inconsistent location and geometry. This work proposes a patient-specified stiffness-based method to correct the tissue deformations in robotic 3D US acquisitions. To obtain the patient-specified model, robotic palpation is performed at sampling positions on the tissue. The contact force, US images and the probe poses of the palpation procedure are recorded. The contact force and the probe poses are used to estimate the nonlinear tissue stiffness. The images are fed to an optical flow algorithm to compute the pixel displacement. Then the pixel-wise tissue deformation under different forces is characterized by a coupled quadratic regression. To correct the deformation at unseen positions on the trajectory for building 3D volumes, an interpolation is performed based on the stiffness values computed at the sampling positions. With the stiffness and recorded force, the tissue displacement could be corrected. The method was validated on two blood vessel phantoms with different stiffness. The results demonstrate that the method can effectively correct the force-induced deformation and finally generate 3D tissue geometries

eess.IV↗

arXiv2021

Impact of Local Energy Markets on the Distribution Systems: A Comprehensive Review

In recent years extensive research has been conducted on the development of different models that enable energy trading between prosumers and consumers due to expected high integration of distributed energy resources. Some of the most researched mechanisms include Peer-to-Peer energy trading, Community Self-Consumption and Transactive Energy Models. Here, we present an exhaustive review of existing research around Local Energy Market integration into distribution systems, in particular benefits and challenges that the power grid can expect from integrating these models. We also present a detailed overview of methods that are used to integrate physical network constraints into the market mechanisms, their advantages, drawbacks, and scaling potential. We find that financial energy transactions do not directly reflect the physical energy flows imposed by the constraints of the installed electrical infrastructure. Therefore, ensuring the stable and reliable delivery of electricity, it is vital to understand the impact of these transactions on the grid infrastructure, e.g., impacts on the control, operation, and planning of electricity distribution systems.

eess.SY↗

arXiv2021

Dense Label Encoding for Boundary Discontinuity Free Rotation Detection

Rotation detection serves as a fundamental building block in many visual applications involving aerial image, scene text, and face etc. Differing from the dominant regression-based approaches for orientation estimation, this paper explores a relatively less-studied methodology based on classification. The hope is to inherently dismiss the boundary discontinuity issue as encountered by the regression-based detectors. We propose new techniques to push its frontier in two aspects: i) new encoding mechanism: the design of two Densely Coded Labels (DCL) for angle classification, to replace the Sparsely Coded Label (SCL) in existing classification-based detectors, leading to three times training speed increase as empirically observed across benchmarks, further with notable improvement in detection accuracy; ii) loss re-weighting: we propose Angle Distance and Aspect Ratio Sensitive Weighting (ADARSW), which improves the detection accuracy especially for square-like objects, by making DCL-based detectors sensitive to angular distance and object's aspect ratio. Extensive experiments and visual analysis on large-scale public datasets for aerial images i.e. DOTA, UCAS-AOD, HRSC2016, as well as scene text dataset ICDAR2015 and MLT, show the effectiveness of our approach. The source code is available at https://github.com/Thinklab-SJTU/DCL_RetinaNet_Tensorflow and is also integrated in our open source rotation detection benchmark: https://github.com/yangxue0827/RotationDetection.

cs.CV↗

arXiv2021

Two new infinite classes of APN functions

In this paper, we present two new infinite classes of APN functions over $\gf_{2^{2m}}$ and $\gf_{2^{3m}}$, respectively. The first one is with bivariate form and obtained by adding special terms, $\sum(a_ix^{2^i}y^{2^i},b_ix^{2^i}y^{2^i})$, to a known class of APN functions by {G{ö}lo{ǧ}lu} over $\gf_{2^m}^2$. The second one is of the form $L(z)^{2^m+1}+vz^{2^m+1}$ over $\gf_{2^{3m}}$, which is a generalization of one family of APN functions by Bracken et al. [Cryptogr. Commun. 3 (1): 43-53, 2011]. The calculation of the CCZ-invariants $Γ$-ranks of our APN classes over $\gf_{2^8}$ or $\gf_{2^9}$ indicates that they are CCZ-inequivalent to all known infinite families of APN functions. Moreover, by using the code isomorphism, we see that our first APN family covers an APN function over $\gf_{2^8}$ obtained through the switching method by Edel and Pott in [Adv. Math. Commun. 3 (1): 59-81, 2009].

cs.IT↗

arXiv2021

AIPerf: Automated machine learning as an AI-HPC benchmark

The plethora of complex artificial intelligence (AI) algorithms and available high performance computing (HPC) power stimulates the expeditious development of AI components with heterogeneous designs. Consequently, the need for cross-stack performance benchmarking of AI-HPC systems emerges rapidly. The de facto HPC benchmark LINPACK can not reflect AI computing power and I/O performance without representative workload. The current popular AI benchmarks like MLPerf have fixed problem size therefore limited scalability. To address these issues, we propose an end-to-end benchmark suite utilizing automated machine learning (AutoML), which not only represents real AI scenarios, but also is auto-adaptively scalable to various scales of machines. We implement the algorithms in a highly parallel and flexible way to ensure the efficiency and optimization potential on diverse systems with customizable configurations. We utilize operations per second (OPS), which is measured in an analytical and systematic approach, as the major metric to quantify the AI performance. We perform evaluations on various systems to ensure the benchmark's stability and scalability, from 4 nodes with 32 NVIDIA Tesla T4 (56.1 Tera-OPS measured), up to 512 nodes with 4096 Huawei Ascend 910 (194.53 Peta-OPS measured), and the results show near-linear weak scalability. With flexible workload and single metric, our benchmark can scale and rank AI-HPC easily.

cs.DC↗

arXiv2021

Remarks on Viscosity Super-Solutions of Quasi-Variational Inequalities

For Hamilton-Jacobi-Bellman (HJB) equations, with the standard definitions of viscosity super-solution and sub-solution, it is known that there is a comparison between any (viscosity) super-solutions and sub-solutions. This should be the same for HJB type quasi-variational inequalities (QVIs) arising from optimal impulse control problems. However, according to a natural adoption of the definition found in Barles 1985, Barles 1985b, the uniqueness of the viscosity solution could be guaranteed, but the comparison between viscosity super- and sub-solutions could not be guaranteed. This paper introduces a modification of the definition for the viscosity super-solution of HJB type QVIs so that the desired comparison theorem will hold.

math.AP↗

arXiv2020

Beyond intensity modulation: new approaches to pump-probe microscopy

Pump-probe microscopy is an emerging nonlinear imaging technique based on high repetition rate lasers and fast intensity modulation. Here we present new methods for pump-probe microscopy that keep the beam intensity constant and instead modulate the inter-pulse time delay, the relative polarization, or the pulse length. These techniques can improve image quality for samples that have poor heat dissipation or long-lived radiative states, and can selectively address nonlinear interactions in the sample. We experimentally demonstrate this approach and point out the advantages over conventional intensity modulation.

physics.optics↗

arXiv2020

The number of almost perfect nonlinear functions grows exponentially

Almost perfect nonlinear (APN) functions play an important role in the design of block ciphers as they offer the strongest resistance against differential cryptanalysis. Despite more than 25 years of research, only a limited number of APN functions are known. In this paper, we show that a recent construction by Taniguchi provides at least $\frac{φ(m)}{2}\left\lceil \frac{2^m+1}{3m} \right\rceil$ inequivalent APN functions on the finite field with ${2^{2m}}$ elements, where $φ$ denotes Euler's totient function. This is a great improvement of previous results: for even $m$, the best known lower bound has been $\frac{φ(m)}{2}\left(\lfloor \frac{m}{4}\rfloor +1\right)$, for odd $m$, there has been no such lower bound at all. Moreover, we determine the automorphism group of Taniguchi's APN functions.

math.CO↗