arXiv subjects

Hai Zhang

Publications and source records attributed to Hai Zhang.

At least 73 records · Page 4Linked to original sources

arXiv2022

Dirac points for the honeycomb lattice with impenetrable obstacles

This work is concerned with the Dirac points for the honeycomb lattice with impenetrable obstacles arranged periodically in a homogeneous medium. We consider both the Dirichlet and Neumann eigenvalue problems and prove the existence of Dirac points for both eigenvalue problems at crossing of the lower band surfaces as well as higher band surfaces. Furthermore, we perform quantitative analysis for the eigenvalues and the slopes of two conical dispersion surfaces near each Dirac point based on a combination of the layer potential technique and asymptotic analysis. It is shown that the eigenvalues are in the neighborhood of the singular frequencies associated with the Green's function for the honeycomb lattice, and the slopes of the dispersion surfaces are reciprocal to the eigenvalues.

math.AP↗

arXiv2022

Mathematical theory for electromagnetic scattering resonances and field enhancement in a subwavelength annular gap

This work presents a mathematical theory for electromagnetic scattering resonances in a subwavelength annular hole embedded in a metallic slab, with the annulus width $h\ll1$. The model is representative among many 3D subwavelength hole structures, which are able to induce resonant scattering of electromagnetic wave and the so-called extraordinary optical transmission. We develop a multiscale framework for the underlying scattering problem based upon a combination of the integral equation in the exterior domain and the waveguide mode expansion inside the tiny hole. The matching of the electromagnetic field over the hole aperture leads to a sequence of decoupled infinite systems, which are used to set up the resonance conditions for the scattering problem. By performing rigorous analysis for the infinite systems and the resonance conditions, we characterize all the resonances in a bounded domain over the complex plane. It is shown that the resonances are associated with the TE and TEM waveguide modes in the annular hole, and they are close to the real axis with the imaginary parts of order ${\cal O}(h)$. We also investigate the resonant scattering when an incident wave is present. It is proved that the electromagnetic field is amplified with order ${\cal O}(1/h)$ at the resonant frequencies that are associated with the TE modes in the annular hole. On the other hand, one particular resonance associated with the TEM mode can not be excited by a plane wave but can be excited with a near-field electric dipole source, leading to field enhancement of order ${\cal O}(1/h)$.

math-ph↗

arXiv2022

Randomized spectral co-clustering for large-scale directed networks

Directed networks are broadly used to represent asymmetric relationships among units. Co-clustering aims to cluster the senders and receivers of directed networks simultaneously. In particular, the well-known spectral clustering algorithm could be modified as the spectral co-clustering to co-cluster directed networks. However, large-scale networks pose great computational challenges to it. In this paper, we leverage sketching techniques and derive two randomized spectral co-clustering algorithms, one \emph{random-projection-based} and the other \emph{random-sampling-based}, to accelerate the co-clustering of large-scale directed networks. We theoretically analyze the resulting algorithms under two generative models -- the stochastic co-block model and the degree-corrected stochastic co-block model, and establish their approximation error rates and misclustering error rates, indicating better bounds than the state-of-the-art results of co-clustering literature. Numerically, we design and conduct simulations to support our theoretical results and test the efficiency of the algorithms on real networks with up to millions of nodes. A publicly available R package \textsf{RandClust} is developed for better usability and reproducibility of the proposed methods.

stat.ML↗

arXiv2022

A measurement decoupling based fast algorithm for super-resolving point sources with multi-cluster structure

We consider the problem of resolving closely spaced point sources in one dimension from their Fourier data in a bounded domain. Classical subspace methods (e.g., MUSIC algorithm, Matrix Pencil method, etc.) show great superiority in resolving closely spaced sources, but their computational cost is usually heavy. This is especially the case for point sources with a multi-cluster structure which requires processing large-sized data matrix resulted from highly sampled measurements. To address this issue, we propose a fast algorithm termed D-MUSIC, based on a measurement decoupling strategy. We demonstrate theoretically that for point sources with a known cluster structure, their measurement can be decoupled into local measurements of each of the clusters by solving a system of linear equations that are obtained by using a multipole basis. We further develop a subsampled MUSIC algorithm to detect the cluster structure and utilize it to decouple the global measurement. In the end, the MUSIC algorithm was applied to each local measurement to resolve point sources therein. Compared to the standard MUSIC algorithm, the proposed algorithm has comparable super-resolving capability while having a much lower computational complexity.

eess.SP↗

arXiv2022

Randomized Spectral Clustering in Large-Scale Stochastic Block Models

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we study the spectral clustering using randomized sketching algorithms from a statistical perspective, where we typically assume the network data are generated from a stochastic block model that is not necessarily of full rank. To do this, we first use the recently developed sketching algorithms to obtain two randomized spectral clustering algorithms, namely, the random projection-based and the random sampling-based spectral clustering. Then we study the theoretical bounds of the resulting algorithms in terms of the approximation error for the population adjacency matrix, the misclassification error, and the estimation error for the link probability matrix. It turns out that, under mild conditions, the randomized spectral clustering algorithms lead to the same theoretical bounds as those of the original spectral clustering algorithm. We also extend the results to degree-corrected stochastic block models. Numerical experiments support our theoretical findings and show the efficiency of randomized methods. A new R package called Rclust is developed and made available to the public.

cs.SI↗

arXiv2021

Differentially Private SGD with Non-Smooth Losses

In this paper, we are concerned with differentially private {stochastic gradient descent (SGD)} algorithms in the setting of stochastic convex optimization (SCO). Most of the existing work requires the loss to be Lipschitz continuous and strongly smooth, and the model parameter to be uniformly bounded. However, these assumptions are restrictive as many popular losses violate these conditions including the hinge loss for SVM, the absolute loss in robust regression, and even the least square loss in an unbounded domain. We significantly relax these restrictive assumptions and establish privacy and generalization (utility) guarantees for private SGD algorithms using output and gradient perturbations associated with non-smooth convex losses. Specifically, the loss function is relaxed to have an $α$-Hölder continuous gradient (referred to as $α$-Hölder smoothness) which instantiates the Lipschitz continuity ($α=0$) and the strong smoothness ($α=1$). We prove that noisy SGD with $α$-Hölder smooth losses using gradient perturbation can guarantee $(ε,δ)$-differential privacy (DP) and attain optimal excess population risk $\mathcal{O}\Big(\frac{\sqrt{d\log(1/δ)}}{nε}+\frac{1}{\sqrt{n}}\Big)$, up to logarithmic terms, with the gradient complexity $ \mathcal{O}( n^{2-α\over 1+α}+ n).$ This shows an important trade-off between $α$-Hölder smoothness of the loss and the computational complexity for private SGD with statistically optimal performance. In particular, our results indicate that $α$-Hölder smoothness with $α\ge {1/2}$ is sufficient to guarantee $(ε,δ)$-DP of noisy SGD algorithms while achieving optimal excess risk with the linear gradient complexity $\mathcal{O}(n).$

stat.ML↗

arXiv2021

Global Guidance Network for Breast Lesion Segmentation in Ultrasound Images

Automatic breast lesion segmentation in ultrasound helps to diagnose breast cancer, which is one of the dreadful diseases that affect women globally. Segmenting breast regions accurately from ultrasound image is a challenging task due to the inherent speckle artifacts, blurry breast lesion boundaries, and inhomogeneous intensity distributions inside the breast lesion regions. Recently, convolutional neural networks (CNNs) have demonstrated remarkable results in medical image segmentation tasks. However, the convolutional operations in a CNN often focus on local regions, which suffer from limited capabilities in capturing long-range dependencies of the input ultrasound image, resulting in degraded breast lesion segmentation accuracy. In this paper, we develop a deep convolutional neural network equipped with a global guidance block (GGB) and breast lesion boundary detection (BD) modules for boosting the breast ultrasound lesion segmentation. The GGB utilizes the multi-layer integrated feature map as a guidance information to learn the long-range non-local dependencies from both spatial and channel domains. The BD modules learn additional breast lesion boundary map to enhance the boundary quality of a segmentation result refinement. Experimental results on a public dataset and a collected dataset show that our network outperforms other medical image segmentation methods and the recent semantic segmentation methods on breast ultrasound lesion segmentation. Moreover, we also show the application of our network on the ultrasound prostate segmentation, in which our method better identifies prostate regions than state-of-the-art networks.

eess.IV↗

arXiv2021

Mathematical Theory of Computational Resolution Limit in Multi-dimensions

Resolving a linear combination of point sources from their band-limited Fourier data is a fundamental problem in imaging and signal processing. With the incomplete Fourier data and the inevitable noise in the measurement, there is a fundamental limit on the separation distance between point sources that can be resolved. This is the so-called resolution limit problem. Characterization of this resolution limit is still a long-standing puzzle despite the prevalent use of the classic Rayleigh limit. It is well-known that Rayleigh limit is heuristic and its drawbacks become prominent when dealing with data that is subjected to delicate processing, as is what modern computational imaging methods do. Therefore, more precise characterization of the resolution limit becomes increasingly necessary with the development of data processing methods. For this purpose, we developed a theory of "computational resolution limit" for both number detection and support recovery in one dimension in [arXiv:2003.02917[cs.IT], arXiv:1912.05430[eess.IV]]. In this paper, we extend the one-dimensional theory to multi-dimensions. More precisely, we define and quantitatively characterize the "computational resolution limit" for the number detection and support recovery problems in a general k-dimensional space. Our results indicate that there exists a phase transition phenomenon regarding to the super-resolution factor and the signal-to-noise ratio in each of the two recovery problems. Our main results are derived using a subspace projection strategy. Finally, to verify the theory, we proposed deterministic subspace projection based algorithms for the number detection and support recovery problems in dimension two and three. The numerical results confirm the phase transition phenomenon predicted by the theory.

eess.IV↗

arXiv2021

Mathematical theory for topological photonic materials in one dimension

This work presents a rigorous theory for topological photonic materials in one dimension. The main focus is on the existence and stability of interface modes that are induced by topological properties of the bulk structure. For a general 1D photonic structure with time-reversal symmetry, the associated Zak phase (or Berry phase) may not be quantized. We investigate the existence of an interface mode which is induced by a Dirac point upon perturbation. Specifically, we establish conditions on the perturbation which guarantee the opening of a band gap around the Dirac point and the existence of an interface mode. For a periodic photonic structure with both time-reversal and inversion symmetry, the Zak phase is quantized, taking only two values $0, π$. We show that the Zak phase is determined by the parity (even or odd) of the Bloch modes at the band edges. For a photonic structure consisting of two semi-infinite systems on the two sides of an interface with distinct topological indices, we show the existence of an interface mode inside the common gap. The stability of the mode under perturbations is also investigated. Finally, we study resonances for finite topological structures. Our results are based on the transfer matrix method and the oscillation theory for Sturm-Liouville operators. The methods and results can be extended to general topological Sturm-Liouville systems in one dimension.

math-ph↗

arXiv2021

A mathematical theory of computational resolution limit in one dimension

Given an image generated by the convolution of point sources with a band-limited function, the deconvolution problem is to reconstruct the source number, positions, and amplitudes. This problem arises from many important applications in imaging and signal processing. It is well-known that it is impossible to resolve the sources when they are close enough in practice. Rayleigh investigated this problem and formulated a resolution limit, the so-called Rayleigh limit, for the case of two sources with identical amplitudes. On the other hand, many numerical experiments demonstrate that a stable recovery of the sources is possible even if the sources are separated below the Rayleigh limit. In this paper, a mathematical theory for the deconvolution problem in one dimension is developed. The theory addresses the issue when one can recover the source number exactly from noisy data. The key is a new concept "computational resolution limit" which is defined to be the minimum separation distance between the sources such that exact recovery of the source number is possible. This new resolution limit is determined by the signal-to-noise ratio and the sparsity of sources, in addition to the cutoff frequency of the image. Quantitative bounds for this limit is derived, which reveal the importance of the sparsity as well as the signal-to-noise ratio to the recovery problem. The stability for recovering the source positions is also analyzed under a condition on their separation distances. Moreover, a singular-value-thresholding algorithm is proposed to recover the source number of a cluster of closely spaced point sources and to verify our theoretical results on the computational resolution limit. The results are based on a multipole expansion method and a non-linear approximation theory in Vandermonde space.

eess.IV↗

arXiv2020

A Theory of Computational Resolution Limit for Line Spectral Estimation

Line spectral estimation is a classical signal processing problem that aims to estimate the line spectra from their signal which is contaminated by deterministic or random noise. Despite a large body of research on this subject, the theoretical understanding of this problem is still elusive. In this paper, we introduce and quantitatively characterize the two resolution limits for the line spectral estimation problem under deterministic noise: one is the minimum separation distance between the line spectra that is required for exact detection of their number, and the other is the minimum separation distance between the line spectra that is required for a stable recovery of their supports. The quantitative results imply a phase transition phenomenon in each of the two recovery problems, and also the subtle difference between the two. We further propose a sweeping singular-value-thresholding algorithm for the number detection problem and conduct numerical experiments. The numerical results confirm the phase transition phenomenon in the number detection problem.

cs.IT↗

arXiv2020

A mathematical theory for Fano resonance in a periodic array of narrow slits

This work concerns resonant scattering by a perfectly conducting slab with periodically arranged subwavelength slits, with two slits per period. There are two classes of resonances, corresponding to poles of a scattering problem. A sequence of resonances has an imaginary part that is nonzero and on the order of the width $\varepsilon$ of the slits; these are associated with Fabry-Perot resonance, with field enhancement of order $1/\varepsilon$ in the slits. The focus of this study is another class of resonances which become real valued at normal incidence, when the Bloch wavenumber $κ$ is zero. These are embedded eigenvalues of the scattering operator restricted to a period cell, and the associated eigenfunctions extend to surface waves of the slab that lie within the radiation continuum. When $0<|κ|\ll 1$, the real embedded eigenvalues will be perturbed as complex-valued resonances, which induce the Fano resonance phenomenon. We derive the asymptotic expansions of embedded eigenvalues and their perturbations as resonances when the Bloch wavenumber becomes nonzero. Based on the quantitative analysis of the diffracted field, we prove that the Fano-type anomalies occurs for the transmission of energy through the slab, and show that the field enhancement is of order $1/(κ\varepsilon)$, which is stronger than Fabry-Perot resonance.

math.AP↗

arXiv2020

Fano resonance in metallic grating via strongly coupled subwavelength resonators

We investigate the Fano resonance in grating structures by using coupled resonators. The grating consists of a perfectly conducting slab with periodically arranged subwavelength slit holes, where inside each period, a pair of slits sit very close to each other. The slit holes act as resonators and are strongly coupled. It is shown rigorously that there exist two groups of resonances corresponding to poles of the scattering problem. One sequence of resonances have imaginary part on the order of $\varepsilon$, where $\varepsilon$ is the size of the slit aperture, while the other sequence have imaginary part on the order of $\varepsilon^2$. When coupled with the incident wave at resonant frequencies, the narrow-band resonant scattering induced by the latter will interfere with the broader background resonant radiation induced by the former. The interference of these two resonances generates the Fano type transmission anomaly, which persists in the whole radiation continuum of the grating structure as long as the slit aperture size is small compared to the incident wavelength.

math.AP↗

arXiv2020

A super-resolution imaging approach via subwavelength hole resonances

This work presents a new super-resolution imaging approach by using subwavelength hole resonances. We employ a subwavelength structure in which an array of tiny holes are etched in a metallic slab with the neighboring distance $\ell$ that is smaller than half of the wavelength. By tuning the incident wave at resonant frequencies, the subwavelength structure generates strong illumination patterns that are able to probe both low and high spatial frequency components of the imaging sample sitting above the structure. The image of the sample is obtained by performing stable numerical reconstruction from the far-field measurement of the diffracted wave. It is demonstrated that a resolution of $\ell/2$ can be obtained for reconstructed images, thus one can achieve super-resolution by arranging multiple holes within one wavelength. The proposed approach may find applications in wave-based imaging such as electromagnetic and ultrasound imaging. It attains two advantages that are important for practical realization. It avoids the difficulty to control the distance the between the probe and the sample surface with high precision. In addition, the numerical reconstructed images are very stable against noise by only using the low frequency band of the far-field data in the numerical reconstruction.

physics.optics↗

arXiv2020

Sensitivity of resonance frequency in the detection of thin layer using nano-slit structures

We derive the formulas for the resonance frequencies and their sensitivity when the nano-slit structures are used in the detection of thin layers. For a thin layer with a thickness of $H$ deposited over the nanostructure, we show quantitatively that for both single and periodic slit structures with slit aperture size $δ$, the sensitivity of resonance frequency reduces as $H$ increases. Specifically, the sensitivity is of order $O(δ/H)$ if $H >δ$ and of order $O(1+\ln H/δ)$ otherwise. The evanescent wave modes are present along the interface between the thin dielectric film and ambient medium above. From the mathematical derivations, it is observed that the sensitivity of the resonance frequency highly depends on the effect of evanescent wave modes on the tiny slit apertures.

physics.class-ph↗

arXiv2019

Differentially Private Precision Matrix Estimation

In this paper, we study the problem of precision matrix estimation when the dataset contains sensitive information. In the differential privacy framework, we develop a differentially private ridge estimator by perturbing the sample covariance matrix. Then we develop a differentially private graphical lasso estimator by using the alternating direction method of multipliers (ADMM) algorithm. The theoretical results and empirical results that show the utility of the proposed methods are also provided.

stat.ML↗

arXiv2019

Differential Privacy for Sparse Classification Learning

In this paper, we present a differential privacy version of convex and nonconvex sparse classification approach. Based on alternating direction method of multiplier (ADMM) algorithm, we transform the solving of sparse problem into the multistep iteration process. Then we add exponential noise to stable steps to achieve privacy protection. By the property of the post-processing holding of differential privacy, the proposed approach satisfies the $ε-$differential privacy even when the original problem is unstable. Furthermore, we present the theoretical privacy bound of the differential privacy classification algorithm. Specifically, the privacy bound of our algorithm is controlled by the algorithm iteration number, the privacy parameter, the parameter of loss function, ADMM pre-selected parameter, and the data size. Finally we apply our framework to logistic regression with $L_1$ regularizer and logistic regression with $L_{1/2}$ regularizer. Numerical studies demonstrate that our method is both effective and efficient which performs well in sensitive data analysis.

stat.ML↗

arXiv2019

Retinal Vessels Segmentation Based on Dilated Multi-Scale Convolutional Neural Network

Accurate segmentation of retinal vessels is a basic step in Diabetic retinopathy(DR) detection. Most methods based on deep convolutional neural network (DCNN) have small receptive fields, and hence they are unable to capture global context information of larger regions, with difficult to identify lesions. The final segmented retina vessels contain more noise with low classification accuracy. Therefore, in this paper, we propose a DCNN structure named as D-Net. In the proposed D-Net, the dilation convolution is used in the backbone network to obtain a larger receptive field without losing spatial resolution, so as to reduce the loss of feature information and to reduce the difficulty of tiny thin vessels segmentation. The large receptive field can better distinguished between the lesion area and the blood vessel area. In the proposed Multi-Scale Information Fusion module (MSIF), parallel convolution layers with different dilation rates are used, so that the model can obtain more dense feature information and better capture retinal vessel information of different sizes. In the decoding module, the skip layer connection is used to propagate context information to higher resolution layers, so as to prevent low-level information from passing the entire network structure. Finally, our method was verified on DRIVE, STARE and CHASE dataset. The experimental results show that our network structure outperforms some state-of-art method, such as N4-fields, U-Net, and DRIU in terms of accuracy, sensitivity, specificity, and AUCROC. Particularly, D-Net outperforms U-Net by 1.04%, 1.23% and 2.79% in DRIVE, STARE, and CHASE three dataset, respectively.

cs.CV↗