arXiv subjects

Sheng Xu

Publications and source records attributed to Sheng Xu.

At least 109 records · Page 6Linked to original sources

arXiv2023

Dynamic brain spectrum acquired by a real-time ultra-spectral imaging chip with reconfigurable metasurfaces

Spectral imaging paves way for various fields and particular in biomedical research. However, spectral imaging mainly depending on spatial or temporal scanning, cannot achieve high temporal, spatial and spectral resolution simultaneously. In this study, we demonstrated a silicon real-time ultra-spectral imaging chip based on reconfigurable metasurfaces, comprising of 155,216 (356$\times$436) image-adaptive micro-spectrometers with ultra-high center-wavelength accuracy of 0.04 nm and spectral resolution of 0.8 nm. It is employed for imaging brain hemodynamics, and the dynamic spectral absorption properties of deoxyhemoglobin and oxyhemoglobin in a rat barrel cortex were obtained, which enlighten the spectroscopy in vivo studies and other real-time applications.

physics.optics↗

arXiv2023

The early stage of the interaction between a planar shock and a cylindrical droplet considering cavitation effects: theoretical analysis and numerical simulation

The interaction between planar shock waves and droplets, involved the evolution of high transient unsteady wave structures and the induced cavitation process, occurs widely in nature and industry. In this paper, a combination of theoretical analysis and high-resolution numerical simulation is employed to study the inherent characteristics of the interaction. A multi-component two-phase compressible flow model, coupled with the phase transition procedure, is used to capture the spatiotemporal evolution of wave structures and cavitation behaviours, including the inception, growth and collapse of cavitation. The ray analysis method is appended to the interaction, and the evolution of wave structures are characterized by the motion of a series of rays, whose emission angle is correlated to a dimensionless wave speed, the ratio of the transmitted shock velocity and incident shock velocity. Under the influence of cylindrical droplet curvature, those rays focus inside the droplet. The present study theoretically predicts the focusing position for the first time, determined by the dimensionless wave speed, and the theoretical analysis is well consistent with numerical results. Due to the significant difference in the properties between the upper and lower branches of the second reflected wave, a high-transient pressure region is observed and its position is clarified. Numerical results show that if the incident shock wave intensity is high enough, the focusing zone of the reflected expansion wave can be identified as a cavity inside the droplet. Furthermore, the cavitation zone is enlarged, and the stronger collapsing waves are induced by increasing the incident shock wave intensity.

physics.flu-dyn↗

arXiv2023

Resilient Binary Neural Network

Binary neural networks (BNNs) have received ever-increasing popularity for their great capability of reducing storage burden as well as quickening inference time. However, there is a severe performance drop compared with real-valued networks, due to its intrinsic frequent weight oscillation during training. In this paper, we introduce a Resilient Binary Neural Network (ReBNN) to mitigate the frequent oscillation for better BNNs' training. We identify that the weight oscillation mainly stems from the non-parametric scaling factor. To address this issue, we propose to parameterize the scaling factor and introduce a weighted reconstruction loss to build an adaptive training objective. For the first time, we show that the weight oscillation is controlled by the balanced parameter attached to the reconstruction loss, which provides a theoretical foundation to parameterize it in back propagation. Based on this, we learn our ReBNN by calculating the balanced parameter based on its maximum magnitude, which can effectively mitigate the weight oscillation with a resilient training process. Extensive experiments are conducted upon various network models, such as ResNet and Faster-RCNN for computer vision, as well as BERT for natural language processing. The results demonstrate the overwhelming performance of our ReBNN over prior arts. For example, our ReBNN achieves 66.9% Top-1 accuracy with ResNet-18 backbone on the ImageNet dataset, surpassing existing state-of-the-arts by a significant margin. Our code is open-sourced at https://github.com/SteveTsui/ReBNN.

cs.LG↗

arXiv2022

Rubidium Focused Ion Beam Induced Platinum Deposition

This work presents characterization of focused ion beam induced deposition (FIBID) of platinum using both rubidium and gallium ions. Under similar beam energies, 8.5 keV for Rb$^+$ and 8.0 keV for Ga$^+$, and beam current near 10 pA, the two ion species deposited Pt films at similar rates. Energy-dispersive x-ray spectroscopy shows that the Rb$^+$ FIBID-Pt consists of similar Pt contents with much lower primary ion contents (5% Rb and 27% Ga) than the Ga$^+$ FIBID-Pt. The deposited material was also measured to have a resistivity of $8.1\times 10^4$ $\mathrm{μΩ\cdot cm}$ for the Rb$^+$ FIBID-Pt and $5.7\times 10^3$ $\mathrm{μΩ\cdot cm}$ for the Ga$^+$ FIBID-Pt.

physics.app-ph↗

arXiv2022

Collage: Seamless Integration of Deep Learning Backends with Automatic Placement

The strong demand for efficient and performant deployment of Deep Learning (DL) applications prompts the rapid development of a rich DL ecosystem. To keep up with this fast advancement, it is crucial for modern DL frameworks to efficiently integrate a variety of optimized tensor algebra libraries and runtimes as their backends and generate the fastest possible executable using these backends. However, current DL frameworks require significant manual effort and expertise to integrate every new backend while failing to unleash its full potential. Given the fast-evolving nature of the DL ecosystem, this manual approach often slows down continuous innovations across different layers; it prevents hardware vendors from the fast deployment of their cutting-edge libraries, DL framework developers must repeatedly adjust their hand-coded rules to accommodate new versions of libraries, and machine learning practitioners need to wait for the integration of new technologies and often encounter unsatisfactory performance. In this paper, we propose Collage, a DL framework that offers seamless integration of DL backends. Collage provides an expressive backend registration interface that allows users to precisely specify the capability of various backends. By leveraging the specifications of available backends, Collage automatically searches for an optimized backend placement strategy for a given workload and execution environment. Our evaluation shows that Collage outperforms the best existing framework for each hardware by $1.26\times$, $1.43\times$, $1.40\times$ on average on NVIDIA's RTX 2070 GPU, V100 GPU, and Intel's Xeon 8259CL CPU, respectively. Collage has been open-sourced and deployed in Apache TVM.

cs.LG↗

arXiv2022

Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformer

The large pre-trained vision transformers (ViTs) have demonstrated remarkable performance on various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. Among the powerful compression approaches, quantization extremely reduces the computation and memory consumption by low-bit parameters and bit-wise operations. However, low-bit ViTs remain largely unexplored and usually suffer from a significant performance drop compared with the real-valued counterparts. In this work, through extensive empirical analysis, we first identify the bottleneck for severe performance drop comes from the information distortion of the low-bit quantized self-attention map. We then develop an information rectification module (IRM) and a distribution guided distillation (DGD) scheme for fully quantized vision transformers (Q-ViT) to effectively eliminate such distortion, leading to a fully quantized ViTs. We evaluate our methods on popular DeiT and Swin backbones. Extensive experimental results show that our method achieves a much better performance than the prior arts. For example, our Q-ViT can theoretically accelerates the ViT-S by 6.14x and achieves about 80.9% Top-1 accuracy, even surpassing the full-precision counterpart by 1.0% on ImageNet dataset. Our codes and models are attached on https://github.com/YanjingLi0202/Q-ViT

cs.CV↗

arXiv2022

Distance Map Supervised Landmark Localization for MR-TRUS Registration

In this work, we propose to explicitly use the landmarks of prostate to guide the MR-TRUS image registration. We first train a deep neural network to automatically localize a set of meaningful landmarks, and then directly generate the affine registration matrix from the location of these landmarks. For landmark localization, instead of directly training a network to predict the landmark coordinates, we propose to regress a full-resolution distance map of the landmark, which is demonstrated effective in avoiding statistical bias to unsatisfactory performance and thus improving performance. We then use the predicted landmarks to generate the affine transformation matrix, which outperforms the clinicians' manual rigid registration by a significant margin in terms of TRE.

cs.CV↗

arXiv2022

IDa-Det: An Information Discrepancy-aware Distillation for 1-bit Detectors

Knowledge distillation (KD) has been proven to be useful for training compact object detection models. However, we observe that KD is often effective when the teacher model and student counterpart share similar proposal information. This explains why existing KD methods are less effective for 1-bit detectors, caused by a significant information discrepancy between the real-valued teacher and the 1-bit student. This paper presents an Information Discrepancy-aware strategy (IDa-Det) to distill 1-bit detectors that can effectively eliminate information discrepancies and significantly reduce the performance gap between a 1-bit detector and its real-valued counterpart. We formulate the distillation process as a bi-level optimization formulation. At the inner level, we select the representative proposals with maximum information discrepancy. We then introduce a novel entropy distillation loss to reduce the disparity based on the selected proposals. Extensive experiments demonstrate IDa-Det's superiority over state-of-the-art 1-bit detectors and KD methods on both PASCAL VOC and COCO datasets. IDa-Det achieves a 76.9% mAP for a 1-bit Faster-RCNN with ResNet-18 backbone. Our code is open-sourced on https://github.com/SteveTsui/IDa-Det.

cs.CV↗

arXiv2022

Maximum likelihood for high-noise group orbit estimation and single-particle cryo-EM

Motivated by applications to single-particle cryo-electron microscopy (cryo-EM), we study several problems of function estimation in a high noise regime, where samples are observed after random rotation and possible linear projection of the function domain. We describe a stratification of the Fisher information eigenvalues according to transcendence degrees of graded pieces of the algebra of group invariants, and we relate critical points of the log-likelihood landscape to a sequence of moment optimization problems, extending previous results for a discrete rotation group without projections. We then compute the transcendence degrees and forms of these optimization problems for several examples of function estimation under $SO(2)$ and $SO(3)$ rotations, including a simplified model of cryo-EM as introduced by Bandeira, Blum-Smith, Kileel, Perry, Weed, and Wein. We affirmatively resolve conjectures that $3^\text{rd}$-order moments are sufficient to locally identify a generic signal up to its rotational orbit in these examples. For low-dimensional approximations of the electric potential maps of two small protein molecules, we empirically verify that the noise-scalings of the Fisher information eigenvalues conform with our theoretical predictions over a range of SNR, in a model of $SO(3)$ rotations without projections.

math.ST↗

arXiv2022

Two-Stage Maximum Score Estimator

This paper considers the asymptotic theory of a semiparametric M-estimator that is generally applicable to models that satisfy a monotonicity condition in one or several parametric indexes. We call the estimator two-stage maximum score (TSMS) estimator since our estimator involves a first-stage nonparametric regression when applied to the binary choice model of Manski (1975, 1985). We characterize the asymptotic distribution of the TSMS estimator, which features phase transitions depending on the dimension and thus the convergence rate of the first-stage estimation. Effectively, the first-stage nonparametric estimator serves as an imperfect smoothing function on a non-smooth criterion function, leading to the pivotality of the first-stage estimation error with respect to the second-stage convergence rate and asymptotic distribution

econ.EM↗

arXiv2022

An Improved Lightweight YOLOv5 Model Based on Attention Mechanism for Face Mask Detection

Coronavirus 2019 has brought severe challenges to social stability and public health worldwide. One effective way of curbing the epidemic is to require people to wear masks in public places and monitor mask-wearing states by utilizing suitable automatic detectors. However, existing deep learning based models struggle to simultaneously achieve the requirements of both high precision and real-time performance. To solve this problem, we propose an improved lightweight face mask detector based on YOLOv5, which can achieve an excellent balance of precision and speed. Firstly, a novel backbone ShuffleCANet that combines ShuffleNetV2 network with Coordinate Attention mechanism is proposed as the backbone. Afterwards, an efficient path aggression network BiFPN is applied as the feature fusion neck. Furthermore, the localization loss is replaced with alpha-CIoU in model training phase to obtain higher-quality anchors. Some valuable strategies such as data augmentation, adaptive image scaling, and anchor cluster operation are also utilized. Experimental results on AIZOO face mask dataset show the superiority of the proposed model. Compared with the original YOLOv5, the proposed model increases the inference speed by 28.3% while still improving the precision by 0.58%. It achieves the best mean average precision of 95.2% compared with other seven existing models, which is 4.4% higher than the baseline.

cs.CV↗

arXiv2022

Recurrent Bilinear Optimization for Binary Neural Networks

Binary Neural Networks (BNNs) show great promise for real-world embedded devices. As one of the critical steps to achieve a powerful BNN, the scale factor calculation plays an essential role in reducing the performance gap to their real-valued counterparts. However, existing BNNs neglect the intrinsic bilinear relationship of real-valued weights and scale factors, resulting in a sub-optimal model caused by an insufficient training process. To address this issue, Recurrent Bilinear Optimization is proposed to improve the learning process of BNNs (RBONNs) by associating the intrinsic bilinear variables in the back propagation process. Our work is the first attempt to optimize BNNs from the bilinear perspective. Specifically, we employ a recurrent optimization and Density-ReLU to sequentially backtrack the sparse real-valued weight filters, which will be sufficiently trained and reach their performance limits based on a controllable learning process. We obtain robust RBONNs, which show impressive performance over state-of-the-art BNNs on various models and datasets. Particularly, on the task of object detection, RBONNs have great generalization performance. Our code is open-sourced on https://github.com/SteveTsui/RBONN .

cs.CV↗

arXiv2022

TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline

Transparent objects are common in our daily life and frequently handled in the automated production line. Robust vision-based robotic grasping and manipulation for these objects would be beneficial for automation. However, the majority of current grasping algorithms would fail in this case since they heavily rely on the depth image, while ordinary depth sensors usually fail to produce accurate depth information for transparent objects owing to the reflection and refraction of light. In this work, we address this issue by contributing a large-scale real-world dataset for transparent object depth completion, which contains 57,715 RGB-D images from 130 different scenes. Our dataset is the first large-scale, real-world dataset that provides ground truth depth, surface normals, transparent masks in diverse and cluttered scenes. Cross-domain experiments show that our dataset is more general and can enable better generalization ability for models. Moreover, we propose an end-to-end depth completion network, which takes the RGB image and the inaccurate depth map as inputs and outputs a refined depth map. Experiments demonstrate superior efficacy, efficiency and robustness of our method over previous works, and it is able to process images of high resolutions under limited hardware resources. Real robot experiments show that our method can also be applied to novel transparent object grasping robustly. The full dataset and our method are publicly available at www.graspnet.net/transcg

cs.RO↗

arXiv2022

Genome-wide nucleotide-resolution model of single-strand break site reveals species evolutionary hierarchy

Single-strand breaks (SSBs) are the major DNA damage in the genome arising spontaneously as the outcome of genotoxins and intermediates of DNA transactions. SSBs play a crucial role in various biological processes and show a non-random distribution in the genome. Several SSB detection approaches such as S1 END-seq and SSiNGLe-ILM emerged to characterize the genomic landscape of SSB with nucleotide resolution. However, these sequencing-based methods are costly and unfeasible for large-scale analysis of diverse species. Thus, we proposed the first computational approach, SSBlazer, which is an explainable and scalable deep learning framework for genome-wide nucleotide-resolution SSB site prediction. We demonstrated that SSBlazer can accurately predict SSB sites and sufficiently alleviate false positives by constructing an imbalanced dataset to simulate the realistic SSB distribution. The model interpretation analysis reveals that SSBlazer captures the pattern of individual CpG in genomic context and the motif of TGCC in the center region as critical features. Besides, SSBlazer is a lightweight model with robust cross-species generalization ability in the cross-species evaluation, which enables the large-scale genome-wide application in diverse species. Strikingly, the putative SSB genomic landscapes of 216 vertebrates reveal a negative correlation between SSB frequency and evolutionary hierarchy, suggesting that the genome tends to be integrity during evolution.

q-bio.GN↗

arXiv2022

Investigation of Rb$^+$ Milling Rates using an Ultracold Focused Ion Beam

Several ion source alternatives for current focused ion beam (FIB) systems have been studied to achieve higher brightness, including cold atom ion sources. However, a study of ultracold ions interacting with often used materials is seldom reported. Here we investigate milling on several typical samples in a prototype ultracold Rb FIB system at 8.5 keV beam energy. For polycrystalline metallic substrates, such as Cu and Au, patterns milled by Rb$^+$ ions are observed to have reduced surface roughness, but still high milling rates compared with those milled by Ga$^+$ ions. Rb$^+$ also shows similar sputter rates as 30 keV Ga$^+$ on semiconductor substrates GaAs and InP. Special cases for Rb$^+$ milling show that the Rb$^+$ ion beam has a $2.6 \times$ faster sputter rate on diamond but a $3 \times$ slower sputter rate on Al compared with a normal 30 keV Ga$^+$ ion beam. Generally, a Rb$^+$ ion beam is shown to be suitable for nanostructuring of several basic materials.

physics.app-ph↗

arXiv2022

Critical behavior in the Mn$_{5}$Ge$_{3}$ ferromagnet

High-Curie-temperature ferromagnets are promising candidates for designing new spintronic devices. Here we have successfully synthesized a single-crystal sample of the itinerant ferromagnet Mn$ _{5}$Ge$_{3}$ used flux method and its critical properties were investigated by means of bulk dc-magnetization at the boundary between the ferromagnetic (FM) and paramagnetic (PM) phase. Critical exponents $ β=0.336 \pm 0.001 $ with a critical temperature $ T_{c}=300.29 \pm 0.01 $ K and $ γ=1.193 \pm 0.003 $ with $ T_{c} = 300.15 \pm 0.05 $ K are obtained by the modified Arrott plot, whereas $ δ= 4.61 \pm 0.03 $ is deduced by a critical isotherm analysis at $ T_{c} = 300 $ K. The self-consistency and reliability of these critical exponents are verified by the Widom scaling law and the scaling equations. Further analysis reveals that the spin coupling in Mn$ _{5}$Ge$_{3}$ exhibits three-dimensional Ising-like behavior. The magnetic exchange is found to decay as $ J(r)\approx r^{-4.855} $ and the spin interactions are extended beyond the nearest neighbors, which may be related to different set of Mn--Mn interactions with unequal magnitude of exchange strengths. Additionally, the existence of noncollinear spin configurations in Mn$ _{5} $Ge$ _{3} $ results in a small deviation of obtained critical exponents from those for standard 3D-Ising model.

cond-mat.mtrl-sci↗

arXiv2022

Quantum oscillations and weak anisotropic resistivity in the chiral Fermion semimetal PdGa

We perform a detailed analysis of the magnetotransport and de Haas-van Alphen (dHvA) oscillations in crystal PdGa which is predicted to be a typical chiral Fermion semimetal from CoSi family holding a large Chern number. The unsaturated quadratic magnetoresistance (MR) and nonlinear Hall resistivity indicate that PdGa is a multi-band system without electron-hole compensation. Angle-dependent resistivity in PdGa shows weak anisotropy with twofold or threefold symmetry when the magnetic field rotates within the (1$\bar{1}$0) or (111) plane perpendicular to the current. Nine or three frequencies are extracted after the fast Fourier-transform analysis (FFT) of the dHvA oscillations with B//[001] or B//[011], respectively, which is confirmed to be consistent with the Fermi surfaces (FSs) obtained from first-principles calculations with spin-orbit coupling (SOC) considered.

cond-mat.mtrl-sci↗

arXiv2022

Realization of A Strong Ferroelectric Metal by Nb-doping in Strained EuTiO$_{3}$

Ferroelectric (FE) metals have been attracting attention as they possess both metallicity and ferroelectricity, the two seemingly incompatible physical properties. An important problem for both fundamental research and potential applications is how to realize a strong FE metal. One strategy is to dope a strong FE insulator into an FE metal provided that the induced free electrons do not destroy FE distortion. Strained EuTiO$_{3}$ film is a strong FE ferromagnet and a promising candidate for such a strategy. Here, we calculate the structural, electronic, and polarization properties of Nb-doped strained EuTiO$_{3}$ film using the hybrid density-functional theory. The results show that the strained EuTi$_{0.875}$Nb$_{0.125}$O$_{3}$ film is a strong FE metal as the Nb doping induces metallicity without weakening the FE distortion. The underlying atomistic mechanism of the coexistence of metallicity and strong ferroelectricity is discussed. The findings show that combining doping and strain engineering is a promising way to realize new EuTiO$_{3}$-based strong FE metals and may be used in other materials as well.

cond-mat.mtrl-sci↗