arXiv subjects

Jun Zhou

Publications and source records attributed to Jun Zhou.

At least 379 records · Page 21Linked to original sources

arXiv2022

Deep Learning-based Protoacoustic Signal Denoising for Proton Range Verification

Objective: Proton therapy offers an advantageous dose distribution compared to the photon therapy, since it deposits most of the energy at the end of range, namely the Bragg peak (BP). Protoacoustic technique was developed to in vivo determine the BP locations. However, it requires large dose delivery to the tissue to obtain an averaged acoustic signal with a sufficient signal to noise ratio (SNR), which is not suitable in clinics. We propose a deep learning-based technique to acquire denoised acoustic signals and reduce BP range uncertainty with much lower doses. Approach: Three accelerometers were placed on the distal surface of a cylindrical polyethylene (PE) phantom to collect protoacoustic signals. In total 512 raw signals were collected at each device. Device-specific stack autoencoder (SAE) denoising models were trained to denoise the input signals, which were generated by averaging 1, 2, 4, 8, 16, or 32 raw signals. Both supervised and unsupervised learning training strategies were tested for comparison. Mean squared error (MSE), signal-to-noise ratio (SNR) and the Bragg peak (BP) range uncertainty were used for model evaluation. Main results: After SAE denoising, the MSE was substantially reduced, and the SNR was enhanced. Overall, the supervised SAEs outperformed the unsupervised SAEs in BP range verification. For the high accuracy detector, it achieved a BP range uncertainty of 0.20 +/- 3.44 mm by averaging over 8 raw signals, while for the other two low accuracy detectors, they achieved the BP uncertainty of 1.44 +/- 6.45 mm and -0.23 +/- 4.88 mm by averaging 16 raw signals, respectively. Significance: We have proposed a deep learning based denoising method to enhance the SNR of protoacoustic measurements and improve the accuracy in BP range verification, which greatly reduces the dose and time for potential clinical applications.

physics.med-ph↗

arXiv2022

Early in vivo Radiation Damage Quantification for Pediatric Craniospinal Irradiation Using Longitudinal MRI for Intensity Modulated Proton Therapy

Purpose: Proton vertebral body sparing craniospinal irradiation (VBS CSI) treats the thecal sac while avoiding the anterior vertebral bodies in effort to reduce myelosuppression and growth inhibition. However, robust treatment planning needs to compensate proton range uncertainty, contributing unwanted doses within the vertebral bodies. This work aims to develop an early in vivo radiation damage quantification method using longitudinal magnetic resonance (MR) scans to quantify dose effect during fractionated CSI. Materials and methods: Ten pediatric patients were enrolled in a prospective clinical trial of proton VBS CSI receiving 23.4-36 Gy. Monte Carlo robust planning was used with spinal clinical target volumes defined as the thecal sac and neural foramina. T1/T2-weighted MR scans were acquired before, during, and after treatments to detect transition from hematopoietic to less metabolically active fatty marrow. MR signal intensity histograms at each time point were analyzed and fitted by multi-Gaussian models to quantify radiation damages. Results: Fatty marrow filtration was observed on MR images as early as the fifth fraction of treatment. Maximum radiation-induced marrow damage occurred 40-50 days from the treatment start, followed by marrow regeneration. The mean damage ratios were 0.23, 0.41, 0.59, and 0.54 corresponding to 10, 20, 40, and 60 days from the treatment start. Conclusions: We demonstrated a non-invasive method to identify early vertebral marrow damage based on radiation-induced fatty marrow replacement. The proposed method can be potentially used to quantify the quality of CSI vertebral sparing to preserve metabolically active hematopoietic bone marrow.

physics.med-ph↗

arXiv2022

Low Latency Conversion of Artificial Neural Network Models to Rate-encoded Spiking Neural Networks

Spiking neural networks (SNNs) are well suited for resource-constrained applications as they do not need expensive multipliers. In a typical rate-encoded SNN, a series of binary spikes within a globally fixed time window is used to fire the neurons. The maximum number of spikes in this time window is also the latency of the network in performing a single inference, as well as determines the overall energy efficiency of the model. The aim of this paper is to reduce this while maintaining accuracy when converting ANNs to their equivalent SNNs. The state-of-the-art conversion schemes yield SNNs with accuracies comparable with ANNs only for large window sizes. In this paper, we start with understanding the information loss when converting from pre-existing ANN models to standard rate-encoded SNN models. From these insights, we propose a suite of novel techniques that together mitigate the information lost in the conversion, and achieve state-of-art SNN accuracies along with very low latency. Our method achieved a Top-1 SNN accuracy of 98.73% (1 time step) on the MNIST dataset, 76.38% (8 time steps) on the CIFAR-100 dataset, and 93.71% (8 time steps) on the CIFAR-10 dataset. On ImageNet, an SNN accuracy of 75.35%/79.16% was achieved with 100/200 time steps.

cs.NE↗

arXiv2022

Deep learning-based Fast Volumetric Image Generation for Image-guided Proton FLASH Radiotherapy

Proton FLASH therapy leverages ultra-high dose-rate radiation to enhance the sparing of organs at risk without compromising tumor control probability. To prepare for the delivery of high doses to targets, we aim to develop a deep learning-based image-guide framework to enable fast volumetric image reconstruction for accurate target localization before FLSAH beam delivery. The proposed framework comprises four modules, including orthogonal kV x-ray projection acquisition, DL-based volumetric image generation, image quality analyses, and water equivalent thickness evaluation. We investigated volumetric image reconstruction using four kV projection pairs with different source angles. Thirty lung patients were identified from the institutional database, and each patient contains a four-dimensional computed tomography dataset with ten respiratory phases. The retrospective patient study indicated that the proposed framework could reconstruct patient volumetric anatomy, including tumors and organs at risk from orthogonal x-ray projections. Considering all evaluation metrics, the kV projections with source angles of 135 and 225 degrees yielded the optimal volumetric images. The proposed framework has been demonstrated to reconstruct volumetric images with accurate lesion locations from two orthogonal x-ray projections. The embedded WET module can be used to detect potential proton beam-specific patient anatomy variations. The framework can deliver fast volumetric image generation and can potentially guide treatment delivery systems for proton FLASH therapy.

physics.med-ph↗

arXiv2022

A Practical Distributed ADMM Solver for Billion-Scale Generalized Assignment Problems

Assigning items to owners is a common problem found in various real-world applications, for example, audience-channel matching in marketing campaigns, borrower-lender matching in loan management, and shopper-merchant matching in e-commerce. Given an objective and multiple constraints, an assignment problem can be formulated as a constrained optimization problem. Such assignment problems are usually NP-hard, so when the number of items or the number of owners is large, solving for exact solutions becomes challenging. In this paper, we are interested in solving constrained assignment problems with hundreds of millions of items. Thus, with just tens of owners, the number of decision variables is at billion-scale. This scale is usually seen in the internet industry, which makes decisions for large groups of users. We relax the possible integer constraint, and formulate a general optimization problem that covers commonly seen assignment problems. Its objective function is convex. Its constraints are either linear, or convex and separable by items. We study to solve our generalized assignment problems in the Bregman Alternating Direction Method of Multipliers (BADMM) framework where we exploit Bregman divergence to transform the Augmented Lagrangian into a separable form, and solve many subproblems in parallel. The entire solution can thus be implemented using a MapReduce-style distributed computation framework. We present experiment results on both synthetic and real-world datasets to verify its accuracy and scalability.

cs.DS↗

arXiv2022

GraTO: Graph Neural Network Framework Tackling Over-smoothing with Neural Architecture Search

Current Graph Neural Networks (GNNs) suffer from the over-smoothing problem, which results in indistinguishable node representations and low model performance with more GNN layers. Many methods have been put forward to tackle this problem in recent years. However, existing tackling over-smoothing methods emphasize model performance and neglect the over-smoothness of node representations. Additional, different approaches are applied one at a time, while there lacks an overall framework to jointly leverage multiple solutions to the over-smoothing challenge. To solve these problems, we propose GraTO, a framework based on neural architecture search to automatically search for GNNs architecture. GraTO adopts a novel loss function to facilitate striking a balance between model performance and representation smoothness. In addition to existing methods, our search space also includes DropAttribute, a novel scheme for alleviating the over-smoothing challenge, to fully leverage diverse solutions. We conduct extensive experiments on six real-world datasets to evaluate GraTo, which demonstrates that GraTo outperforms baselines in the over-smoothing metrics and achieves competitive performance in accuracy. GraTO is especially effective and robust with increasing numbers of GNN layers. Further experiments bear out the quality of node representations learned with GraTO and the effectiveness of model architecture. We make cide of GraTo available at Github (\url{https://github.com/fxsxjtu/GraTO}).

cs.LG↗

arXiv2022

Emergent Topological Superconductor by Charge Density Wave Transition

Many-body instabilities and topological physics are two attractive topics in condensed matter physics. It is intriguing to explore the interplay between these phenomena in a single quantum material. Here, using the prototypical charge density wave (CDW) material monolayer 1H-NbSe$_2$ as an example, we show how momentum-dependent electron-phonon coupling drives the CDW transition from $3\times3$ to $2\times2$ phase under electron doping. More interestingly, we find the coexistence of superconductivity and nontrivial topology in one of the two $2\times2$ CDW phases, the latter of which is identified by the nonzero Z$_2$ invariant with ideal Dirac cone edge states near the Fermi level. A similar CDW transition-induced topological superconductor has also been confirmed in monolayer 1H-TaSe$_2$. Our findings not only reveal a unique and general method to introduce nontrivial topology by CDW transition, but also provide an ideal platform to modulate different quantum orders by electron doping, thus stimulating experimental interest.

cond-mat.supr-con↗

arXiv2022

PP-StructureV2: A Stronger Document Analysis System

A large amount of document data exists in unstructured form such as raw images without any text information. Designing a practical document image analysis system is a meaningful but challenging task. In previous work, we proposed an intelligent document analysis system PP-Structure. In order to further upgrade the function and performance of PP-Structure, we propose PP-StructureV2 in this work, which contains two subsystems: Layout Information Extraction and Key Information Extraction. Firstly, we integrate Image Direction Correction module and Layout Restoration module to enhance the functionality of the system. Secondly, 8 practical strategies are utilized in PP-StructureV2 for better performance. For Layout Analysis model, we introduce ultra light-weight detector PP-PicoDet and knowledge distillation algorithm FGD for model lightweighting, which increased the inference speed by 11 times with comparable mAP. For Table Recognition model, we utilize PP-LCNet, CSP-PAN and SLAHead to optimize the backbone module, feature fusion module and decoding module, respectively, which improved the table structure accuracy by 6\% with comparable inference speed. For Key Information Extraction model, we introduce VI-LayoutXLM which is a visual-feature independent LayoutXLM architecture, TB-YX sorting algorithm and U-DML knowledge distillation algorithm, which brought 2.8\% and 9.1\% improvement respectively on the Hmean of Semantic Entity Recognition and Relation Extraction tasks. All the above mentioned models and code are open-sourced in the GitHub repository PaddleOCR.

cs.CV↗

arXiv2022

MRI-based Material Mass Density and Relative Stopping Power Estimation via Deep Learning for Proton Therapy

Magnetic Resonance Imaging (MRI) is increasingly incorporated into treatment planning, because of its superior soft tissue contrast used for tumor and soft tissue delineation versus computed tomography (CT). However, MRI cannot directly provide mass density or relative stopping power (RSP) maps required for proton radiotherapy dose calculation. To demonstrate the feasibility of MRI-only based mass density and RSP estimation using deep learning (DL) for proton radiotherapy. A DL-based framework was developed to discover underlying voxel-wise correlation between MR images and mass density and RSP. Five tissue substitute phantoms including skin, muscle, adipose, 45% hydroxyapatite (HA), and spongiosa bone were customized for MRI scanning based on material composition information from ICRP reports. Two animal tissue phantoms made of pig brain and liver were prepared for DL training. In the phantom study, two DL models were trained: one containing clinical T1 and T2 MRIs and another incorporating zero echo time (ZTE) MRIs as input. In the patient application study, two DL models were trained: one including T1 and T2 MRIs as input, and one incorporating synthetic dual-energy computed tomography (sDECT) images to provide bone tissue information. In the phantom study, DL model based on T1 and T2 MRI demonstrated higher accuracy mass density and RSP estimation in skin, muscle, adipose, brain, and liver with mean absolute percentage errors (MAPE) of 0.42%, 0.14%, 0.19%, 0.78% and 0.26% for mass density and 0.30%, 0.11%, 0.16%, 0.61% and 0.23% for RSP, respectively. DL model incorporating ZTE MRI improved the accuracy of mass density and RSP estimation in 45% HA and spongiosa bone with MAPE at 0.23% and 0.09% for mass density and 0.19% and 0.07% for RSP, respectively. Results show feasibility of MRI-only based mass density and RSP estimation for proton therapy treatment planning using DL method.

physics.med-ph↗

arXiv2022

Feasibility Study of Hybrid Inverse Planning with Transmission Beams and Single-energy Spread-out Bragg Peaks for Proton Flash Radiotherapy

Ultra-high dose rate (FLASH) proton planning with only transmission beams (TBs) has limitations in normal tissue sparing. The single-energy spread-out Bragg peaks (SESOBPs) of FLASH dose rate have been demonstrated feasible for proton FLASH planning. A hybrid inverse optimization method was developed to combine the TBs and SESOBPs (TB-SESOBP) for FLASH planning. The SESOBPs were generated from spreading out the BPs by pre-designed general bar ridge filters and placed at the central target by range shifters to obtain a uniform dose within the target. The SESOBPs and TBs were fully sampled field-by-field allowing automatic spot selection and weighting in the optimization process. The TB-SESOBP plans were validated in comparison with the TB only (TB-only) plans and the plans with the combination of TBs and BPs (TB-BP) regarding 3D dose and dose rate distributions for five lung cases. Comparing to the TB-only plans, the mean spinal cord D1.2cc drastically reduced 41%, the mean lung V7Gy and V7.4Gy moderately reduced by up to 17% and the target dose homogeneity slightly increased in the TB-SESOBP plans. Comparable dose homogeneity was achieved in both TB-SESOBP and TB-BP plans. Besides, prominent improvements were achieved in lung sparing for the cases of relatively large targets by the TB-SESOBP plans comparing to the TB-BP plans. The targets were fully covered with the FLASH dose rate in all the three plans. For the OARs, V40Gy/s = 100% was achieved by the TB-only plans while V40Gy/s > 85% was obtained by the other two plans. We have demonstrated that the hybrid TB-SESOBP planning was feasible to achieve FLASH dose rate for proton therapy. The hybrid TB-SESOBP planning has great potential in improving OAR sparing while maintaining high target dose homogeneity, and can be potentially implemented for adaptive radiotherapy.

physics.med-ph↗

arXiv2022

Measurement of the time structure of FLASH beams using prompt gamma rays and secondary neutrons as surrogates

We aim to investigate the feasibility of online monitoring of irradiation time (IRT) and scan time for FLASH radiotherapy using a pixelated semiconductor detector. Measurements of the time structure of FLASH irradiations were performed using fast, pixelated spectral detectors, AdvaPIX-TPX3 and Minipix-TPX3. The latter has a fraction of its sensor coated with a neutron sensitive material. With little or no dead time and an ability to resolve events that are closely spaced in time (tens of ns), both detectors can accurately determine IRTs as long as pile-ups are avoided. To avoid pile-ups, we placed the detectors beyond the Bragg peak or at a large scattering angle. We acquired prompt gamma rays and secondary neutrons and calculated IRTs based on timestamps of the first (beam-on) and the last (beam-off) charged species. We also measured scan times in x, y, and diagonal directions. We performed these measurements for a single spot, a small animal field, a patient field, and a ridge filter optimized field to demonstrate in vivo online monitoring of IRT. All measurements were compared to vendor log files. Differences between measurements and log files for a single spot, a small animal field, and a patient field were within 1%, 0.3% and 1%, respectively. In vivo monitoring of IRTs was accurate within 0.1% for AdvaPIX-TPX3 and within 6.1% for Minipix-TPX3. The scan times in x, y, and diagonal directions were 4.0, 3.4, and 4.0 ms, respectively. Overall, the AdvaPIX-TPX3 can measure FLASH IRTs within 1% accuracy, indicating that prompt gamma rays are a good surrogate for primary protons. The Minipix-TPX3 showed a higher discrepancy, suggesting a need for further investigation. The scan times (3.4 \pm 0.05 ms) in the 60-mm distance of y-direction were less than (4.0 \pm 0.06 ms) in the 24-mm distance of x-direction, confirming the much faster scanning speed of the Y magnets than that of X.

physics.med-ph↗

arXiv2022

AHEAD: A Triple Attention Based Heterogeneous Graph Anomaly Detection Approach

Graph anomaly detection on attributed networks has become a prevalent research topic due to its broad applications in many influential domains. In real-world scenarios, nodes and edges in attributed networks usually display distinct heterogeneity, i.e. attributes of different types of nodes show great variety, different types of relations represent diverse meanings. Anomalies usually perform differently from the majority in various perspectives of heterogeneity in these networks. However, existing graph anomaly detection approaches do not leverage heterogeneity in attributed networks, which is highly related to anomaly detection. In light of this problem, we propose AHEAD: a heterogeneity-aware unsupervised graph anomaly detection approach based on the encoder-decoder framework. Specifically, for the encoder, we design three levels of attention, i.e. attribute level, node type level, and edge level attentions to capture the heterogeneity of network structure, node properties and information of a single node, respectively. In the decoder, we exploit structure, attribute, and node type reconstruction terms to obtain an anomaly score for each node. Extensive experiments show the superiority of AHEAD on several real-world heterogeneous information networks compared with the state-of-arts in the unsupervised setting. Further experiments verify the effectiveness and robustness of our triple attention, model backbone, and decoder in general.

cs.SI↗

arXiv2022

SO(3)-Pose: SO(3)-Equivariance Learning for 6D Object Pose Estimation

6D pose estimation of rigid objects from RGB-D images is crucial for object grasping and manipulation in robotics. Although RGB channels and the depth (D) channel are often complementary, providing respectively the appearance and geometry information, it is still non-trivial how to fully benefit from the two cross-modal data. From the simple yet new observation, when an object rotates, its semantic label is invariant to the pose while its keypoint offset direction is variant to the pose. To this end, we present SO(3)-Pose, a new representation learning network to explore SO(3)-equivariant and SO(3)-invariant features from the depth channel for pose estimation. The SO(3)-invariant features facilitate to learn more distinctive representations for segmenting objects with similar appearance from RGB channels. The SO(3)-equivariant features communicate with RGB features to deduce the (missed) geometry for detecting keypoints of an object with the reflective surface from the depth channel. Unlike most of existing pose estimation methods, our SO(3)-Pose not only implements the information communication between the RGB and depth channels, but also naturally absorbs the SO(3)-equivariance geometry knowledge from depth images, leading to better appearance and geometry representation learning. Comprehensive experiments show that our method achieves the state-of-the-art performance on three benchmarks.

cs.CV↗

arXiv2022

Decisive role of electron-phonon coupling for phonon and electron instabilities in transition metal dichalcogenides

The origin of the charge density wave (CDW) in transition metal dichalcognides has been in hot debate and no conclusive agreement has been reached. Here, we propose an ab-initio framework for an accurate description of both Fermi surface nesting and electron-phonon coupling (EPC) and systematically investigate their roles in the formation of CDW. Using monolayer 1H-NbSe$_2$ and 1T-VTe$_2$ as representative examples, we show that it is the momentum-dependent EPC softens the phonon frequencies, which become imaginary (phonon instabilities) at CDW vectors (indicating CDW formation). Besides, the distribution of the CDW gap opening (electron instabilities) can be correctly predicted only if EPC is included in the mean-field model. These results emphasize the decisive role of EPC in the CDW formation. Our analytical process is general and can be applied to other CDW systems.

cond-mat.mtrl-sci↗

arXiv2022

Abnormal Phonon Angular Momentum due to Off-diagonal Elements in Density Matrix induced by Temperature Gradient

Nonzero mean value of phonon angular momentum (PAM) in chiral materials can be generated when a temperature gradient is applied. We find that both diagonal and off-diagonal terms of PAM contribute to mean PAM by using the Kubo formula where both diagonal and off-diagonal elements of the heat current operator are considered. The calculation results show that the off-diagonal term is dominant when the phonon scattering is strong enough. This finding reveals that the quantum transition between different phonon modes induced by temperature gradient strongly affects the local atomic rotation. Our discovery provides an explanation of the recently observed chiral phonon activated spin Seebeck effect.

cond-mat.mes-hall↗

arXiv2022

Multimodal Imaging-based Material Mass Density Estimation for Proton Therapy Using Physics-Constrained Deep Learning

Mapping computed tomography (CT) number to material property dominates the proton range uncertainty. This work aims to develop a physics-constrained deep learning-based multimodal imaging (PDMI) framework to integrate physics, deep learning, magnetic resonance imaging (MRI), and advanced dual-energy CT (DECT) to derive accurate patient mass density maps. Seven tissue substitute MRI phantoms were used for PDMI-based material calibration. The training inputs are from MRI and twin-beam dual-energy images acquired at 120 kVp with gold and tin filters. The feasibility investigation included an empirical DECT correlation and four residual networks (ResNet) derived from different training inputs and strategies by the PDMI framework. PRN-MR-DE and RN-MR-DE denote ResNet trained with and without a physics constraint using MRI and DECT images. PRN-DE and RN-DE represent ResNet trained with and without a physics constraint using DECT-only images. For the tissue surrogate study, PRN-MR-DE, PRN-DE, and RN-MR-DE result in mean mass density errors: -0.72%, 2.62%, -3.58% for adipose; -0.03%, -0.61%, and -0.18% for muscle; -0.58%, -1.36%, and -4.86% for 45% HA bone. The retrospective patient study indicated that PRN-MR-DE predicted the densities of soft tissue and bone within expected intervals based on the literature survey, while PRN-DE generated large density deviations. The proposed PDMI framework can generate accurate mass density maps using MRI and DECT images. The physics-constrained training can further enhance model efficacy, making PRN-MR-DE outperform RN-MR-DE. The patient investigation also shows that the PDMI framework has the potential to improve proton range uncertainty with accurate patient mass density maps.

physics.med-ph↗

arXiv2022

Gaia: Graph Neural Network with Temporal Shift aware Attention for Gross Merchandise Value Forecast in E-commerce

E-commerce has gone a long way in empowering merchants through the internet. In order to store the goods efficiently and arrange the marketing resource properly, it is important for them to make the accurate gross merchandise value (GMV) prediction. However, it's nontrivial to make accurate prediction with the deficiency of digitized data. In this article, we present a solution to better forecast GMV inside Alipay app. Thanks to graph neural networks (GNN) which has great ability to correlate different entities to enrich information, we propose Gaia, a graph neural network (GNN) model with temporal shift aware attention. Gaia leverages the relevant e-seller' sales information and learn neighbor correlation based on temporal dependencies. By testing on Alipay's real dataset and comparing with other baselines, Gaia has shown the best performance. And Gaia is deployed in the simulated online environment, which also achieves great improvement compared with baselines.

cs.LG↗

arXiv2022

An Integrated Biological Optimization framework for proton SBRT FLASH treatment planning allows dose, dose rate, and LET optimization using patient-specific ridge filters

Purpose: Patient-specific ridge filters can modulate proton energy to obtain a conformal dose. We describe a new framework for optimization of filter design and spot maps to meet the unique demands of FLASH radiotherapy. We demonstrate an Integrated Biological Optimization IMPT (IBO-IMPT) approach for optimization of dose, dose-averaged dose rate (DADR), and dose-averaged LET (LETd). Methods: We developed inverse planning software to design patient-specific ridge filters that spread the Bragg peak from a fixed-energy, 250 MeV beam to a proximal beam-specific planning target volume. The software optimizes patient-specific ridge filter and uses a Monte Carlo calculation engine, based on Geant4, to provide dose and LET influence matrices. Plan optimization, using matRAD, accommodates the IBO-IMPT objective function considering dose, dose rate, and LET simultaneously with minimum MU constraints. The framework enables design of both regularly spaced and sparse-optimized ridge filters, which allow faster delivery and selective LET optimization. Volume distributions and histograms for dose, DADR, and LETd are compared using evaluation structures specific to the heart and lung. Results: We used IBO-IMPT to design ridge filters for a central lung tumor patient. The IBO-IMPT framework selectively spared heart and lung by reducing LET and increasing dose rate, relative to IMPT planning. Sparse-optimized ridge filters were superior to regularly spaced ridge filters in dose rate. Together, these innovations substantially increased the DADR in the heart and lung while maintaining good target coverage. The volume that received a FLASH dose rate of higher 40 Gy/second increased by 31% for heart and 50% for lung. Conclusion: This proof-of-concept study demonstrates the feasibility of using an IBO-IMPT framework to accomplish proton FLASH SBPT, accounting for dose, DADR, and LETd simultaneously.

physics.med-ph↗