arXiv subjects

Yifan Yang

Publications and source records attributed to Yifan Yang.

At least 343 records · Page 19Linked to original sources

arXiv2021

Lifelong Learning based Disease Diagnosis on Clinical Notes

Current deep learning based disease diagnosis systems usually fall short in catastrophic forgetting, i.e., directly fine-tuning the disease diagnosis model on new tasks usually leads to abrupt decay of performance on previous tasks. What is worse, the trained diagnosis system would be fixed once deployed but collecting training data that covers enough diseases is infeasible, which inspires us to develop a lifelong learning diagnosis system. In this work, we propose to adopt attention to combine medical entities and context, embedding episodic memory and consolidation to retain knowledge, such that the learned model is capable of adapting to sequential disease-diagnosis tasks. Moreover, we establish a new benchmark, named Jarvis-40, which contains clinical notes collected from various hospitals. Our experiments show that the proposed method can achieve state-of-the-art performance on the proposed benchmark.

cs.AI↗

arXiv2020

Study of using machine learning for level 1 trigger decision in JUNO experiment

A study on the use of a machine learning algorithm for the level 1 trigger decision in the JUNO experiment ispresented. JUNO is a medium baseline neutrino experiment in construction in China, with the main goal of determining the neutrino mass hierarchy. A large liquid scintillator (LS)volume will detect the electron antineutrinos issued from nuclear reactors. The LS detector is instrumented by around 20000 large photomultiplier tubes. The hit information from each PMT will be collected into a center trigger unit for the level 1 trigger decision. The current trigger algorithm used to select a neutrino signal event is based on a fast vertex reconstruction. We propose to study an alternative level 1 (L1) trigger in order to achieve a similar performance as the vertex fitting trigger but with less logic resources by using firmware implemented machine learning model at the L1 trigger level. We treat the trigger decision as a classification problem and train a Multi-Layer Perceptron (MLP)model to distinguish the signal events with an energy higher than a certain threshold from noise events. We use JUNO software to generate datasets which include 100K physics events with noise and 100K pure noise events coming from PMT dark noise.For events with energy higher than 100 keV, the L1 trigger based on the converged MLP model can achieve an efficiency higher than 99%. After the training performed on simulations,we successfully implemented the trained model into a Kintex 7FPGA. We present the technical details of the neural network development and training, as well as its implementation in the hardware with the FPGA programming. Finally the performance of the L1 trigger MLP implementation is discussed.

physics.ins-det↗

arXiv2020

Automatic test system of the back-end card for the JUNO experiment

The Jiangmen Underground Neutrino Observatory (JUNO) is a medium-baseline neutrino experiment under construction in China, with the goal to determine the neutrino mass hierarchy. The JUNO electronics readout system consists of an underwater front-end electronics system and an outside-water back-end electronics system. These two parts are connected by 100-meter Ethernet cables and power cables. The back-end card (BEC) is the part of the JUNO electronics readout system used to link the underwater boxes to the trigger system is connected to transmit the system clock and triggered signals. Each BEC is connected to 48 underwater boxes, and in total around 150 BECs are needed. It is essential to verify the physical layer links before applying real connection with the underwater system. Therefore, our goal is to build an automatic test system to check the physical link performance. The test system is based on a custom designed FPGA board, in order to make the design general, only JTAG is used as the interface to the PC. The system can generate and check different data pattern at different speeds for 96 channels simultaneously. The test results of 1024 continuously clock cycles are automatically uploaded to PC periodically. We describe the setup of the automatic test system of the BEC and present the latest test results.

physics.ins-det↗

arXiv2020

Modular units and cuspidal divisor classes on $X_0(n^2M)$ with $n|24$ and $M$ squarefree

For a positive integer $N$, let $\mathscr C(N)$ be the subgroup of $J_0(N)$ generated by the equivalence classes of cuspidal divisors of degree $0$ and $\mathscr C(N)(\mathbb Q):=\mathscr C(N)\cap J_0(N)(\mathbb Q)$ be its $\mathbb Q$-rational subgroup. Let also $\mathscr C_{\mathbb Q}(N)$ be the subgroup of $\mathscr C(N)(\mathbb Q)$ generated by $\mathbb Q$-rational cuspidal divisors. We prove that when $N=n^2M$ for some integer $n$ dividing $24$ and some squarefree integer $M$, the two groups $\mathscr C(N)(\mathbb Q)$ and $\mathscr C_{\mathbb Q}(N)$ are equal. To achieve this, we show that all modular units on $X_0(N)$ on such $N$ are products of functions of the form $η(mτ+k/h)$, $mh^2|N$ and $k\in\mathbb Z$ and determine the necessary and sufficient conditions for products of such functions to be modular units on $X_0(N)$.

math.NT↗

arXiv2020

Experiments of Federated Learning for COVID-19 Chest X-ray Images

AI plays an important role in COVID-19 identification. Computer vision and deep learning techniques can assist in determining COVID-19 infection with Chest X-ray Images. However, for the protection and respect of the privacy of patients, the hospital's specific medical-related data did not allow leakage and sharing without permission. Collecting such training data was a major challenge. To a certain extent, this has caused a lack of sufficient data samples when performing deep learning approaches to detect COVID-19. Federated Learning is an available way to address this issue. It can effectively address the issue of data silos and get a shared model without obtaining local data. In the work, we propose the use of federated learning for COVID-19 data training and deploy experiments to verify the effectiveness. And we also compare performances of four popular models (MobileNet, ResNet18, MoblieNet, and COVID-Net) with the federated learning framework and without the framework. This work aims to inspire more researches on federated learning about COVID-19.

eess.IV↗

arXiv2020

COVID-19 Public Opinion and Emotion Monitoring System Based on Time Series Thermal New Word Mining

With the spread and development of new epidemics, it is of great reference value to identify the changing trends of epidemics in public emotions. We designed and implemented the COVID-19 public opinion monitoring system based on time series thermal new word mining. A new word structure discovery scheme based on the timing explosion of network topics and a Chinese sentiment analysis method for the COVID-19 public opinion environment is proposed. Establish a "Scrapy-Redis-Bloomfilter" distributed crawler framework to collect data. The system can judge the positive and negative emotions of the reviewer based on the comments, and can also reflect the depth of the seven emotions such as Hopeful, Happy, and Depressed. Finally, we improved the sentiment discriminant model of this system and compared the sentiment discriminant error of COVID-19 related comments with the Jiagu deep learning model. The results show that our model has better generalization ability and smaller discriminant error. We designed a large data visualization screen, which can clearly show the trend of public emotions, the proportion of various emotion categories, keywords, hot topics, etc., and fully and intuitively reflect the development of public opinion.

cs.IR↗

arXiv2020

Ramanujan-type $1/π$-series from bimodular forms

We develop an approach to establish $1/π$-series from bimodular forms. Utilizing this approach, we obtain new families of $2$-variable $1/π$-series associated to Zagier's sporadic Apery-like sequences.

math.NT↗

arXiv2020

Synetgy: Algorithm-hardware Co-design for ConvNet Accelerators on Embedded FPGAs

Using FPGAs to accelerate ConvNets has attracted significant attention in recent years. However, FPGA accelerator design has not leveraged the latest progress of ConvNets. As a result, the key application characteristics such as frames-per-second (FPS) are ignored in favor of simply counting GOPs, and results on accuracy, which is critical to application success, are often not even reported. In this work, we adopt an algorithm-hardware co-design approach to develop a ConvNet accelerator called Synetgy and a novel ConvNet model called DiracDeltaNet$^{\dagger}$. Both the accelerator and ConvNet are tailored to FPGA requirements. DiracDeltaNet, as the name suggests, is a ConvNet with only $1\times 1$ convolutions while spatial convolutions are replaced by more efficient shift operations. DiracDeltaNet achieves competitive accuracy on ImageNet (88.7\% top-5), but with 42$\times$ fewer parameters and 48$\times$ fewer OPs than VGG16. We further quantize DiracDeltaNet's weights to 4-bit and activations to 4-bits, with less than 1\% accuracy loss. These quantizations exploit well the nature of FPGA hardware. In short, DiracDeltaNet's small model size, low computational OP count, low precision and simplified operators allow us to co-design a highly customized computing unit for an FPGA. We implement the computing units for DiracDeltaNet on an Ultra96 SoC system through high-level synthesis. Our accelerator's final top-5 accuracy of 88.1\% on ImageNet, is higher than all the previously reported embedded FPGA accelerators. In addition, the accelerator reaches an inference speed of 66.3 FPS on the ImageNet classification task, surpassing prior works with similar accuracy by at least 11.6$\times$.

cs.CV↗

arXiv2020

The smallest parts function associated with $ω(q)$

We establish two families of congruences modulo powers of 5 for the Fourier coefficients of $(2E_2(2τ)-E_2(τ))η(2τ)^{-1}$, where $E_2(τ)$ is the weight 2 Eisenstein series and $η(τ)$ is the Dedekind eta function. This allows us to prove similar congruences for two smallest parts functions. The first function is $\mathrm{spt}_ω(n)$, which was introduced by Andrews, Dixit and Yee and associated with Ramanujan/Watson's third order mock theta function $ω(q)$. The second one is $\mathrm{spt}_{C5}(n)$, which appeared in the work of Garvan and Jennings-Shaffer. Moreover, we confirm two conjectural congruences of Wang.

math.NT↗

arXiv2020

Moments of ranks and cranks, and Quotients of Eisenstein Series and the Dedekind Eta Function

Atkin and Garvan introduced the functions $N_k(n)$ and $M_k(n)$, which denote the $k$-th moments of ranks and cranks in the theory of partitions. Let $e_{2r}(n)$ be the $n$-th Fourier coefficient of $E_{2r}(τ)/η(τ)$, where $E_{2r}(τ)$ is the classical Eisenstein series of weight $2r$ and $η(τ)$ is the Dedekind eta function. Via the theory of quasi-modular forms, we find that for $k \leq 5$, $N_k(n)$ and $M_k(n)$ can be expressed using $e_{2r}(n)$ ($2\leq r \leq k$), $p(n)$ and $N_2(n)$. For $k>5$, additional functions are required for such expressions. For $r\in \{2, 3, 4, 5, 7\}$, by studying the action of Hecke operators on $E_{2r}(τ)/η(τ)$, we provide explicit congruences modulo arbitrary powers of primes for $e_{2r}(n)$. Moreover, for $\ell \in \{5, 7, 11, 13\}$ and any $k\geq 1$, we present uniform methods for finding nice representations for $\sum_{n=0}^\infty e_{2r}\left(\frac{\ell^{k}n+1}{24}\right)q^n$, which work for every $r\geq 2$. These representations allow us to prove congruences modulo powers of $\ell$, and we have done so for $e_4(n)$ and $e_6(n)$ as examples. Based on the congruences satisfied by $e_{2r}(n)$, we establish congruences modulo arbitrary powers of $\ell$ for the moments and symmetrized moments of ranks and cranks as well as higher order $\mathrm{spt}$-functions.

math.NT↗

arXiv2020

A New Unified Deep Learning Approach with Decomposition-Reconstruction-Ensemble Framework for Time Series Forecasting

A new variational mode decomposition (VMD) based deep learning approach is proposed in this paper for time series forecasting problem. Firstly, VMD is adopted to decompose the original time series into several sub-signals. Then, a convolutional neural network (CNN) is applied to learn the reconstruction patterns on the decomposed sub-signals to obtain several reconstructed sub-signals. Finally, a long short term memory (LSTM) network is employed to forecast the time series with the decomposed sub-signals and the reconstructed sub-signals as inputs. The proposed VMD-CNN-LSTM approach is originated from the decomposition-reconstruction-ensemble framework, and innovated by embedding the reconstruction, single forecasting, and ensemble steps in a unified deep learning approach. To verify the forecasting performance of the proposed approach, four typical time series datasets are introduced for empirical analysis. The empirical results demonstrate that the proposed approach outperforms consistently the benchmark approaches in terms of forecasting accuracy, and also indicate that the reconstructed sub-signals obtained by CNN is of importance for further improving the forecasting performance.

stat.ML↗

arXiv2020

Water affects morphogenesis of growing aquatic plant leaves

Lotus leaves floating on water usually experience short-wavelength edge wrinkling that decays toward the center, while the leaves growing above water normally morph into a global bending cone shape with long rippled waves near the edge. Observations suggest that the underlying water (liquid substrate) significantly affects the morphogenesis of leaves. To understand the biophysical mechanism under such phenomena, we develop mathematical models that can effectively account for inhomogeneous differential growth of floating and free-standing leaves, to quantitatively predict formation and evolution of their morphology. We find, both theoretically and experimentally, that the short-wavelength buckled configuration is energetically favorable for growing membranes lying on liquid, while the global buckling shape is more preferable for suspended ones. Other influencing factors such as stem/vein, heterogeneity and dimension are also investigated. Our results provide a fundamental insight into a variety of plant morphogenesis affected by water foundation and suggest that such surface instabilities can be harnessed for morphology control of biomimetic deployable structures using substrate or edge actuation.

cond-mat.soft↗

arXiv2019

GRID: a Student Project to Monitor the Transient Gamma-Ray Sky in the Multi-Messenger Astronomy Era

The Gamma-Ray Integrated Detectors (GRID) is a space mission concept dedicated to monitoring the transient gamma-ray sky in the energy range from 10 keV to 2 MeV using scintillation detectors onboard CubeSats in low Earth orbits. The primary targets of GRID are the gamma-ray bursts (GRBs) in the local universe. The scientific goal of GRID is, in synergy with ground-based gravitational wave (GW) detectors such as LIGO and VIRGO, to accumulate a sample of GRBs associated with the merger of two compact stars and study jets and related physics of those objects. It also involves observing and studying other gamma-ray transients such as long GRBs, soft gamma-ray repeaters, terrestrial gamma-ray flashes, and solar flares. With multiple CubeSats in various orbits, GRID is unaffected by the Earth occultation and serves as a full-time and all-sky monitor. Assuming a horizon of 200 Mpc for ground-based GW detectors, we expect to see a few associated GW-GRB events per year. With about 10 CubeSats in operation, GRID is capable of localizing a faint GRB like 170817A with a 90% error radius of about 10 degrees, through triangulation and flux modulation. GRID is proposed and developed by students, with considerable contribution from undergraduate students, and will remain operated as a student project in the future. The current GRID collaboration involves more than 20 institutes and keeps growing. On August 29th, the first GRID detector onboard a CubeSat was launched into a Sun-synchronous orbit and is currently under test.

astro-ph.IM↗

arXiv2019

Maximal abelian extension of $X_0(p)$ unramified outside cusps

Let $p$ be a prime number. Mazur proved that a geometrically maximal unramified abelian covering of $X_0(p)$ over $\mathbb Q$ is given by the Shimura covering $X_2(p) \to X_0(p)$, that is, a unique subcovering of $X_1(p) \to X_0(p)$ of degree $N_p := (p-1)/\gcd(p-1, 12)$. In this short paper, we show that a geometrically maximal abelian covering $X_2'(p) \to X_0(p)$ of $X_0(p)$ over $\mathbb Q$ unramified outside cusps is cyclic of degree $2N_p$. The main ingredient for the construction of $X_2'(p)$ is the generalized Dedelind eta functions.

math.NT↗

arXiv2019

TAPESTRY: A Blockchain based Service for Trusted Interaction Online

We present a novel blockchain based service for proving the provenance of online digital identity, exposed as an assistive tool to help non-expert users make better decisions about whom to trust online. Our service harnesses the digital personhood (DP); the longitudinal and multi-modal signals created through users' lifelong digital interactions, as a basis for evidencing the provenance of identity. We describe how users may exchange trust evidence derived from their DP, in a granular and privacy-preserving manner, with other users in order to demonstrate coherence and longevity in their behaviour online. This is enabled through a novel secure infrastructure combining hybrid on- and off-chain storage combined with deep learning for DP analytics and visualization. We show how our tools enable users to make more effective decisions on whether to trust unknown third parties online, and also to spot behavioural deviations in their own social media footprints indicative of account hijacking.

cs.CR↗

arXiv2019

Feature Pyramid Hashing

In recent years, deep-networks-based hashing has become a leading approach for large-scale image retrieval. Most deep hashing approaches use the high layer to extract the powerful semantic representations. However, these methods have limited ability for fine-grained image retrieval because the semantic features extracted from the high layer are difficult in capturing the subtle differences. To this end, we propose a novel two-pyramid hashing architecture to learn both the semantic information and the subtle appearance details for fine-grained image search. Inspired by the feature pyramids of convolutional neural network, a vertical pyramid is proposed to capture the high-layer features and a horizontal pyramid combines multiple low-layer features with structural information to capture the subtle differences. To fuse the low-level features, a novel combination strategy, called consensus fusion, is proposed to capture all subtle information from several low-layers for finer retrieval. Extensive evaluation on two fine-grained datasets CUB-200-2011 and Stanford Dogs demonstrate that the proposed method achieves significant performance compared with the state-of-art baselines.

cs.CV↗

arXiv2019

Deep Policy Hashing Network with Listwise Supervision

Deep-networks-based hashing has become a leading approach for large-scale image retrieval, which learns a similarity-preserving network to map similar images to nearby hash codes. The pairwise and triplet losses are two widely used similarity preserving manners for deep hashing. These manners ignore the fact that hashing is a prediction task on the list of binary codes. However, learning deep hashing with listwise supervision is challenging in 1) how to obtain the rank list of whole training set when the batch size of the deep network is always small and 2) how to utilize the listwise supervision. In this paper, we present a novel deep policy hashing architecture with two systems are learned in parallel: a query network and a shared and slowly changing database network. The following three steps are repeated until convergence: 1) the database network encodes all training samples into binary codes to obtain a whole rank list, 2) the query network is trained based on policy learning to maximize a reward that indicates the performance of the whole ranking list of binary codes, e.g., mean average precision (MAP), and 3) the database network is updated as the query network. Extensive evaluations on several benchmark datasets show that the proposed method brings substantial improvements over state-of-the-art hashing methods.

cs.CV↗

arXiv2019

Investigation of $cs\bar c\bar s$ tetraquark in the chiral quark model

Inspired by the recent observation of exotic resonances $X(4140)$, $X(4274)$, $X(4350)$, $X(4500)$ and $X(4700)$ reported by several experiment collaborations, we investigated the four-quark system $cs\bar c\bar s$ with quantum numbers $J^{PC}=1^{++}$ and $0^{++}$ in the framework of the chiral quark model. Two configurations, diquark-antidiquark and meson-meson, with all possible color structures are considered. The results show that no molecular state can be formed, but the resonance may exist if the color structure of meson-meson configuration is $8\otimes8$. In the present calculation, the $X(4274)$ can be assigned as the $cs\bar c\bar s$ tetraquark states with $J^{PC}=1^{++}$, but the energy of $X(4140)$ is too low to be regarded as the tetraquark state. $X(4350)$ can be a good candidate of compact tetraquark state with $J^{PC}=0^{++}$. When the radial excitation is taken into account, the $X(4700)$ can be explained as the $2S$ radial excited tetraquark state with $J^{PC}=0^{++}$. As for $X(4500)$, there is no matching state in our calculation.

hep-ph↗