arXiv Science⌕ Search

arXiv subjects

Min Zhang

Publications and source records attributed to Min Zhang.

At least 829 records · Page 46Linked to original sources

Jointly Learning Explainable Rules for Recommendation with Knowledge Graph

Explainability and effectiveness are two key aspects for building recommender systems. Prior efforts mostly focus on incorporating side information to achieve better recommendation performance. However, these methods have some weaknesses: (1) prediction of neural network-based embedding methods are hard to explain and debug; (2) symbolic, graph-based approaches (e.g., meta path-based models) require manual efforts and domain knowledge to define patterns and rules, and ignore the item association types (e.g. substitutable and complementary). In this paper, we propose a novel joint learning framework to integrate \textit{induction of explainable rules from knowledge graph} with \textit{construction of a rule-guided neural recommendation model}. The framework encourages two modules to complement each other in generating effective and explainable recommendation: 1) inductive rules, mined from item-centric knowledge graphs, summarize common multi-hop relational patterns for inferring different item associations and provide human-readable explanation for model prediction; 2) recommendation module can be augmented by induced rules and thus have better generalization ability dealing with the cold-start issue. Extensive experiments\footnote{Code and data can be found at: \url{https://github.com/THUIR/RuleRec}} show that our proposed method has achieved significant improvements in item recommendation over baselines on real-world datasets. Our model demonstrates robust performance over "noisy" item knowledge graphs, generated by linking item names to related entities.

cs.IR↗

3D quench modeling based on T-A formulation for high temperature superconductor CORC cables

High temperature superconductor (HTS) (RE)Ba2Cu3Ox (REBCO) conductor on round core cable (CORC) has high current carrying capacity for high field magnet and power applications. In REBCO CORC cables, current redistribution occurs among tapes through terminal contact resistances when a local quench occurs. Therefore, the quench behaviour of CORC cable is different from single tape situation, for it is significantly affected by terminal contact resistances. To better understand the underlying physical process of local quenches in CORC cables, a new 3D multi-physics modelling tool for CORC cables is developed and presented in this paper. In this model, the REBCO tape is treated as a thin shell without thickness, and four models are coupled: T-formulation model, A-formulation model, a heat transfer model and an equivalent circuit model. The current redistribution, temperature and tape voltage of CORC cable during hot spot induced quenches are analysed using this model. The results show that the thermal stability of CORC cable can be considerably improved by reducing terminal contact resistance. The minimum quench energy (MQE) increases rapidly with the reduction of terminal contact resistance when the resistance is in a middle range. When the terminal contact resistance is too low or too high, the MQE shows no obvious variation with terminal contact resistances. With a low terminal contact resistance, a hot spot in one tape may induce an over-current quench on the other tapes without hot spots. This will not happen in a cable with high terminal contact resistance. In this case, the tape with hot spot will quench and burn out before inducing a quench on other tapes. The modelling tool developed can be used to design CORC cables with improved thermal stability.

cond-mat.supr-con↗

A Novel Euler's Elastica based Segmentation Approach for Noisy Images via using the Progressive Hedging Algorithm

Euler's Elastica based unsupervised segmentation models have strong capability of completing the missing boundaries for existing objects in a clean image, but they are not working well for noisy images. This paper aims to establish a Euler's Elastica based approach that properly deals with random noises to improve the segmentation performance for noisy images. We solve the corresponding optimization problem via using the progressive hedging algorithm (PHA) with a step length suggested by the alternating direction method of multipliers (ADMM). Technically, all the simplified convex versions of the subproblems derived from the major framework of PHA can be obtained by using the curvature weighted approach and the convex relaxation method. Then an alternating optimization strategy is applied with the merits of using some powerful accelerating techniques including the fast Fourier transform (FFT) and generalized soft threshold formulas. Extensive experiments have been conducted on both synthetic and real images, which validated some significant gains of the proposed segmentation models and demonstrated the advantages of the developed algorithm.

cs.CV↗

Semi-supervised learning via Feedforward-Designed Convolutional Neural Networks

A semi-supervised learning framework using the feedforward-designed convolutional neural networks (FF-CNNs) is proposed for image classification in this work. One unique property of FF-CNNs is that no backpropagation is used in model parameters determination. Since unlabeled data may not always enhance semi-supervised learning, we define an effective quality score and use it to select a subset of unlabeled data in the training process. We conduct experiments on the MNIST, SVHN, and CIFAR-10 datasets, and show that the proposed semi-supervised FF-CNN solution outperforms the CNN trained by backpropagation (BP-CNN) when the amount of labeled data is reduced. Furthermore, we develop an ensemble system that combines the output decision vectors of different semi-supervised FF-CNNs to boost classification accuracy. The ensemble systems can achieve further performance gains on all three benchmarking datasets.

cs.CV↗

On a Diophantine equation with five prime variables

Let $[x]$ denote the integral part of the real number $x$, and $N$ be a sufficiently large integer. In this paper, it is proved that, for $1<c<\frac{4109054}{1999527}, c\not=2$, the Diophantine equation $N=[p_1^c]+[p_2^c]+[p_3^c]+[p_4^c]+[p_5^c]$ is solvable in prime variables $p_1,p_2,p_3,p_4,p_5$.

math.NT↗

Rethinking Interphase Representations for Modeling Viscoelastic Properties for Polymer Nanocomposites

Numerical modeling of viscoelastic properties is critical to developing the structure-property relationship of polymer nanocomposites. While it is recognized that the altered polymer region near filler particles, the interphase, significantly contributes to enhancements of composite properties, the spatial distribution of interphase properties is rarely considered due to lack of local property measurements. In recent years, the Atomic Force Microscopy (AFM) technique has begun to make local property measurements of the interphase available. In the light of the increasing availability of AFM data, in this work a new interphase representation for modeling the viscoelastic properties of polymer nanocomposites is proposed. The proposed interphase representation disentangles the interphase behavior by two separate components -- single-body interphase gradient and multi-body compound effect, whose functional forms are learned via data mining. The proposed interphase representation is integrated into a Finite Element model, and the effects of each component of the interphase representations are numerically studied. In addition, the advantages of the proposed interphase representation are demonstrated by comparison to a prior simulation work in which only a uniform effective property of the interphase is considered. Moreover, the proposed interphase representation is utilized to solve the inverse problem of inferring spatial distribution of local properties using Bayesian Inference on experimental data.

cond-mat.mtrl-sci↗

A Diophantine inequality with four prime variables

Let $N$ be a sufficiently large real number. In this paper, it is proved that, for $1<c<\frac{1193}{889}$, the following Diophantine inequality \begin{equation*} \big|p_1^c+p_2^c+p_3^c+p_4^c-N\big|<\log^{-1}N \end{equation*} is solvable in prime variables $p_1,p_2,p_3,p_4$, which improves the result of Mu.

math.NT↗

Unraveling the Links among Sympathetic Eruptions

Solar eruptions occurring at different places within a relatively short time interval are considered to be sympathetic. However, it is difficult to determine whether there exists a cause and effect between them. Here we study a failed and a successful filament eruption following an X1.8-class flare on 2014 December 20, in which slipping-like magnetic reconnections serve as a key causal link among the eruptions. Reconnection signatures and effects are: at both sides of the filament experiencing the failed eruption, serpentine ribbons extend along chromospheric network to move away from the filament, while a hot loop apparently grows above it; at the filament undergoing the successful eruption, overlying cold loops contract, while coronal dimming appears at both sides even before the filament eruption. These effects are understood by reconnections continually transforming magnetic fluxes overlying one filament to the other, which adjusts how the magnetic field decays with increasing height above the filaments in opposite trends, therefore either strengthening or weakening the magnetic confinement of each filament.

astro-ph.SR↗

Interpretable Convolutional Neural Networks via Feedforward Design

The model parameters of convolutional neural networks (CNNs) are determined by backpropagation (BP). In this work, we propose an interpretable feedforward (FF) design without any BP as a reference. The FF design adopts a data-centric approach. It derives network parameters of the current layer based on data statistics from the output of the previous layer in a one-pass manner. To construct convolutional layers, we develop a new signal transform, called the Saab (Subspace Approximation with Adjusted Bias) transform. It is a variant of the principal component analysis (PCA) with an added bias vector to annihilate activation's nonlinearity. Multiple Saab transforms in cascade yield multiple convolutional layers. As to fully-connected (FC) layers, we construct them using a cascade of multi-stage linear least squared regressors (LSRs). The classification and robustness (against adversarial attacks) performances of BP- and FF-designed CNNs applied to the MNIST and the CIFAR-10 datasets are compared. Finally, we comment on the relationship between BP and FF designs.

cs.CV↗

Improving the Transformer Translation Model with Document-Level Context

Although the Transformer translation model (Vaswani et al., 2017) has achieved state-of-the-art performance in a variety of translation tasks, how to use document-level context to deal with discourse phenomena problematic for Transformer still remains a challenge. In this work, we extend the Transformer model with a new context encoder to represent document-level context, which is then incorporated into the original encoder and decoder. As large-scale document-level parallel corpora are usually not available, we introduce a two-step training method to take full advantage of abundant sentence-level parallel corpora and limited document-level parallel corpora. Experiments on the NIST Chinese-English datasets and the IWSLT French-English datasets show that our approach improves over Transformer significantly.

cs.CL↗

An adaptive moving mesh discontinuous Galerkin method for the radiative transfer equation

The radiative transfer equation models the interaction of radiation with scattering and absorbing media and has important applications in various fields in science and engineering. It is an integro-differential equation involving time, space and angular variables and contains an integral term in angular directions while being hyperbolic in space. The challenges for its numerical solution include the needs to handle with its high dimensionality, the presence of the integral term, and the development of discontinuities and sharp layers in its solution along spatial directions. Its numerical solution is studied in this paper using an adaptive moving mesh discontinuous Galerkin method for spatial discretization together with the discrete ordinate method for angular discretization. The former employs a dynamic mesh adaptation strategy based on moving mesh partial differential equations to improve computational accuracy and efficiency. Its mesh adaptation ability, accuracy, and efficiency are demonstrated in a selection of one- and two-dimensional numerical examples.

math.NA↗

Deriving Enhanced Geographical Representations via Similarity-based Spectral Analysis: Predicting Colorectal Cancer Survival Curves in Iowa

Neural networks are capable of learning rich, nonlinear feature representations shown to be beneficial in many predictive tasks. In this work, we use such models to explore different geographical feature representations in the context of predicting colorectal cancer survival curves for patients in the state of Iowa, spanning the years 1989 to 2013. Specifically, we compare model performance using "area between the curves" (ABC) to assess (a) whether survival curves can be reasonably predicted for colorectal cancer patients in the state of Iowa, (b) whether geographical features improve predictive performance, (c) whether a simple binary representation, or a richer, spectral analysis-elicited representation perform better, and (d) whether spectral analysis-based representations can be improved upon by leveraging geographically-descriptive features. In exploring (d), we devise a similarity-based spectral analysis procedure, which allows for the combination of geographically relational and geographically descriptive features. Our findings suggest that survival curves can be reasonably estimated on average, with predictive performance deviating at the five-year survival mark among all models. We also find that geographical features improve predictive performance, and that better performance is obtained using richer, spectral analysis-elicited features. Furthermore, we find that similarity-based spectral analysis-elicited representations improve upon the original spectral analysis results by approximately 40%.

cs.LG↗

Two-dimensional InSe/WS$_2$ heterostructure with enhanced optoelectronic performance in the visible region

Two-dimensional (2D) InSe and WS$_2$ exhibit promising characteristics for optoelectronic and photoelectrochemical applications, e.g. photodetection and photocatalytic water splitting. However, both of them have poor absorption of visible light due to wide band gaps. 2D InSe has high electron mobility but low hole mobility, while 2D WS$_2$ is on the opposite. Here, we design a 2D heterostructure composed of their monolayers and study its optoelectronic properties by first-principles calculations. Our results show that the heterostructure has a direct band gap of 2.19 eV, which is much smaller than those of the monolayers mainly due to a type-II band alignment: the valence band maximum and the conduction band minimum of monolayer InSe are lower than those of monolayer WS$_2$, respectively. The visible-light absorption is enhanced considerably, e.g. about fivefold (threefold) increase at the wavelength of 490 nm in comparison to monolayer InSe (WS$_2$). The type-II band alignment also facilitates the spatial separation of photogenerated electron-hole pairs, i.e., electrons (holes) reside preferably in the InSe (WS$_2$) layer. The two layers complement each other in carrier mobilities of the heterostructure: the photogenerated electrons and holes inherit the large mobilities from the InSe and WS$_2$ monolayers, respectively.

cond-mat.mtrl-sci↗

A Two-Stage Penalized Least Squares Method for Constructing Large Systems of Structural Equations

We propose a two-stage penalized least squares method to build large systems of structural equations based on the instrumental variables view of the classical two-stage least squares method. We show that, with large numbers of endogenous and exogenous variables, the system can be constructed via consistent estimation of a set of conditional expectations at the first stage, and consistent selection of regulatory effects at the second stage. While the consistent estimation at the first stage can be obtained via the ridge regression, the adaptive lasso is employed at the second stage to achieve the consistent selection. The resultant estimates of regulatory effects enjoy the oracle properties. This method is computationally fast and allows for parallel implementation. We demonstrate its effectiveness via simulation studies and real data analysis.

stat.ME↗

Comparison of 2D simulation models to estimate the critical current of a coated superconducting coil

Superconductors have been being applied to a variety of large-scale power applications, including magnets, electric machines, and fault current limiters, because they can enable a compact, lightweight and high efficiency design. In applications such those mentioned above, superconducting coils are always a key component. For example, in a superconducting electric machine, the superconducting coils are used to generate the main flux density in the air gap, which is significantly important for the energy conversion. It is the performance of the superconducting coils that plays an essential role in determining the performance of the device. However, the performance of a superconducting coil is limited by its critical current, which is determined by temperature and the magnitude and orientation of the magnetic field inside the superconductors. Hence, in-depth investigations to estimate the critical current of the superconducting coils are necessary before manufacturing. Available transient simulation models to estimate the critical current are through the H- and T-A formulations of Maxwell's equations. Both methods consider the same current ramp-up process occurring in experiments. Besides these transient models, static simulations can also be used: a modified load-line method and the so-called P-model, which is based on the asymptotic limit of Faraday's equation when time approaches infinity. To find the best way to calculate the critical current, the four methods are used to estimate the critical current of a double pancake superconducting coils and results are compared with experiments. As a conclusion, T-A formulation, P-model, and the modified load-line methods are recommended for estimating the critical current of the superconducting coils.

cond-mat.supr-con↗

LineNet: a Zoomable CNN for Crowdsourced High Definition Maps Modeling in Urban Environments

High Definition (HD) maps play an important role in modern traffic scenes. However, the development of HD maps coverage grows slowly because of the cost limitation. To efficiently model HD maps, we proposed a convolutional neural network with a novel prediction layer and a zoom module, called LineNet. It is designed for state-of-the-art lane detection in an unordered crowdsourced image dataset. And we introduced TTLane, a dataset for efficient lane detection in urban road modeling applications. Combining LineNet and TTLane, we proposed a pipeline to model HD maps with crowdsourced data for the first time. And the maps can be constructed precisely even with inaccurate crowdsourced data.

cs.CV↗

Classification of lung nodules in CT images based on Wasserstein distance in differential geometry

Lung nodules are commonly detected in screening for patients with a risk for lung cancer. Though the status of large nodules can be easily diagnosed by fine needle biopsy or bronchoscopy, small nodules are often difficult to classify on computed tomography (CT). Recent works have shown that shape analysis of lung nodules can be used to differentiate benign lesions from malignant ones, though existing methods are limited in their sensitivity and specificity. In this work we introduced a new 3D shape analysis within the framework of differential geometry to calculate the Wasserstein distance between benign and malignant lung nodules to derive an accurate classification scheme. The Wasserstein distance between the nodules is calculated based on our new spherical optimal mass transport, this new algorithm works directly on sphere by using spherical metric, which is much more accurate and efficient than previous methods. In the process of deformation, the area-distortion factor gives a probability measure on the unit sphere, which forms the Wasserstein space. From known cases of benign and malignant lung nodules, we can calculate a unique optimal mass transport map between their correspondingly deformed Wasserstein spaces. This transportation cost defines the Wasserstein distance between them and can be used to classify new lung nodules into either the benign or malignant class. To the best of our knowledge, this is the first work that utilizes Wasserstein distance for lung nodule classification. The advantages of Wasserstein distance are it is invariant under rigid motions and scalings, thus it intrinsically measures shape distance even when the underlying shapes are of high complexity, making it well suited to classify lung nodules as they have different sizes, orientations, and appearances.

q-bio.QM↗

Constructing an Interaction Behavior Model for Web Image Search

User interaction behavior is a valuable source of implicit relevance feedback. In Web image search a different type of search result presentation is used than in general Web search, which leads to different interaction mechanisms and user behavior. For example, image search results are self-contained, so that users do not need to click the results to view the landing page as in general Web search, which generates sparse click data. Also, two-dimensional result placement instead of a linear result list makes browsing behaviors more complex. Thus, it is hard to apply standard user behavior models (e.g., click models) developed for general Web search to Web image search. In this paper, we conduct a comprehensive image search user behavior analysis using data from a lab-based user study as well as data from a commercial search log. We then propose a novel interaction behavior model, called grid-based user browsing model (GUBM), whose design is motivated by observations from our data analysis. GUBM can both capture users' interaction behavior, including cursor hovering, and alleviate position bias. The advantages of GUBM are two-fold: (1) It is based on an unsupervised learning method and does not need manually annotated data for training. (2) It is based on user interaction features on search engine result pages (SERPs) and is easily transferable to other scenarios that have a grid-based interface such as video search engines. We conduct extensive experiments to test the performance of our model using a large-scale commercial image search log. Experimental results show that in terms of behavior prediction (perplexity), and topical relevance and image quality (normalized discounted cumulative gain (NDCG)), GUBM outperforms state-of-the-art baseline models as well as the original ranking. We make the implementation of GUBM and related datasets publicly available for future studies.

cs.IR↗