arXiv subjects

Zheng Zhang

Publications and source records attributed to Zheng Zhang.

At least 631 records · Page 35Linked to original sources

arXiv2018

Integrated Object Detection and Tracking with Tracklet-Conditioned Detection

Accurate detection and tracking of objects is vital for effective video understanding. In previous work, the two tasks have been combined in a way that tracking is based heavily on detection, but the detection benefits marginally from the tracking. To increase synergy, we propose to more tightly integrate the tasks by conditioning the object detection in the current frame on tracklets computed in prior frames. With this approach, the object detection results not only have high detection responses, but also improved coherence with the existing tracklets. This greater coherence leads to estimated object trajectories that are smoother and more stable than the jittered paths obtained without tracklet-conditioned detection. Over extensive experiments, this approach is shown to achieve state-of-the-art performance in terms of both detection and tracking accuracy, as well as noticeable improvements in tracking stability.

cs.CV↗

arXiv2018

Melodic Phrase Segmentation By Deep Neural Networks

Automated melodic phrase detection and segmentation is a classical task in content-based music information retrieval and also the key towards automated music structure analysis. However, traditional methods still cannot satisfy practical requirements. In this paper, we explore and adapt various neural network architectures to see if they can be generalized to work with the symbolic representation of music and produce satisfactory melodic phrase segmentation. The main issue of applying deep-learning methods to phrase detection is the sparse labeling problem of training sets. We proposed two tailored label engineering with corresponding training techniques for different neural networks in order to make decisions at a sequential level. Experiment results show that the CNN-CRF architecture performs the best, being able to offer finer segmentation and faster to train, while CNN, Bi-LSTM-CNN and Bi-LSTM-CRF are acceptable alternatives.

cs.LG↗

arXiv2018

On the moduli space of pairs consisting of a cubic threefold and a hyperplane

We study the moduli space of pairs $(X,H)$ consisting of a cubic threefold $X$ and a hyperplane $H$ in $\mathbb P^4$. The interest in this moduli comes from two sources: the study of certain weighted hypersurfaces whose middle cohomology admit Hodge structures of $K3$ type and, on the other hand, the study of the singularity $O_{16}$ (the cone over a cubic surface). In this paper, we give a Hodge theoretic construction of the moduli space of cubic pairs by relating $(X,H)$ to certain "lattice polarized" cubic fourfolds $Y$. A period map for the pairs $(X,H)$ is then defined using the periods of the cubic fourfolds $Y$. The main result is that the period map induces an isomorphism between a GIT model for the pairs $(X,H)$ and the Baily-Borel compactification of some locally symmetric domain of type IV.

math.AG↗

arXiv2018

Loss Functions for Multiset Prediction

We study the problem of multiset prediction. The goal of multiset prediction is to train a predictor that maps an input to a multiset consisting of multiple items. Unlike existing problems in supervised learning, such as classification, ranking and sequence generation, there is no known order among items in a target multiset, and each item in the multiset may appear more than once, making this problem extremely challenging. In this paper, we propose a novel multiset loss function by viewing this problem from the perspective of sequential decision making. The proposed multiset loss function is empirically evaluated on two families of datasets, one synthetic and the other real, with varying levels of difficulty, against various baseline loss functions including reinforcement learning, sequence, and aggregated distribution matching loss functions. The experiments reveal the effectiveness of the proposed loss function over the others.

cs.LG↗

arXiv2018

Rare-earth chalcogenides: A large family of triangular lattice spin liquid candidate

Frustrated quantum magnets are expected to host many exotic quantum spin states like quantum spin liquid (QSL), and have attracted numerous interest in modern condensed matter physics. The discovery of the triangular lattice spin liquid candidate YbMgGaO$_4$ stimulated an increasing attention on the rare-earth-based frustrated magnets with strong spin-orbit coupling. Here we report the synthesis and characterization of a large family of rare-earth chalcogenides AReCh$_2$ (A = alkali or monovalent ions, Re = rare earth, Ch = O, S, Se). The family compounds share the same structure (R$\bar{3}$m) as YbMgGaO$_4$, and antiferromagnetically coupled rare-earth ions form perfect triangular layers that are well separated along the $c$-axis. Specific heat and magnetic susceptibility measurements on NaYbO$_2$, NaYbS$_2$ and NaYbSe$_2$ single crystals and polycrystals, reveal no structural or magnetic transition down to 50mK. The family, having the simplest structure and chemical formula among the known QSL candidates, removes the issue on possible exchange disorders in YbMgGaO$_4$. More excitingly, the rich diversity of the family members allows tunable charge gaps, variable exchange coupling, and many other advantages. This makes the family an ideal platform for fundamental research of QSLs and its promising applications.

cond-mat.str-el↗

arXiv2018

Highly-Economized Multi-View Binary Compression for Scalable Image Clustering

How to economically cluster large-scale multi-view images is a long-standing problem in computer vision. To tackle this challenge, we introduce a novel approach named Highly-economized Scalable Image Clustering (HSIC) that radically surpasses conventional image clustering methods via binary compression. We intuitively unify the binary representation learning and efficient binary cluster structure learning into a joint framework. In particular, common binary representations are learned by exploiting both sharable and individual information across multiple views to capture their underlying correlations. Meanwhile, cluster assignment with robust binary centroids is also performed via effective discrete optimization under L21-norm constraint. By this means, heavy continuous-valued Euclidean distance computations can be successfully reduced by efficient binary XOR operations during the clustering procedure. To our best knowledge, HSIC is the first binary clustering work specifically designed for scalable multi-view image clustering. Extensive experimental results on four large-scale image datasets show that HSIC consistently outperforms the state-of-the-art approaches, whilst significantly reducing computational time and memory footprint.

cs.CV↗

arXiv2018

Incomplete Multi-view Clustering via Graph Regularized Matrix Factorization

Clustering with incomplete views is a challenge in multi-view clustering. In this paper, we provide a novel and simple method to address this issue. Specifically, the proposed method simultaneously exploits the local information of each view and the complementary information among views to learn the common latent representation for all samples, which can greatly improve the compactness and discriminability of the obtained representation. Compared with the conventional graph embedding methods, the proposed method does not introduce any extra regularization term and corresponding penalty parameter to preserve the local structure of data, and thus does not increase the burden of extra parameter selection. By imposing the orthogonal constraint on the basis matrix of each view, the proposed method is able to handle the out-of-sample. Moreover, the proposed method can be viewed as a unified framework for multi-view learning since it can handle both incomplete and complete multi-view clustering and classification tasks. Extensive experiments conducted on several multi-view datasets prove that the proposed method can significantly improve the clustering performance.

cs.CV↗

arXiv2018

Robust Factorization and Completion of Streaming Tensor Data via Variational Bayesian Inference

Streaming tensor factorization is a powerful tool for processing high-volume and multi-way temporal data in Internet networks, recommender systems and image/video data analysis. In many applications the full tensor is not known, but instead received in a slice-by-slice manner over time. Streaming factorizations aim to take advantage of inherent temporal relationships in data analytics. Existing streaming tensor factorization algorithms rely on least-squares data fitting and they do not possess a mechanism for tensor rank determination. This leaves them susceptible to outliers and vulnerable to over-fitting. This paper presents the first Bayesian robust streaming tensor factorization model. Our model successfully identifies sparse outliers, automatically determines the underlying tensor rank and accurately fits low-rank structure. We implement our model in Matlab and compare it to existing algorithms. Our algorithm is applied to factorize and complete various streaming tensors including synthetic data, dynamic MRI, video sequences, and Internet traffic data.

eess.SP↗

arXiv2018

Stochastic Collocation with Non-Gaussian Correlated Parameters via a New Quadrature Rule

This paper generalizes stochastic collocation methods to handle correlated non-Gaussian random parameters. The key challenge is to perform a multivariate numerical integration in a correlated parameter space when computing the coefficient of each basis function via a projection step. We propose an optimization model and a block coordinate descent solver to compute the required quadrature samples. Our method is verified with a CMOS ring oscillator and an optical ring resonator, showing 3000x speedup over Monte Carlo.

math.NA↗

arXiv2018

A Unified Framework for Efficient Estimation of General Treatment Models

This paper presents a weighted optimization framework that unifies the binary,multi-valued, continuous, as well as mixture of discrete and continuous treatment, under the unconfounded treatment assignment. With a general loss function, the framework includes the average, quantile and asymmetric least squares causal effect of treatment as special cases. For this general framework, we first derive the semiparametric efficiency bound for the causal effect of treatment, extending the existing bound results to a wider class of models. We then propose a generalized optimization estimation for the causal effect with weights estimated by solving an expanding set of equations. Under some sufficient conditions, we establish consistency and asymptotic normality of the proposed estimator of the causal effect and show that the estimator attains our semiparametric efficiency bound, thereby extending the existing literature on efficient estimation of causal effect to a wider class of applications. Finally, we discuss etimation of some causal effect functionals such as the treatment effect curve and the average outcome. To evaluate the finite sample performance of the proposed procedure, we conduct a small scale simulation study and find that the proposed estimation has practical value. To illustrate the applicability of the procedure, we revisit the literature on campaign advertise and campaign contributions. Unlike the existing procedures which produce mixed results, we find no evidence of campaign advertise on campaign contribution.

econ.EM↗

arXiv2018

Top-Down Tree Structured Text Generation

Text generation is a fundamental building block in natural language processing tasks. Existing sequential models performs autoregression directly over the text sequence and have difficulty generating long sentences of complex structures. This paper advocates a simple approach that treats sentence generation as a tree-generation task. By explicitly modelling syntactic structures in a constituent syntactic tree and performing top-down, breadth-first tree generation, our model fixes dependencies appropriately and performs implicit global planning. This is in contrast to transition-based depth-first generation process, which has difficulty dealing with incomplete texts when parsing and also does not incorporate future contexts in planning. Our preliminary results on two generation tasks and one parsing task demonstrate that this is an effective strategy.

cs.CL↗

arXiv2018

Music Style Transfer: A Position Paper

Led by the success of neural style transfer on visual arts, there has been a rising trend very recently in the effort of music style transfer. However, "music style" is not yet a well-defined concept from a scientific point of view. The difficulty lies in the intrinsic multi-level and multi-modal character of music representation (which is very different from image representation). As a result, depending on their interpretation of "music style", current studies under the category of "music style transfer", are actually solving completely different problems that belong to a variety of sub-fields of Computer Music. Also, a vanilla end-to-end approach, which aims at dealing with all levels of music representation at once by directly adopting the method of image style transfer, leads to poor results. Thus, we vitally propose a more scientifically-viable definition of music style transfer by breaking it down into precise concepts of timbre style transfer, performance style transfer and composition style transfer, as well as to connect different aspects of music style transfer with existing well-established sub-fields of computer music studies. In addition, we discuss the current limitations of music style modeling and its future directions by drawing spirit from some deep generative models, especially the ones using unsupervised learning and disentanglement techniques.

cs.SD↗

arXiv2018

A Simple and Efficient Estimation of the Average Treatment Effect in the Presence of Unmeasured Confounders

Wang and Tchetgen Tchetgen (2017) studied identification and estimation of the average treatment effect when some confounders are unmeasured. Under their identification condition, they showed that the semiparametric efficient influence function depends on five unknown functionals. They proposed to parameterize all functionals and estimate the average treatment effect from the efficient influence function by replacing the unknown functionals with estimated functionals. They established that their estimator is consistent when certain functionals are correctly specified and attains the semiparametric efficiency bound when all functionals are correctly specified. In applications, it is likely that those functionals could all be misspecified. Consequently their estimator could be inconsistent or consistent but not efficient. This paper presents an alternative estimator that does not require parameterization of any of the functionals. We establish that the proposed estimator is always consistent and always attains the semiparametric efficiency bound. A simple and intuitive estimator of the asymptotic variance is presented, and a small scale simulation study reveals that the proposed estimation outperforms the existing alternatives in finite samples.

econ.EM↗

arXiv2018

Uncertainty Quantification of Electronic and Photonic ICs with Non-Gaussian Correlated Process Variations

Since the invention of generalized polynomial chaos in 2002, uncertainty quantification has impacted many engineering fields, including variation-aware design automation of integrated circuits and integrated photonics. Due to the fast convergence rate, the generalized polynomial chaos expansion has achieved orders-of-magnitude speedup than Monte Carlo in many applications. However, almost all existing generalized polynomial chaos methods have a strong assumption: the uncertain parameters are mutually independent or Gaussian correlated. This assumption rarely holds in many realistic applications, and it has been a long-standing challenge for both theorists and practitioners. This paper propose a rigorous and efficient solution to address the challenge of non-Gaussian correlation. We first extend generalized polynomial chaos, and propose a class of smooth basis functions to efficiently handle non-Gaussian correlations. Then, we consider high-dimensional parameters, and develop a scalable tensor method to compute the proposed basis functions. Finally, we develop a sparse solver with adaptive sample selections to solve high-dimensional uncertainty quantification problems. We validate our theory and algorithm by electronic and photonic ICs with 19 to 57 non-Gaussian correlated variation parameters. The results show that our approach outperforms Monte Carlo by $2500\times$ to $3000\times$ in terms of efficiency. Moreover, our method can accurately predict the output density functions with multiple peaks caused by non-Gaussian correlations, which is hard to handle by existing methods. Based on the results in this paper, many novel uncertainty quantification algorithms can be developed and can be further applied to a broad range of engineering domains.

math.NA↗

arXiv2018

Polarization-dependent property of dipole-dipole interaction mediated by localized surface plasmon of an Ag nanosphere

The effect of the dipole polarization on the quantum dipole dipole interaction near an Ag nanosphere (ANS) is investigated. A theoretical formalism in terms of classical Green function is developed for the transfer rate and the potential energy of the dipole dipole interaction (DDI) between two polarized dipoles. It is found that a linear transition dipole can couple to a left circularly polarized transition dipole much stronger than to a right circularly polarized transition dipole. This polarization selectivity exists over a wide frequency range and is robust against the variation of the dipoles' position or the radius of the ANS. In contrast, a right circularly polarized transition dipole, can change sharply from coupling strongly to another right circularly polarized dipole to coupling strongly to a left circularly polarized dipole with varying frequency. However, if the two dipoles are placed in the same radial direction of the sphere, the right circularly polarized transition dipole can only couple to the dipole with the same polarization while not to the left circularly polarized transition dipole. These findings may be used in solid-state quantum-information processing based on the DDI.

quant-ph↗

arXiv2018

Relation Networks for Object Detection

Although it is well believed for years that modeling relations between objects would help object recognition, there has not been evidence that the idea is working in the deep learning era. All state-of-the-art object detection systems still rely on recognizing object instances individually, without exploiting their relations during learning. This work proposes an object relation module. It processes a set of objects simultaneously through interaction between their appearance feature and geometry, thus allowing modeling of their relations. It is lightweight and in-place. It does not require additional supervision and is easy to embed in existing networks. It is shown effective on improving object recognition and duplicate removal steps in the modern object detection pipeline. It verifies the efficacy of modeling object relations in CNN based detection. It gives rise to the first fully end-to-end object detector.

cs.CV↗

arXiv2018

Portfolio Optimization with Delay Factor Models

We propose an optimal portfolio problem in the incomplete market where the underlying assets depend on economic factors with delayed effects, such models can describe the short term forecasting and the interaction with time lag among different financial markets. The delay phenomenon can be recognized as the integral type and the pointwise type. The optimal strategy is identified through maximizing the power utility. Due to the delay leading to the non-Markovian structure, the conventional Hamilton-Jacobi-Bellman (HJB) approach is no longer applicable. By using the stochastic maximum principle, we argue that the optimal strategy can be characterized by the solutions of a decoupled quadratic forward-backward stochastic differential equations(QFBSDEs). The optimality is verified via the super-martingale argument. The existence and uniqueness of the solution to the QFBSDEs are established. In addition, if the market is complete, we also provide a martingale based method to solve our portfolio optimization problem, and investigate its connection with the proposed FBSDE approach. Finally, two particular cases are analyzed where the corresponding FBSDEs can be solved explicitly.

q-fin.MF↗

arXiv2018

Memory-augmented Dialogue Management for Task-oriented Dialogue Systems

Dialogue management (DM) decides the next action of a dialogue system according to the current dialogue state, and thus plays a central role in task-oriented dialogue systems. Since dialogue management requires to have access to not only local utterances, but also the global semantics of the entire dialogue session, modeling the long-range history information is a critical issue. To this end, we propose a novel Memory-Augmented Dialogue management model (MAD) which employs a memory controller and two additional memory structures, i.e., a slot-value memory and an external memory. The slot-value memory tracks the dialogue state by memorizing and updating the values of semantic slots (for instance, cuisine, price, and location), and the external memory augments the representation of hidden states of traditional recurrent neural networks through storing more context information. To update the dialogue state efficiently, we also propose slot-level attention on user utterances to extract specific semantic information for each slot. Experiments show that our model can obtain state-of-the-art performance and outperforms existing baselines.

cs.CL↗