arXiv Science⌕ Search

arXiv subjects

Alexander Moreno

Publications and source records attributed to Alexander Moreno.

23 records · Page 2Linked to original sources

Efficient Learning and Decoding of the Continuous-Time Hidden Markov Model for Disease Progression Modeling

The Continuous-Time Hidden Markov Model (CT-HMM) is an attractive approach to modeling disease progression due to its ability to describe noisy observations arriving irregularly in time. However, the lack of an efficient parameter learning algorithm for CT-HMM restricts its use to very small models or requires unrealistic constraints on the state transitions. In this paper, we present the first complete characterization of efficient EM-based learning methods for CT-HMM models, as well as the first solution to decoding the optimal state transition sequence and the corresponding state dwelling time. We show that EM-based learning consists of two challenges: the estimation of posterior state probabilities and the computation of end-state conditioned statistics. We solve the first challenge by reformulating the estimation problem as an equivalent discrete time-inhomogeneous hidden Markov model. The second challenge is addressed by adapting three distinct approaches from the continuous time Markov chain (CTMC) literature to the CT-HMM domain. Additionally, we further improve the efficiency of the most efficient method by a factor of the number of states. Then, for decoding, we incorporate a state-of-the-art method from the (CTMC) literature, and extend the end-state conditioned optimal state sequence decoding to the CT-HMM case with the computation of the expected state dwelling time. We demonstrate the use of CT-HMMs with more than 100 states to visualize and predict disease progression using a glaucoma dataset and an Alzheimer's disease dataset, and to decode and visualize the most probable state transition trajectory for individuals on the glaucoma dataset, which helps to identify progressing phenotypes in a comprehensive way. Finally, we apply the CT-HMM modeling and decoding strategy to investigate the progression of language acquisition and development.

cs.LG↗

A Robust Functional EM Algorithm for Incomplete Panel Count Data

Panel count data describes aggregated counts of recurrent events observed at discrete time points. To understand dynamics of health behaviors, the field of quantitative behavioral research has evolved to increasingly rely upon panel count data collected via multiple self reports, for example, about frequencies of smoking using in-the-moment surveys on mobile devices. However, missing reports are common and present a major barrier to downstream statistical learning. As a first step, under a missing completely at random assumption (MCAR), we propose a simple yet widely applicable functional EM algorithm to estimate the counting process mean function, which is of central interest to behavioral scientists. The proposed approach wraps several popular panel count inference methods, seamlessly deals with incomplete counts and is robust to misspecification of the Poisson process assumption. Theoretical analysis of the proposed algorithm provides finite-sample guarantees by expanding parametric EM theory to our general non-parametric setting. We illustrate the utility of the proposed algorithm through numerical experiments and an analysis of smoking cessation data. We also discuss useful extensions to address deviations from the MCAR assumption and covariate effects.

stat.ME↗

Automatic Variational ABC

Approximate Bayesian Computation (ABC) is a framework for performing likelihood-free posterior inference for simulation models. Stochastic Variational inference (SVI) is an appealing alternative to the inefficient sampling approaches commonly used in ABC. However, SVI is highly sensitive to the variance of the gradient estimators, and this problem is exacerbated by approximating the likelihood. We draw upon recent advances in variance reduction for SV and likelihood-free inference using deterministic simulations to produce low variance gradient estimators of the variational lower-bound. By then exploiting automatic differentiation libraries we can avoid nearly all model-specific derivations. We demonstrate performance on three problems and compare to existing SVI algorithms. Our results demonstrate the correctness and efficiency of our algorithm.

stat.ML↗

Transport through two interacting resonant levels connected by a Fermi sea

We study transport at finite bias, i.e. beyond the linear regime, through two interacting resonant levels connected by a Fermi sea, by means of time-dependent density matrix renormalization group. We first consider methodological issues, like the protocol that leads to a current-currying state and the characterization of the steady state. At finite sizes both the current and the occupations of the interacting levels oscillate as a function of time. We determine the amplitude and period of such oscillations as a function of bias. We find that the occupations on the two dots oscillate with a relative phase which depends on the distance between the impurities and on the Fermi momentum of the Fermi sea, as expected for RKKY interactions. Also the approximant to the steady-state current displays oscillations as a function of the distance between the impurities. Such a behavior can be explained by resonances in the free case. We then discuss the incidence of interaction on such a behavior. We conclude by showing the effect of the bias on the current, making connection with the one-impurity case.

cond-mat.str-el↗

Ground-State Phase Diagram of the 1D t-J model

We examine the ground-state phase diagram of the t-J model in one dimension by means of the Density Matrix Renormalization Group. This model is characterized by a rich phase diagram as a function of the exchange interaction J and the density n, displaying Luttinger-liquid (LL) behavior both of repulsive and attractive (i.e. superconducting) nature, a spin-gap phase, and phase-separation. The phase boundaries separating the repulsive from the attractive LL phase as J is increased, and also the boundaries of the spin-gap region at low densities, and phase-separation at even larger J, are determined on the basis of correlation functions and energy-gaps. In particular, we shed light on a contradiction between variational and renormalization-group (RG) results about the extent of the spin-gap phase, that results larger than the variational but smaller than the RG one. Furthermore, we show that the spin gap can reach a sizable value (~ 0.1 t) at low enough filling, such that preformed pairs should be observable at temperatures below these energy scales. No evidence for a phase with clustering of more than two particles is found on approaching phase separation.

cond-mat.str-el↗