arXiv subjects

Jun Morimoto

Publications and source records attributed to Jun Morimoto.

23 records · Page 2Linked to original sources

arXiv2017

Identifying melancholic depression biomarker using whole-brain functional connectivity

By focusing on melancholic features with biological homogeneity, this study aimed to identify a small number of critical functional connections (FCs) that were specific only to the melancholic type of MDD. On the resting-state fMRI data, classifiers were developed to differentiate MDD patients from healthy controls (HCs). The classification accuracy was improved from 50 % (93 MDD and 93 HCs) to 70% (66 melancholic MDD and 66 HCs), when we specifically focused on the melancholic MDD with moderate or severer level of depressive symptoms. It showed 65% accuracy for the independent validation cohort. The biomarker score distribution showed improvements with escitalopram treatments, and also showed significant correlations with depression symptom scores. This classifier was specific to melancholic MDD, and it did not generalize in other mental disorders including autism spectrum disorder (ASD, 54% accuracy) and schizophrenia spectrum disorder (SSD, 45% accuracy). Among the identified 12 FCs from 9,316 FCs between whole brain anatomical node pairs, the left DLPFC / IFG region, which has most commonly been targeted for depression treatments, and its functional connections between Precuneus / PCC, and between right DLPFC / SMA areas had the highest contributions. Given the heterogeneity of the MDD, focusing on the melancholic features is the key to achieve high classification accuracy. The identified FCs specifically predicted the melancholic MDD and associated with subjective depressive symptoms. These results suggested key FCs of melancholic depression, and open doors to novel treatments targeting these regions in the future.

q-bio.NC↗

arXiv2015

Balancer effects in opinion dynamics

We introduce a novel type of contrarian agent, the balancer, to Galam model of opinion dynamics, in order to account for the existence of social skepticism over one-sidedness. We find that the inclusion of balancers, along with majoritarian floaters and single-sided inflexibles, brings about the emergence of a critical point on parametric plane of the dynamical system. Around the critical point, three distinct phases of opinion dynamics separated by discontinuous changes are found.

physics.soc-ph↗

arXiv2014

Efficient Reuse of Previous Experiences to Improve Policies in Real Environment

In this study, we show that a movement policy can be improved efficiently using the previous experiences of a real robot. Reinforcement Learning (RL) is becoming a popular approach to acquire a nonlinear optimal policy through trial and error. However, it is considered very difficult to apply RL to real robot control since it usually requires many learning trials. Such trials cannot be executed in real environments because unrealistic time is necessary and the real system's durability is limited. Therefore, in this study, instead of executing many learning trials, we propose to use a recently developed RL algorithm, importance-weighted PGPE, by which the robot can efficiently reuse previously sampled data to improve it's policy parameters. We apply importance-weighted PGPE to CB-i, our real humanoid robot, and show that it can learn a target reaching movement and a cart-pole swing up movement in a real environment without using any prior knowledge of the task or any carefully designed initial trajectory.

cs.RO↗

arXiv2013

Model-Based Policy Gradients with Parameter-Based Exploration by Least-Squares Conditional Density Estimation

The goal of reinforcement learning (RL) is to let an agent learn an optimal control policy in an unknown environment so that future expected rewards are maximized. The model-free RL approach directly learns the policy based on data samples. Although using many samples tends to improve the accuracy of policy learning, collecting a large number of samples is often expensive in practice. On the other hand, the model-based RL approach first estimates the transition model of the environment and then learns the policy based on the estimated transition model. Thus, if the transition model is accurately learned from a small amount of data, the model-based approach can perform better than the model-free approach. In this paper, we propose a novel model-based RL method by combining a recently proposed model-free policy search method called policy gradients with parameter-based exploration and the state-of-the-art transition model estimator called least-squares conditional density estimation. Through experiments, we demonstrate the practical usefulness of the proposed method.

stat.ML↗

arXiv2013

Efficient Sample Reuse in Policy Gradients with Parameter-based Exploration

The policy gradient approach is a flexible and powerful reinforcement learning method particularly for problems with continuous actions such as robot control. A common challenge in this scenario is how to reduce the variance of policy gradient estimates for reliable policy updates. In this paper, we combine the following three ideas and give a highly effective policy gradient method: (a) the policy gradients with parameter based exploration, which is a recently proposed policy search method with low variance of gradient estimates, (b) an importance sampling technique, which allows us to reuse previously gathered data in a consistent way, and (c) an optimal baseline, which minimizes the variance of gradient estimates with their unbiasedness being maintained. For the proposed method, we give theoretical analysis of the variance of gradient estimates and show its usefulness through extensive experiments.

cs.LG↗