Inverse reinforcement learning conditioned on brain scan

Tofara Moyo

Home/Archive/arXiv

arXiv · 1906.09770

Inverse reinforcement learning conditioned on brain scan

Tofara Moyo

View original source ↗Read source document ↗Export metadata ↓

Abstract

We outline a way for an agent to learn the dispositions of a particular individual through inverse reinforcement learning where the state space at time t includes an fMRI scan of the individual, to represent his brain state at that time. The fundamental assumption being that the information shown on an fMRI scan of an individual is conditioned on his thoughts and thought processes. The system models both long and short term memory as well any internal dynamics we may not be aware of that are in the human brain. The human expert will put on a suit for a set duration with sensors whose information will be used to train a policy network, while a generative model will be trained to produce the next fMRI scan image conditioned on the present one and the state of the environment. During operation the humanoid robots actions will be conditioned on this evolving fMRI and the environment it is in.

Explore related subjects

cs.OH

Keep this discovery

BibTeX RIS

Tofara Moyo. 2019-06-24. Inverse reinforcement learning conditioned on brain scan. https://arxiv.org/abs/1906.09770

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Circular Economy Synergies and Trade-offs in Data Centres

This report analyses data centre (DC) sustainability and circularity, revealing existing synergies and trade-offs: The PUE is too coarse, mixing cooling and power provisioning. It wrongly attributes server fan consumption and transformation losses to IT energy. It does not measure compute but infrastructure efficiency, which is already outstanding. Compute energy, however, is exploding. Better energy metrics for DCs would thus cover i) compute efficiency, ii) transformation efficiency, and iii) cooling overhead. Trade-offs exist between cooling energy and water as well as on-site and upstream water: Consuming water on-site lowers the cooling energy, which also lowers the water consumed upstream in power generation. For 'wet' electricity, there is little competition: It is worth spending more on-site energy to save both electricity and related upstream water. For 'dry' electricity, there is a trade-off. Waste heat recovery brings energy circularity but has limited uses and is not the same energy quality, a fact not reflected by current metrics. A better metric would consider the avoided energy through heat recovery instead of the amount recovered. Material circularity can be achieved by interpreting the 9R framework in the context of DCs. Circularity-enhancing measures can be categorised into product design, process design and business models, choice of materials, and operating conditions. Together, they have effects across all circularity levels. The relation between DCs and the power grid is complex. Modern DCs present new challenges for the grid. Mitigation includes battery storage and onsite generation. These measures have, in turn, further consequences, both beneficial and detrimental. They can offer grid flexibility as well as innovations in the field of energy. But they also bring noise, pollution, and GHGs, and compete with the energy sector for resources.

cs.OH↗

arXiv2026

Digital Twin Modeling of a Highly Automated Agricultural Tractor

In efforts to increase research efficiency and availability, a digital twin of our research tractor (AMX G-trac) is created, focusing especially on the CAN communication for data reading and actuation command following the ISOBUS protocol. Mevea Simulation Software is utilized as the foundation, providing the kinematic model and visuals, while Python is used to read and write CAN messages over a Kvaser CanKing virtual CAN channel. Various performance tests involving straight line and turning behavior are performed in both the digital twin simulation and in the real world to measure similarity. Results indicate that the Mevea model behaves very comparable in its lateral dynamics, often within 5-10 percent, but requires better data to fully capture the longitudinal aspects like acceleration. The final model described in this paper sets the table for a second iteration to include more tractor functions such as hydraulics and tractor-implement dynamics.

cs.OH↗

arXiv2026

Risk-based Design for Sustainability in Cloud Systems: Insights from an Experts' Survey

Cloud Systems' Sustainability is critical in Cloud Computing, especially with the growing demand in many industries. Sustainability risks in Cloud Computing can be tricky, mostly because of system complexity and their impact on performance. Thus, this research focuses on Risk-based design (RBD) and how it can support the early identification of possible risks for Cloud System Sustainability, as well as respective mitigation strategies of each risk. In order to successfully identify risks of Cloud System Sustainability, an Expert Survey is conducted including experts with different roles from different industries, to identify possible sustainability risks of a Cloud System on all different levels. Thematic analysis of the responses resulted in a categorization of risks, as well as in the identification of mitigation strategies and factors affecting each risk. Such findings can be helpful for researchers and practitioners that utilize RBD when building sustainable Cloud systems.

cs.OH↗