Samuel Shaw | arXiv Science

arXiv2021

Ion exchange in atomically thin clays and micas

Clays and micas are receiving attention as materials that, in their atomically thin form, could allow for novel proton conductive, ion selective, osmotic power generation, or solvent filtration membranes. The interest arises from the possibility of controlling their properties by exchanging ions in the crystal lattice. However, the ion exchange process itself remains largely unexplored in atomically thin materials. Here we use atomic-resolution scanning transmission electron microscopy to study the dynamics of the process and reveal the binding sites of individual ions in atomically thin and artificially restacked clays and micas. Imaging ion exchange after different exposure time and for different crystal thicknesses, we find that the ion diffusion constant, D, for the interlayer space of atomically thin samples is up to 10^4 times larger than in bulk crystals and approaches its value in free water. Surprisingly, samples where no bulk exchange is expected display fast exchange if the mica layers are twisted and restacked; but in this case, the exchanged ions arrange in islands controlled by the moir\'e superlattice dimensions. We attribute the fast ion diffusion to enhanced interlayer expandability resulting from weaker interlayer binding forces in both atomically thin and restacked materials. Finally, we demonstrate images of individual surface cations for these materials, which had remained elusive in previous studies. This work provides atomic scale insights into ion diffusion in highly confined spaces and suggests strategies to design novel exfoliated clays membranes.

cond-mat.mtrl-sci↗

arXiv2020

ForMIC: Foraging via Multiagent RL with Implicit Communication

Multi-agent foraging (MAF) involves distributing a team of agents to search an environment and extract resources from it. Nature provides several examples of highly effective foragers, where individuals within the foraging collective use biological markers (e.g., pheromones) to communicate critical information to others via the environment. In this work, we propose ForMIC, a distributed reinforcement learning MAF approach that endows agents with implicit communication abilities via their shared environment. However, learning efficient policies with stigmergic interactions is highly nontrivial, since agents need to perform well to send each other useful signals, but also need to sense others' signals to perform well. In this work, we develop several key learning techniques for training policies with stigmergic interactions, where such a circular dependency is present. By relying on clever curriculum learning design, action filtering, and the introduction of non-learning agents to increase the agent density at training time at low computational cost, we develop a minimal learning framework that leads to the stable training of efficient stigmergic policies. We present simulation results which demonstrate that our learned policy outperforms existing state-of-the-art MAF algorithms in a set of experiments that vary team size, number and placement of resources, and key environmental dynamics not seen at training time.

cs.RO↗