arXiv subjects

Jan Schneider

Publications and source records attributed to Jan Schneider.

At least 19 recordsLinked to original sources

arXiv2026

Sim-to-Real Transfer for Muscle-Actuated Robots via Generalized Actuator Networks

Tendon drives paired with soft muscle actuation enable faster and safer robots while potentially accelerating skill acquisition. Still, these systems are rarely used in practice due to inherent nonlinearities, friction, and hysteresis, which complicate modeling and control. So far, these challenges have hindered policy transfer from simulation to real systems. To bridge this gap, we propose a sim-to-real pipeline that learns a neural network model of this complex actuation and leverages established rigid body simulation for the arm dynamics and interactions with the environment. Our method, called Generalized Actuator Network (GenAN), enables actuation model identification across a wide range of robots by learning directly from joint position trajectories rather than requiring torque sensors. Using GenAN on PAMY2, a tendon-driven robot powered by pneumatic artificial muscles, we successfully deploy dynamic but precise goal-reaching, ball-in-a-cup, and table tennis policies, trained entirely in simulation. To the best of our knowledge, this result constitutes the first successful sim-to-real transfer for a four-degrees-of-freedom muscle-actuated robot arm.

cs.RO↗

arXiv2026

Quantile-Based Skewness for Fuzzy Numbers with Probabilistic Foundations: With an Application in Portfolio Optimization

This paper introduces a novel parameter free skewness coefficient for fuzzy numbers, addressing a critical gap in quantifying asymmetry under imprecision. Existing fuzzy literature substitutes membership functions for probability density functions in moment-based skewness, lacking rigorous theoretical grounding. Our coefficient, however, rigorously establishes a probabilistic foundation, making it both probabilistically meaningful and fully compliant with the semantics of fuzzy set theory. Our approach interprets a fuzzy number's left and right membership function components as cumulative and survival probability functions of associated random variables. This provides a robust probabilistic foundation for its $\alpha$-cuts as generalized quantiles representing values that are "at least $\alpha$-probable", thereby instantiating the well-grounded dualism between probability and possibility theory. As a quantile-based measure, the proposed coefficient offers invariance under scale and location transformations. Crucially, its superior computational efficiency, empirically demonstrating an almost logarithmic reduction in portfolio optimization processing time with increasing assets, enables significant scalability for real-world applications. The coefficient comprises two complementary constituents: an "inner" measure quantifying the intrinsic skewness of the underlying probabilistic distributions, and an "outer" measure capturing the fuzzy number's overall profile asymmetry. This dual structure offers nuanced insights into a fuzzy number's asymmetry. We demonstrate its practical utility and computational advantages within a fuzzy mean-variance-skewness portfolio optimization framework, comparing its performance with two of the most highly cited original moment-based fuzzy skewness coefficients from the literature.

math.GM↗

arXiv2025

Coupling opinion dynamics and epidemiology

This research investigates the coupled dynamics of behavior and infectious disease using a mathematical model. We integrate a two-state q-voter opinion process with SIS-type infection dynamics, where transmission rates are influenced by the opinion and an infection-induced switching mechanism represents individuals reassessing their behavior upon infection. Analytically, we derive conditions for the stability of endemic and disease-free equilibria. Numerical simulations reveal complex dynamics: above a certain infectivity threshold, the system can exhibit alternative basins of attraction leading to a balanced endemic fixed point or stable limit cycles. Notably, the dominant asymptotic opinion and resulting epidemiological outcomes show non-monotonic relationships with infectivity, highlighting the potential for adaptive behavior to induce complex system dynamics. These findings underscore the critical role of social interventions; shifts in behavioral norms and trust can permanently alter epidemic outcomes, suggesting that such interventions are as crucial as biomedical controls

physics.soc-ph↗

arXiv2025

Dexterous Robotic Piano Playing at Scale

Endowing robot hands with human-level dexterity has been a long-standing goal in robotics. Bimanual robotic piano playing represents a particularly challenging task: it is high-dimensional, contact-rich, and requires fast, precise control. We present OmniPianist, the first agent capable of performing nearly one thousand music pieces via scalable, human-demonstration-free learning. Our approach is built on three core components. First, we introduce an automatic fingering strategy based on Optimal Transport (OT), allowing the agent to autonomously discover efficient piano-playing strategies from scratch without demonstrations. Second, we conduct large-scale Reinforcement Learning (RL) by training more than 2,000 agents, each specialized in distinct music pieces, and aggregate their experience into a dataset named RP1M++, consisting of over one million trajectories for robotic piano playing. Finally, we employ a Flow Matching Transformer to leverage RP1M++ through large-scale imitation learning, resulting in the OmniPianist agent capable of performing a wide range of musical pieces. Extensive experiments and ablation studies highlight the effectiveness and scalability of our approach, advancing dexterous robotic piano playing at scale.

cs.RO↗

arXiv2025

Learning Nonlinear Causal Reductions to Explain Reinforcement Learning Policies

Why do reinforcement learning (RL) policies fail or succeed? This is a challenging question due to the complex, high-dimensional nature of agent-environment interactions. In this work, we take a causal perspective on explaining the behavior of RL policies by viewing the states, actions, and rewards as variables in a low-level causal model. We introduce random perturbations to policy actions during execution and observe their effects on the cumulative reward, learning a simplified high-level causal model that explains these relationships. To this end, we develop a nonlinear Causal Model Reduction framework that ensures approximate interventional consistency, meaning the simplified high-level model responds to interventions in a similar way as the original complex system. We prove that for a class of nonlinear causal models, there exists a unique solution that achieves exact interventional consistency, ensuring learned explanations reflect meaningful causal patterns. Experiments on both synthetic causal models and practical RL tasks-including pendulum control and robot table tennis-demonstrate that our approach can uncover important behavioral patterns, biases, and failure modes in trained RL policies.

stat.ML↗

arXiv2024

Chaos in opinion-driven disease dynamics

During the COVID-19 pandemic, it became evident that the effectiveness of applying intervention measures is significantly influenced by societal acceptance, which, in turn, is affected by the processes of opinion formation. This article explores one among the many possibilities of a coupled opinion-epidemic system. The findings reveal either intricate periodic patterns or chaotic dynamics, leading to substantial fluctuations in opinion distribution and, consequently, significant variations in the total number of infections over time. Interestingly, the model is exhibiting the protective pattern.

nlin.CD↗

arXiv2024

RP1M: A Large-Scale Motion Dataset for Piano Playing with Bi-Manual Dexterous Robot Hands

It has been a long-standing research goal to endow robot hands with human-level dexterity. Bi-manual robot piano playing constitutes a task that combines challenges from dynamic tasks, such as generating fast while precise motions, with slower but contact-rich manipulation problems. Although reinforcement learning based approaches have shown promising results in single-task performance, these methods struggle in a multi-song setting. Our work aims to close this gap and, thereby, enable imitation learning approaches for robot piano playing at scale. To this end, we introduce the Robot Piano 1 Million (RP1M) dataset, containing bi-manual robot piano playing motion data of more than one million trajectories. We formulate finger placements as an optimal transport problem, thus, enabling automatic annotation of vast amounts of unlabeled songs. Benchmarking existing imitation learning approaches shows that such approaches reach state-of-the-art robot piano playing performance by leveraging RP1M.

cs.RO↗

arXiv2024

Using quantum computers in control: interval matrix properties

Quantum computing provides a powerful framework for tackling computational problems that are classically intractable. The goal of this paper is to explore the use of quantum computers for solving relevant problems in systems and control theory. In the recent literature, different quantum algorithms have been developed to tackle binary optimization, which plays an important role in various control-theoretic problems. As a prototypical example, we consider the verification of interval matrix properties such as non-singularity and stability on a quantum computer. We present a quantum algorithm solving these problems and we study its performance in simulation. Our results demonstrate that quantum computers provide a promising tool for control whose applicability to further computationally complex problems remains to be explored.

eess.SY↗

arXiv2024

Learning to Control Emulated Muscles in Real Robots: Towards Exploiting Bio-Inspired Actuator Morphology

Recent studies have demonstrated the immense potential of exploiting muscle actuator morphology for natural and robust movement -- in simulation. A validation on real robotic hardware is yet missing. In this study, we emulate muscle actuator properties on hardware in real-time, taking advantage of modern and affordable electric motors. We demonstrate that our setup can emulate a simplified muscle model on a real robot while being controlled by a learned policy. We improve upon an existing muscle model by deriving a damping rule that ensures that the model is not only performant and stable but also tuneable for the real hardware. Our policies are trained by reinforcement learning entirely in simulation, where we show that previously reported benefits of muscles extend to the case of quadruped locomotion and hopping: the learned policies are more robust and exhibit more regular gaits. Finally, we confirm that the learned policies can be executed on real hardware and show that sim-to-real transfer with real-time emulated muscles on a quadruped robot is possible. These results show that artificial muscles can be highly beneficial actuators for future generations of robust legged robots.

cs.RO↗

arXiv2024

Identifying Policy Gradient Subspaces

Policy gradient methods hold great potential for solving complex continuous control tasks. Still, their training efficiency can be improved by exploiting structure within the optimization problem. Recent work indicates that supervised learning can be accelerated by leveraging the fact that gradients lie in a low-dimensional and slowly-changing subspace. In this paper, we conduct a thorough evaluation of this phenomenon for two popular deep policy gradient methods on various simulated benchmark tasks. Our results demonstrate the existence of such gradient subspaces despite the continuously changing data distribution inherent to reinforcement learning. These findings reveal promising directions for future work on more efficient reinforcement learning, e.g., through improving parameter-space exploration or enabling second-order optimization.

cs.LG↗

arXiv2023

Open X-Embodiment: Robotic Learning Datasets and RT-X Models

Large, high-capacity models trained on diverse datasets have shown remarkable successes on efficiently tackling downstream applications. In domains from NLP to Computer Vision, this has led to a consolidation of pretrained models, with general pretrained backbones serving as a starting point for many applications. Can such a consolidation happen in robotics? Conventionally, robotic learning methods train a separate model for every application, every robot, and even every environment. Can we instead train generalist X-robot policy that can be adapted efficiently to new robots, tasks, and environments? In this paper, we provide datasets in standardized data formats and models to make it possible to explore this possibility in the context of robotic manipulation, alongside experimental results that provide an example of effective X-robot policies. We assemble a dataset from 22 different robots collected through a collaboration between 21 institutions, demonstrating 527 skills (160266 tasks). We show that a high-capacity model trained on this data, which we call RT-X, exhibits positive transfer and improves the capabilities of multiple robots by leveraging experience from other platforms. More details can be found on the project website https://robotics-transformer-x.github.io.

cs.RO↗

arXiv2023

Investigating the Impact of Action Representations in Policy Gradient Algorithms

Reinforcement learning~(RL) is a versatile framework for learning to solve complex real-world tasks. However, influences on the learning performance of RL algorithms are often poorly understood in practice. We discuss different analysis techniques and assess their effectiveness for investigating the impact of action representations in RL. Our experiments demonstrate that the action representation can significantly influence the learning performance on popular RL benchmark tasks. The analysis results indicate that some of the performance differences can be attributed to changes in the complexity of the optimization landscape. Finally, we discuss open challenges of analysis techniques for RL algorithms.

cs.LG↗

arXiv2023

Safe & Accurate at Speed with Tendons: A Robot Arm for Exploring Dynamic Motion

Operating robots precisely and at high speeds has been a long-standing goal of robotics research. Balancing these competing demands is key to enabling the seamless collaboration of robots and humans and increasing task performance. However, traditional motor-driven systems often fall short in this balancing act. Due to their rigid and often heavy design exacerbated by positioning the motors into the joints, faster motions of such robots transfer high forces at impact. To enable precise and safe dynamic motions, we introduce a four degree-of-freedom~(DoF) tendon-driven robot arm. Tendons allow placing the actuation at the base to reduce the robot's inertia, which we show significantly reduces peak collision forces compared to conventional robots with motors placed near the joints. Pairing our robot with pneumatic muscles allows generating high forces and highly accelerated motions, while benefiting from impact resilience through passive compliance. Since tendons are subject to additional friction and hence prone to wear and tear, we validate the reliability of our robotic arm on various experiments, including long-term dynamic motions. We also demonstrate its ease of control by quantifying the nonlinearities of the system and the performance on a challenging dynamic table tennis task learned from scratch using reinforcement learning. We open-source the entire hardware design, which can be largely 3D printed, the control software, and a proprioceptive dataset of 25 days of diverse robot motions at webdav.tuebingen.mpg.de/pamy2.

cs.RO↗

arXiv2023

Hindsight States: Blending Sim and Real Task Elements for Efficient Reinforcement Learning

Reinforcement learning has shown great potential in solving complex tasks when large amounts of data can be generated with little effort. In robotics, one approach to generate training data builds on simulations based on dynamics models derived from first principles. However, for tasks that, for instance, involve complex soft robots, devising such models is substantially more challenging. Being able to train effectively in increasingly complicated scenarios with reinforcement learning enables to take advantage of complex systems such as soft robots. Here, we leverage the imbalance in complexity of the dynamics to learn more sample-efficiently. We (i) abstract the task into distinct components, (ii) off-load the simple dynamics parts into the simulation, and (iii) multiply these virtual parts to generate more data in hindsight. Our new method, Hindsight States (HiS), uses this data and selects the most useful transitions for training. It can be used with an arbitrary off-policy algorithm. We validate our method on several challenging simulated tasks and demonstrate that it improves learning both alone and when combined with an existing hindsight algorithm, Hindsight Experience Replay (HER). Finally, we evaluate HiS on a physical system and show that it boosts performance on a complex table tennis task with a muscular robot. Videos and code of the experiments can be found on webdav.tuebingen.mpg.de/his/.

cs.RO↗

arXiv2022

AIMY: An Open-source Table Tennis Ball Launcher for Versatile and High-fidelity Trajectory Generation

To approach the level of advanced human players in table tennis with robots, generating varied ball trajectories in a reproducible and controlled manner is essential. Current ball launchers used in robot table tennis either do not provide an interface for automatic control or are limited in their capabilities to adapt speed, direction, and spin of the ball. For these reasons, we present AIMY, a three-wheeled open-hardware and open-source table tennis ball launcher, which can generate ball speeds and spins of up to 15.4 ms-1 and 192 s-1, respectively, which are comparable to advanced human players. The wheel speeds, launch orientation and time can be fully controlled via an open Ethernet or Wi-Fi interface. We provide a detailed overview of the core design features, as well as open source the software to encourage distribution and duplication within and beyond the robot table tennis research community. We also extensively evaluate the ball launcher's accuracy for different system settings and learn to launch a ball to desired locations. With this ball launcher, we enable long-duration training of robot table tennis approaches where the complexity of the ball trajectory can be automatically adjusted, enabling large-scale real-world online reinforcement learning for table tennis robots.

cs.RO↗

arXiv2020

New definitions (measures) of skewness, mean and dispersion of fuzzy numbers -- by way of a new representation as parameterized curves

We give a geometrically motivated measure of skewness, define a mean value triangle number, and dispersion (in that order) of a fuzzy number without reference or seeking analogy to the namesake but parallel concepts in probability theory. These measures come about by way of a new representation of fuzzy numbers as parameterized curves respectively their associated tangent bundle. Importantly skewness and dispersion are given as functions of $\alpha$ (the degree of membership) and such may be given separately and pointwise at each $\alpha$-level, as well as overall. This allows for e.g., when a mathematical model is formulated in fuzzy numbers, to run optimization programs level-wise thereby encapsuling with deliberate accuracy the involved membership functions' characteristics while increasing the computational complexity by only a multiplicative factor compared to the same program formulated in real variables and parameters. As an example the work offers a contribution to the recently very popular fuzzy mean-variance-skewness portfolio optimization.

stat.OT↗

arXiv2017

Levy processes in cones of fuzzy vectors

The general problem of how to construct stochastic processes which are confined to stay in a predefined cone (in the one-dimensional but also multi-dimensional case also referred to as \emph{subordinators}) is of course known to be of great importance in the theory and a myriad of applications.\par But fuzzy stochastic processes are considered in this context for the first time in this paper:\par By first relating with each proper convex cone $C$ in $\R^{n}$ a certain cone of fuzzy vectors $C^*$ and subsequently using some specific Banach space techniques we have been able to produce as many pairs $(L^*_t, C^*)$ of fuzzy \L processes $L^*_t$ and cones $C^*$ of fuzzy vectors such that $L^*_t$ are $C^*$-$\,$subordinators.

math.PR↗

arXiv2017

Convergence of fuzzy random walks to a standard Brownian motion

In this note - starting from $d$-dimensional (with $d>1$) fuzzy vectors - we prove Donsker's classical invariance principle. We consider a fuzzy random walk ${S^*_n}=X^*_1+\cdots+X^*_n,$ where $\{X^*_i\}_1^{\infty}$ is a sequence of mutually independent and identically distributed $d$-dimensional fuzzy random variables whose $\alpha$-cuts are assumed to be compact and convex. Our reasoning and technique are based on the well known conjugacy correspondence between convex sets and support functions, which allows for the association of an appropriately normalized and interpolated time-continuous fuzzy random process with a real valued random process in the space of support functions. We show that each member of the associated family of dual sequences tends in distribution to a standard Brownian motion.

math.PR↗