Coupled autoregressive active inference agents for control of multi-joint dynamical systems

Abstract

We propose an active inference agent to identify and control a mechanical system with multiple bodies connected by joints. This agent is constructed from multiple scalar autoregressive model-based agents, coupled together by virtue of sharing memories. Each subagent infers parameters through Bayesian filtering and controls by minimizing expected free energy over a finite time horizon. We demonstrate that a coupled agent of this kind is able to learn the dynamics of a double mass-spring-damper system, and drive it to a desired position through a balance of explorative and exploitative actions. It outperforms the uncoupled subagents in terms of surprise and goal alignment.

Publication
International Workshop on Active Inference
Tim Nisslbeck
Tim Nisslbeck
Former PhD student

I am a PhD candidate at the Electrical Engineering department, Eindhoven University of Technology.

Wouter Kouw
Wouter Kouw
Assistant professor

I am an assistant professor working on active inference for mobile robots.