Transformer-Based Prediction of Human Motions and Contact Forces for Physical Human-Robot Interaction

Alessia Fusco (1) , Valerio Modugno (2) , Dimitrios Kanoulas (2) , Alessandro Rizzo (1) , Marco Cognetti (3, 4)

1 DET - Department of Electronics and Telecommunications [Torino]
2 UCL - University College of London [London]
3 UT3 - Université Toulouse III - Paul Sabatier
4 LAAS-RIS - Équipe Robotique et InteractionS

In this paper, we propose a transformer-based architecture for predicting contact forces during a physical human-robot interaction. Our Neural Network is composed of two main parts: a Multi-Layer Perceptron called Transducer and a Transformer. The former estimates, based on the kinematic data from a motion capture suit, the current contact forces. The latter predicts-taking as input the same kinematic data and the output of the Transducer-the human motions and the contact forces over a time window in the future. We validated our approach by testing the network on directions of motions that were not provided in the training set. We also compared our approach to a purely Transformer-based network, showing a better prediction accuracy of the contact forces.

Domains: Automatic

Alessia Fusco, Valerio Modugno, Dimitrios Kanoulas, Alessandro Rizzo, Marco Cognetti. Transformer-Based Prediction of Human Motions and Contact Forces for Physical Human-Robot Interaction. 2023. ⟨hal-04215765v2⟩