Language Grounding through Social Interactions and Curiosity-Driven Multi-Goal Learning - ENSTA Paris - École nationale supérieure de techniques avancées Paris Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Language Grounding through Social Interactions and Curiosity-Driven Multi-Goal Learning

Résumé

Autonomous reinforcement learning agents, like children, do not have access to predefined goals and reward functions. They must discover potential goals, learn their own reward functions and engage in their own learning trajectory. Children, however, benefit from exposure to language, helping to organize and mediate their thought. We propose LE2 (Language Enhanced Exploration), a learning algorithm leveraging intrinsic motivations and natural language (NL) interactions with a descriptive social partner (SP). Using NL descriptions from the SP, it can learn an NL-conditioned reward function to formulate goals for intrinsically motivated goal exploration and learn a goal-conditioned policy. By exploring, collecting descriptions from the SP and jointly learning the reward function and the policy, the agent grounds NL descriptions into real behavioral goals. From simple goals discovered early to more complex goals discovered by experimenting on simpler ones, our agent autonomously builds its own behavioral repertoire. This naturally occurring curriculum is supplemented by an active learning curriculum resulting from the agent's intrinsic motivations. Experiments are presented with a simulated robotic arm that interacts with several objects including tools.
Fichier principal
Vignette du fichier
1911.03219.pdf (3.89 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02369866 , version 1 (19-11-2019)

Identifiants

Citer

Nicolas Lair, Cédric Colas, Rémy Portelas, Jean-Michel Dussoux, Peter Dominey, et al.. Language Grounding through Social Interactions and Curiosity-Driven Multi-Goal Learning. NeurIPS Workshop on Visually Grounded Interaction and Language, Dec 2019, Vancouver, Canada. ⟨hal-02369866⟩
74 Consultations
64 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More