Regulation of the exploration-exploitation trade-off captures long-term changes in rat behaviour - Architectures et Modèles de l'Adaptation et de la Cognition Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Regulation of the exploration-exploitation trade-off captures long-term changes in rat behaviour

Résumé

In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to exploit what they currently believe to be their best option, or instead explore potential alternatives in case better opportunities are in fact available. While such a trade-off has been extensively studied in pretrained animals facing non-stationary decision-making tasks, it is yet unknown how they progressively tune it while progressively learning the task structure during pretraining. Here, we compared the ability of different computational models to account for longterm changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a threearmed bandit task across 24 days of pretraining. We found that the day-by-day evolution of rat performance and win-shift tendency revealed a progressive stabilization of the way they regulated the exploration-exploitation trade-off. We successfully captured these behavioural adaptations using a meta-learning model in which the exploration-exploitation trade-off is controlled by the animal's average reward rate.
Fichier principal
Vignette du fichier
Cinotti_30092023.pdf (1.86 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04228026 , version 1 (04-10-2023)

Identifiants

Citer

Francois Cinotti, Etienne Coutureau, Mehdi Khamassi, Alain Marchand, Benoît Girard. Regulation of the exploration-exploitation trade-off captures long-term changes in rat behaviour. 2023. ⟨hal-04228026⟩
39 Consultations
59 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More