Temporal difference learning with kernels for pricing american-style options - ENSTA Paris - École nationale supérieure de techniques avancées Paris Access content directly
Journal Articles Optimization Online Year : 2005

Temporal difference learning with kernels for pricing american-style options

Abstract

We propose in this paper to study the problem of estimating the cost-to-go function for an infinite-horizon discounted Markov chain with possibly continuous state space. For implementation purposes, the state space is typically discretized. As soon as the dimension of the state space becomes large, the computation is no more practicable, a phenomenon referred to as the curse of dimensionality. The approximation of dynamic programming problems is therefore of major importance. A powerful method for dynamic programming, often referred to as neuro-dynamic programming, consists in representing the Bellman function as a linear combination of a priori defined functions, called neurons. In this article, we propose an alternative approach very similar to temporal differences, based on functional gradient descent and using an infinite kernel basis.Furthermore, our algorithm, though aimed at infinite dimensional problems, is implementable in practice. We prove the convergence of this algorithm, and show applications on e.g. bermudan option pricing.
No file

Dates and versions

hal-00983326 , version 1 (25-04-2014)

Identifiers

  • HAL Id : hal-00983326 , version 1

Cite

Kengy Barty, Jean-Sébastien Roy, Cyrille Strugarek. Temporal difference learning with kernels for pricing american-style options. Optimization Online, 2005. ⟨hal-00983326⟩

Collections

ENSTA UMA_ENSTA
41 View
0 Download

Share

Gmail Facebook X LinkedIn More