On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learning

By Bolin Gao, Lacra Pavel. 2017

384 citations recorded by the source corpus.

In this paper, we utilize results from convex analysis and monotone operator theory to derive additional properties of the softmax function that have not yet been covered in the existing literature. In particular, we show that the softmax function is the monotone gradient map of the log-sum-exp function. By exploiting this connection, we show that the inverse temperature parameter determines the Lipschitz and co-coercivity properties of the softmax function. We then demonstrate the usefulness of these properties through an application in game-theoretic reinforcement learning.

Subfields: Artificial Intelligence, Public Health, Environmental and Occupational Health, Sociology and Political Science, Reinforcement Learning, Game & Decision Theory

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Stefano Ermon
  3. Yoshua Bengio
  4. Mohit Bansal
  5. Quoc V. Le
  6. Percy Liang
  7. Ruslan Salakhutdinov
  8. Jianfeng Gao

In Public Health, Environmental and Occupational Health

  1. Michael L. Littman
  2. Karsten M. Borgwardt
  3. Franccois Fleuret
  4. Apoorv Vyas
  5. Dipendra Kumar Misra
  6. Angelos Katharopoulos
  7. Kavosh Asadi

In Sociology and Political Science

  1. Michael L. Littman
  2. Junjie Yan
  3. Aditya Grover
  4. Franccois Fleuret
  5. Bernard Ghanem
  6. Apoorv Vyas
  7. Dipendra Kumar Misra
  8. Sepp Hochreiter

In Reinforcement Learning

  1. Sergey Levine
  2. Kavosh Asadi
  3. Dipendra Kumar Misra
  4. J. Urgen Schmidhuber
  5. Aditya Grover
  6. Stefano Ermon
  7. Michael L. Littman
  8. Pieter Abbeel

In Game & Decision Theory

  1. Stefano Ermon
  2. Aditya Grover
  3. Michael Widrich
  4. Michael L. Littman
  5. Eric Wang
  6. Franccois Fleuret
  7. Bernard Ghanem
  8. Apoorv Vyas

Citations in the corpus