Because I heard a few students had not come across some mathematical notation. Here is a quick introduction to a few mathematical terms.
Author: appliedprobability
Robbins-Munro
We review the proof by Robbins and Munro for finding fixed points. Stochastic gradient descent, Q-learning and a bunch of other stochastic algorithms can be seen as variants of this basic algorithm. We review the basic ingredients of the original proof.