We consider a continuous time analogue of Markov Decision Processes.
The link below contains notes PDF for this years stochastic control course
I’ll upload individual posts for each section. I’ll likely update these notes and add more exercises over the coming semester. I’ll add this update in a further post at the end of the course. Comments, typos, suggestions are always welcome.
Here is a quick request for comments for Probability 1 students. Here are two answers saying that the probability that a grandfather, father and son are all born on the same day.
The first answer is sort of wrong because it assumes you specify in advance date of birth. The second answer is right because we assume in advance we are given three generations and we assume we deal with a first born son.
Please leave comments below and will forward them on to BBC.