# Sequential Investment

We consider the problem of sequentially investing in a set of stocks.

However to start with we begin with the example of gambling on horses.

• Consider a sequence of $T$ horse races.
• Each race has $N$ horses and only one hose can win.
• Let $\mathbf h_t$ be the unit vector indicating the winning horse in the $t$th race i.e. $\mathbf h_t=(0,...,0,1,0,...,0)\in \{0,1\}^N$ with the one in the position of the $t$th winning horse. Further let $\mathbf H_t = (\mathbf h_\tau : \tau =1,...,t).$
• Let ${p}_t(i | \mathbf H_{t-1})$ be the proportion of our wealth that we invest in horse $i$ given the winners so far $\mathbf H_{t-1}$.
• If horse $n$ wins we multiply our wealth by $m_t(i)>0$ and $m_t(j)=0$ for all $j\neq i$.
• We wish to compare the performance of our prediction policy for betting $p_t(\cdot | \mathbf H_{t-1})$ and some set of experts $q_t(\cdot | \mathbf H_{t-1}) \in \mathcal Q$.

We want to compare the performance of our policy with the best expert. First we show that we can express this in a regret framework.

Ex 1. Argue that after $T$ races, the ratio between our wealth and the best expert in $\mathcal Q$ is given by

and similarly for $q_T(\mathbf H_T)$.

Ans 1. Starting with an initial wealth of $C$, the wealth attained from following $p$ and $q$ respectively are

Now divide the second term by the first and maximize over $q\in\mathcal Q$.

Ex 2. [Continued] Argue that the above ratio can be expressed in terms of regret:

where the loss of a probability distribution $p =(p(i) : i=1,...,N)$ and horse $h$ winning is given by

Ans 2. Take logs in [1] and

Def 3. [Minimax Regret] We look at the worse regret that a specific strategy $p$ can have relative to experts $\mathcal Q$,

and then we look for the best strategy

Here $\mathcal V_T(\mathcal Q)$ is called the minimax regret.

As we will see there is a unique policy that achieves this regret.

Def 4. [Normalized Maximum Likelihood Forcaster] This is the policy defined by

You can bet a proportion wealth

where there is only a prize for winning

Ex 5. For any class of experts $\mathcal Q$ and integrer $T$, the normalized maximum likelihood forcaster is the unique forecaster such that

Ans 5. For a distribution $p \neq p^*$ $\exists \mathbf H_T$ such that $p_T(\mathbf H_T) < p^*(\mathbf H_T)$ (remembering both distributions sum to one). So,

So $\min_p \mathcal V_T(p,\mathcal Q) \geq \mathcal V_T(p^*,\mathcal Q)$.

Ex 6. [Continued] Show that for all $\mathbf H_T$

Ans 6. This follows from the answer to [5].

## Sequential Investment

We now develop put theory for investment strategies. Here there is now longer one winning horse/stock. We consider the goal of maximizing final wealth with respect to a set of reference strategies.

• An investor trades over $T$ days.
• We consider a market with $N$ stocks.
• A market vector $\mathbf S = (S(1),...,S(N))$ gives the (relative) prices of stocks over each period given period.
• For a sequence of market vectors $\mathbf S_\tau$, $\tau=1,...,t$, we let $\mathcal H_t = (\mathbf S_\tau : \tau=1,..,t )$ denote the history of market vectors before time $t$.
• An investment is a probability distribution $\mathbf \pi = (\pi(1),...,\pi(N)) \in \mathcal D$ that give the proportions of (one unit of) wealth invested in each asset. This results in an increase in wealth of
• An investment strategy, ${\Pi}$, is a sequence of investments $\mathbf \pi_t (\mathcal H_{t-1}) = ( \pi_t ( i | \mathcal H_{t-1}) : i=1,...,N)$ for each time $t=1,..,T$.

Def 7. [Wealth Factor] The wealth factor of an on investment strategy is given by

Def 8. [Market Vector] For a vector ${\mathbf S}=(S^1,...,S^d)$ giving the relative prices of $d$ stocks, a Market vector investment in each of these stocks ${\mathbf n}=(n^1,...,n^d)$ and this results in an increase in wealth

Def 9. [Wealth Factor] For a sequence of investments and stock prices ${\mathbf n}^T\! =({\mathbf n}_t : t=1,...,T)$ and $\mathbf{S}^T\! =({\mathbf S}_t : t=1,...,T)$ , the wealth factor is the increase in wealth from time $t=1,..,T$

Def 10. [Investment Strategy] An investment strategy $\Pi$ is a sequence of functions $\mathbf{\pi}_t({\mathbf S}^{t-1})$, $t=1,...,T$ each giving a market vector.

Ex 11. [Buy-and-Hold] Buy-and-hold, $B h$, is an investment strategy where you distribute you initial wealth according to some fixed proportion $Q(i)$, $i=1,..,N$ and afterwards you don’t trade. Show that here the wealth factor is

Ans 11. It is clear the increase in asset $i$ is $\prod_{t=1}^T S_t(i)$ so the average increase is as given.

Ex 12. [Constantly rebalanced portfolio] A constantly rebalanced portfolio, $Cr$, is a policy that keeps a fixed proportion of wealth, $\mathbf F =(F(i): i=1,...,N)$, invested in each asset. Show that here the wealth factor is

Ans 12. Now the increase in wealth at time $t$ is

Thus the total increase is the product of these terms.

Def 13. [Minimax Regret] For a class of investment strategies ${\mathcal I}$, the regret of an investment strategy $\Pi$ is (similar to [2])

The minimax regret is then

Ex 14. [Interpreting the minimax wealth ratio] Show that if $\mathcal R\! g_T (\Pi,{\mathcal P} )=F_T$ then $\Pi$ has the same growth rate as the best investment strategy in ${\mathcal P}$, i.e. for all ${\mathbf S}^T$

(From this exercise we can interpret the regret as the factor from which we are away from the best expert.)

Ex 15. Show that if

then there exists a policy $\Pi$ such that for all histories $\mathcal H_T$

(i.e. The wealth factor of the policu $\Pi$ is guarenteed to be within a factor $F_T$ of the best policy in $\mathcal P$.)

Ans 15.

The minimax wealth ratio is the best possible logarithmic wealth ratio

Def 16. [Kelly Market Vector] A market vector that has only one non-zero component is called a Kelly Market vector, i.e. $\mathbf h_t=(0,...,0,1,0,...,0)\in \{0,1\}^N$.

Note that we considered exactly Kelly market vectors in the previous horse race example.

We want to consider the differences for the “investment policies“ and “prediction policies” for the (horse) betting problem considered previously.

For every investment policy we can define a prediction policy:

Ex 17. Given an investment policy $\Pi$ we can define a prediction policy induced by $\Pi$ by

Similarly, for every prediction policy we can define an investment policy:

Ans 17. Given a prediction strategy $p$ (as considered in the horse racing example), we can define an investment strategy induced by $\Pi$ by

Nb, note that the normalization constant is given by

Ex 18. The wealth factor $\Pi$ the investment strategy induced prediction policy $p$ is

where $F_t$ is given as above in Def. [SI:PinduceI].

Ans 18. From Def. 7, $\mathcal W\! f_T (\Pi, \mathcal H_t) = \prod_{t=1}^T \big\{ \mathbf S_{t}^\top \mathbf \pi_t (\mathcal H_{t-1}) \big\}$. Looking at each term in this product

Thus

In prinicple the investment problem should be more difficult that the prediction problem (used in horse racing). But the result below shows that actually they are in some sense equivalent.

Thrm 19. For a set of constantly rebalanced portfolios $\mathcal I$ and for the class of Prediction strategies $\mathcal P$ induced by $\mathcal I$ (cf. Def 17), we have that

Moreover, in this case, the minimax optimal investment strategy is the investment strategy induced by the normalized maximum likelihood prediction policy.

The first example confirms the intuition that investing is harder than prediction:

Ex 20. [Continued – from Thrm 19] Show that

Ans 20.

The first inequality holds since the Kelly market vectors are a subset of the set of Market Vectors. The subsequent equality holds since

and we can replace policies in $\mathcal I$ and $\mathcal P$ since then coincide on Kelly market vectors (cf. Def 17). The final equality and inequality follow by the definition of the minimax regret in the horse racing example (Def. 3).

Ex 21. Show that for non-negative numbers $a_1,...,a_T$ and $b_1,...,b_T$

Ans 21.

Ex 22. Show that the wealth factor for any investment policy can be expressed as a sum over the Kelly market vectors

Ans 22.

for $\mathbf H_T = (\mathbf h_t : t=1,...,T)$.

Ex 23. Show that for $\Pi$ the investment strategy induced by the normalized maximum likilihood policy, we have that

Ans 23.

(Def. ?? = Def. 13, [??,??]= [18,22], [??]=[21].)

Ex 24. [Continued] Show that for $\mathcal I$ the set of constantly rebalanced portfolios and for $\Pi^*$ the normalized maximum likilihood policy for $\mathcal I$, we have that

Ans 24. For a constantly rebalanced portfolio, $p_T(\mathbf H_T)=\prod_{t=1}^T p_t(\mathbf h_t)$.

Here [??] = [23] , Def. ?? = Def. 4, and [??] = [6].

Ex 25. [Continued] Show that Thrm 19 holds. That is that

Ans 25.(Here [??]=[24]) and by [20] the inequalities also hold in the other direction.