Preply — Study more efficiently by working with a personal tutor. Get 50% off.Affiliate

Wikipedia

Kelly criterion

Kelly criterion

In finance, the Kelly criterion (or Kelly strategy or Kelly bet) is a formula for risk allocation with the sizing a sequence of bets by maximizing the long-term expected value of the logarithm of wealth, which is equivalent to maximizing the long-term expected geometric growth rate. John Larry Kelly Jr., a researcher at Bell Labs, described the criterion in 1956. The practical use of the formula has been demonstrated for gambling, and the same idea was used to explain diversification in investment management. In the 2000s, Kelly-style analysis became a part of mainstream investment theory and the claim has been made that well-known, successful investors including Warren Buffett and Bill Gross use Kelly methods (also see intertemporal portfolio choice). It is also the standard replacement of statistical power in anytime-valid statistical tests and confidence intervals, based on e-values and e-processes.

Relative bet sizes Gamblers often state the size of their bets relative to the Kelly criterion. A full Kelly bet is a bet made at the Kelly Criterion. A half Kelly bet is half the size of a full Kelly bet. A quarter Kelly bet is a quarter of the size of a full Kelly. Gamblers would use less than full Kelly in order to reduce the chance of ruin, reduce volatility, and account for model error. Due to the high drawdowns, gamblers in practice find fractional Kellies much better emotionally than full Kelly. This reduced volatility is a tradeoff, as it increases the time to reach an intended wealth or decreases the wealth growth rate. It has been found that betting an amount larger than the Kelly amount increases the risk of ruin.

Binary return rates In a system where the return on an investment or a bet is binary, so an interested party either wins or loses a fixed percentage of their bet, the expected growth rate coefficient yields a very specific solution for an optimal betting percentage.

Formula The Kelly bet is:

f = p l − q g {\displaystyle f={\frac {p}{l}}-{\frac {q}{g}}}

where:

f {\displaystyle f} is the fraction of the assets to apply to the security.

p {\displaystyle p} is the probability that the investment increases in value.

q {\displaystyle q} is the probability that the investment decreases in value ( q = 1 − p {\displaystyle q=1-p} ).

g {\displaystyle g} is the fraction that is gained in a positive outcome. If the security price rises 10%, then g = 0.1 {\displaystyle g=0.1} .

l {\displaystyle l} is the fraction that is lost in a negative outcome. If the security price falls 10%, then l = 0.1 {\displaystyle l=0.1} . In gambling, typically the entire wager is lost, which corresponds to ⁠ l = 1.0 {\displaystyle l=1.0} ⁠. Note that the Kelly criterion is perfectly valid only for fully known outcome probabilities, which is almost never the case with investments. In addition, risk-averse strategies invest less than the full Kelly fraction. The general form can be rewritten as follows

f = p l ( 1 − 1 − p p l g ) = p l ( 1 − 1 P R 1 R R R ) {\displaystyle f={\frac {p}{l}}\left(1-{\frac {1-p}{p}}{\frac {l}{g}}\right)={\frac {p}{l}}\left(1-{\frac {1}{\mathit {PR}}}{\frac {1}{\mathit {RRR}}}\right)}

where:

P R = p 1 − p {\displaystyle {\mathit {PR}}={\frac {p}{1-p}}} is the win-loss probability ratio, which is the ratio of probabilities of winning to losing bets.

R R R = g l {\displaystyle {\mathit {RRR}}={\frac {g}{l}}} is the reward-to-risk ratio of outcome sizes, which is the winning skew. It is clear that, at least, one of the factors P R {\displaystyle {\mathit {PR}}} or R R R {\displaystyle {\mathit {RRR}}} needs to be larger than 1 for having an edge (so f > 0 {\displaystyle f>0} ). It is even possible that the win-loss probability ratio is unfavorable P R < 1 {\displaystyle {\mathit {PR}}<1} , but one has an edge as long as P R × R R R > 1 {\displaystyle {\mathit {PR}}\times {\mathit {RRR}}>1} . The Kelly formula can easily result in a fraction higher than 1, such as with losing size l ≪ 1 {\displaystyle l\ll 1} (see the above expression with factors of R R R {\displaystyle {\mathit {RRR}}} and P R {\displaystyle {\mathit {PR}}} ). This happens somewhat counterintuitively, because the Kelly fraction formula compensates for a small losing size with a larger bet. However, in most real situations, there is high uncertainty about all parameters entering the Kelly formula. In the case of a Kelly fraction higher than 1, it is theoretically advantageous to use leverage to purchase additional securities on margin.

Example In a study, each participant was given $25 and asked to place even-money bets on a coin that would land heads 60% of the time. Participants had 30 minutes to play, so could place about 300 bets, and the prizes were capped at $250. But the behavior of the test subjects was far from optimal:

Remarkably, 28% of the participants went bust, and the average payout was just $91. Only 21% of the participants reached the maximum. 18 of the 61 participants bet everything on one toss, while two-thirds gambled on tails at some stage in the experiment. Using the Kelly criterion and based on the odds in the experiment (ignoring the cap of $250 and the finite duration of the test), the right approach would be to bet 20% of one's bankroll on each toss of the coin, which works out to a 2.034% average gain each round. This is a geometric mean, not the arithmetic rate of 4% (r = 0.2 x (0.6 - 0.4) = 0.04). The geometric mean wealth after 300 rounds works out to $10,505 ( = 25 ⋅ ( 1.02034 ) 300 {\displaystyle =25\cdot (1.02034)^{300}} ) if it were not capped. In this particular game, because of the cap, a strategy of betting only 12% of the pot on each toss would have even better results (a 95% probability of reaching the cap and an average payout of $242.03).

Proof Heuristic proofs of the Kelly criterion are straightforward. The Kelly criterion maximizes the expected value of the logarithm of wealth (the expectation value of a function is given by the sum, over all possible outcomes, of the probability of each particular outcome multiplied by the value of the function in the event of that outcome). We start with 1 unit of wealth and bet a fraction f {\displaystyle f} of that wealth. The probability of winning is p {\displaystyle p} , the payoff multiplier is g {\displaystyle g} , and the resulting wealth is equal to 1 + f g {\displaystyle 1+fg} . The probability of losing is q = 1 − p {\displaystyle q=1-p} , the loss multiplier is l {\displaystyle l} , and the resulting wealth is equal to 1 − f l {\displaystyle 1-fl} . Therefore, we are trying to maximize the utility ⁠ u {\displaystyle u} ⁠:

u = p log ⁡ ( 1 + f g ) + q log ⁡ ( 1 − f l ) . {\displaystyle u=p\log(1+fg)+q\log(1-fl)\,.}

To find the value of f {\displaystyle f} for which the utility is maximized, we differentiate the above expression with respect to ⁠ f {\displaystyle f} ⁠ and set this equal to zero. This gives:

0 = d u d f = p g 1 + f g + − q l 1 − f l . {\displaystyle 0={\frac {du}{df}}={\frac {pg}{1+fg}}+{\frac {-ql}{1-fl}}\,.}

Rearranging this equation to solve for the value of f {\displaystyle f} gives the Kelly criterion:

f = p l − q g . {\displaystyle f={\frac {p}{l}}-{\frac {q}{g}}\,.}

To be thorough, we should also consider the behaviour as f {\displaystyle f} approaches the boundaries − 1 g {\displaystyle -{\frac {1}{g}}} and 1 l {\displaystyle {\frac {1}{l}}} since there can be a maximum there without the derivative being 0. But u {\displaystyle u} tends to −∞ for both. Finally, we need to show that the critical point found is not a minimum; this can be shown by computing the second derivative which is strictly negative for all f {\displaystyle f} in the domain. For this value of ⁠ f {\displaystyle f} ⁠, the wealth after a win would be ⁠ 1 + f g = 1 + ( p l − q g ) g = p ( 1 + g l ) {\displaystyle 1+fg=1+\left({\frac {p}{l}}-{\frac {q}{g}}\right)g=p\left(1+{\frac {g}{l}}\right)} ⁠ and the wealth after a loss would be ⁠ 1 − f l = 1 − ( p l − q g ) l = q ( 1 + l g ) {\displaystyle 1-fl=1-\left({\frac {p}{l}}-{\frac {q}{g}}\right)l=q\left(1+{\frac {l}{g}}\right)} ⁠. The expected geometric growth rate is ⁠ r = exp ⁡ ( u ) {\displaystyle r=\exp(u)} ⁠, which is ⁠ r = ( 1 + f g ) p ( 1 − f l ) q {\displaystyle r=(1+fg)^{p}(1-fl)^{q}} ⁠.

Non-binary return rates If the return rates on an investment or a bet are continuous in nature the optimal growth rate coefficient must take all possible events into account.

Application to the stock market In mathematical finance, if security weights maximize the expected geometric growth rate (which is equivalent to maximizing log wealth), then a portfolio is growth optimal. The Kelly Criterion shows that for a given volatile security this is satisfied when

f = μ − r σ 2 {\displaystyle f={\frac {\mu -r}{\sigma ^{2}}}}

where f {\displaystyle f} is the fraction of available capital invested that maximizes the expected geometric growth rate, μ {\displaystyle \mu } is the expected growth rate coefficient, σ 2 {\displaystyle \sigma ^{2}} is the variance of the growth rate coefficient and r {\displaystyle r} is the risk-free rate of return. Note that a symmetric probability density function was assumed here. Computations of growth optimal portfolios can suffer tremendous garbage in, garbage out problems. For example, the cases below take as given the expected return and covariance structure of assets, but these parameters are at best estimates or models that have significant uncertainty. If portfolio weights are largely a function of estimation errors, then Ex-post performance of a growth-optimal portfolio may differ fantastically from the ex-ante prediction. Parameter uncertainty and estimation errors are a large topic in portfolio theory. An approach to counteract the unknown risk is to invest less than the Kelly criterion. Rough estimates are still useful. If we take excess return 6% and volatility 15% then the yearly Sharpe ratio is (μ − r)/σ = 40%. The Kelly fraction (i.e., the appropriate investment) for these values is (μ − r)/σ2 = 267%. (That is, one could achieve the Kelly criterion by investing in a diverse set of stocks with a beta of 2.67.) However the market invests 100% in itself so the market is apparently making its investment decisions using 1 / 2.67 = 37.5% of the Kelly criterion value. A detailed paper by Edward O. Thorp and a co-author estimates Kelly fraction to be 117% for the American stock market SP500 index. Significant downside tail-risk for equity markets is another reason to reduce Kelly fraction from naive estimate (for instance, to reduce to half-Kelly).

Proof A rigorous and general proof can be found in Kelly's original paper or in some of the other references listed below. Some corrections have been published. We give the following non-rigorous argument for the case with g = l = 1 {\displaystyle g=l=1} (a 50:50 "even money" bet) to show the general idea and provide some insights. When g = l = 1 {\displaystyle g=l=1} , a Kelly bettor bets 2 p − 1 {\displaystyle 2p-1} times their initial wealth W {\displaystyle W} , as shown above. If they win, they have 2 p W {\displaystyle 2pW} after one bet. If they lose, they have 2 ( 1 − p ) W {\displaystyle 2(1-p)W} . Suppose they make N {\displaystyle N} bets like this, and win K {\displaystyle K} times out of this series of N {\displaystyle N} bets. The resulting wealth will be:

2 N p K ( 1 − p ) N − K W . {\displaystyle 2^{N}p^{K}(1-p)^{N-K}W\!.}

The ordering of the wins and losses does not affect the resulting wealth. Suppose another bettor bets a different amount, ( 2 p − 1 + Δ ) W {\displaystyle (2p-1+\Delta )W} for some value of Δ {\displaystyle \Delta } (where Δ {\displaystyle \Delta } may be positive or negative). They will have ( 2 p + Δ ) W {\displaystyle (2p+\Delta )W} after a win and [ 2 ( 1 − p ) − Δ ] W {\displaystyle [2(1-p)-\Delta ]W} after a loss. After the same series of wins and losses as the Kelly bettor, they will have:

( 2 p + Δ ) K [ 2 ( 1 − p ) − Δ ] N − K W {\displaystyle (2p+\Delta )^{K}[2(1-p)-\Delta ]^{N-K}W}

Take the derivative of this with respect to Δ {\displaystyle \Delta } and get:

K ( 2 p + Δ ) K − 1 [ 2 ( 1 − p ) − Δ ] N − K W − ( N − K ) ( 2 p + Δ ) K [ 2 ( 1 − p ) − Δ ] N − K − 1 W {\displaystyle K(2p+\Delta )^{K-1}[2(1-p)-\Delta ]^{N-K}W-(N-K)(2p+\Delta )^{K}[2(1-p)-\Delta ]^{N-K-1}W}

The function is maximized when this derivative is equal to zero, which occurs at:

K [ 2 ( 1 − p ) − Δ ] = ( N − K ) ( 2 p + Δ ) {\displaystyle K[2(1-p)-\Delta ]=(N-K)(2p+\Delta )}

which implies that

Δ = 2 ( K N − p ) {\displaystyle \Delta =2\left({\frac {K}{N}}-p\right)}

but the proportion of winning bets will eventually converge to:

lim N → + ∞ K N = p {\displaystyle \lim _{N\to +\infty }{\frac {K}{N}}=p}

according to the weak law of large numbers. So in the long run, final wealth is maximized by setting Δ {\displaystyle \Delta } to zero, which means following the Kelly strategy. This illustrates that Kelly has both a deterministic and a stochastic component. If one knows K and N and wishes to pick a constant fraction of wealth to bet each time (otherwise one could cheat and, for example, bet zero after the Kth win knowing that the rest of the bets will lose), one will end up with the most money if one bets:

( 2 K N − 1 ) W {\displaystyle \left(2{\frac {K}{N}}-1\right)W}

each time. This is true whether N {\displaystyle N} is small or large. The "long run" part of Kelly is necessary because K is not known in advance, just that as N {\displaystyle N} gets large, K {\displaystyle K} will approach p N {\displaystyle pN} . Someone who bets more than Kelly can do better if K > p N {\displaystyle K>pN} for a stretch; someone who bets less than Kelly can do better if K < p N {\displaystyle K<pN} for a stretch, but in the long run, Kelly always wins. The heuristic proof for the general case proceeds as follows. In a single trial, if one invests the fraction f {\displaystyle f} of their capital, if the strategy succeeds, the capital at the end of the trial increases by the factor 1 − f + f ( 1 + g ) = 1 + f g {\displaystyle 1-f+f(1+g)=1+fg} , and, likewise, if the strategy fails, the capital is decreased by the factor 1 − f l {\displaystyle 1-fl} . Thus at the end of N {\displaystyle N} trials (with p N {\displaystyle pN} successes and q N {\displaystyle qN} failures), the starting capital of $1 yields

C N = ( 1 + f g ) p N ( 1 − f l ) q N . {\displaystyle C_{N}=(1+fg)^{pN}(1-fl)^{qN}.}

Maximizing log ⁡ ( C N ) / N {\displaystyle \log(C_{N})/N} , and consequently C N {\displaystyle C_{N}} , with respect to f {\displaystyle f} leads to the desired result

f ∗ = p / l − q / g . {\displaystyle f^{*}=p/l-q/g.}

Edward O. Thorp provided a more detailed discussion of this formula for the general case. There, it can be seen that the substitution of p {\displaystyle p} for the ratio of the number of "successes" to the number of trials implies that the number of trials must be very large, since p {\displaystyle p} is defined as the limit of this ratio as the number of trials goes to infinity. In brief, betting f {\displaystyle f} each time will likely maximize the wealth growth rate only in the case where the number of trials is very large, and p {\displaystyle p} , g {\displaystyle g} , and l {\displaystyle l} are the same for each trial. In practice, this is a matter of playing the same game over and over, where the probability of winning and the payoff odds are always the same. In the heuristic proof above, p N {\displaystyle pN} successes and q N {\displaystyle qN} failures are highly likely only for very large N {\displaystyle N} .

Multiple outcomes Kelly's criterion may be generalized on gambling on many mutually exclusive outcomes, such as in horse races. Suppose there are several mutually exclusive outcomes. The probability that the k {\displaystyle k} -th horse wins the race is p k {\displaystyle p_{k}} , the total amount of bets placed on k {\displaystyle k} -th horse is B k {\displaystyle B_{k}} , and

β k = B k ∑ i B i = D 1 + Q k , {\displaystyle \beta _{k}={\frac {B_{k}}{\sum _{i}B_{i}}}={\frac {D}{1+Q_{k}}},}

where Q k {\displaystyle Q_{k}} are the pay-off odds. D = 1 − t t {\displaystyle D=1-tt} , is the dividend rate where t t {\displaystyle tt} is the track take or tax, D β k {\displaystyle {\frac {D}{\beta _{k}}}} is the revenue rate after deduction of the track take when k {\displaystyle k} -th horse wins. The fraction of the bettor's funds to bet on k {\displaystyle k} -th horse is f k {\displaystyle f_{k}} . Kelly's criterion for gambling with multiple mutually exclusive outcomes gives an algorithm for finding the optimal set S o {\displaystyle S^{o}} of outcomes on which it is reasonable to bet and it gives explicit formula for finding the optimal fractions f k o {\displaystyle f_{k}^{o}} of bettor's wealth to be bet on the outcomes included in the optimal set S o {\displaystyle S^{o}} . The algorithm for the optimal set of outcomes consists of four steps:

Calculate the expected revenue rate for all possible (or only for several of the most promising) outcomes: e r i = D p i β i = p i ( Q i + 1 ) {\displaystyle er_{i}={\frac {Dp_{i}}{\beta _{i}}}=p_{i}(Q_{i}+1)}

Reorder the outcomes so that the new sequence e r k {\displaystyle er_{k}} is non-increasing. Thus e r 1 {\displaystyle er_{1}} will be the best bet. Set S = ∅ {\displaystyle S=\varnothing } (the empty set), k = 1 {\displaystyle k=1} , R ( S ) = 1 {\displaystyle R(S)=1} . Thus the best bet e r k = e r 1 {\displaystyle er_{k}=er_{1}} will be considered first. Repeat: If e r k = D β k p k > R ( S ) {\displaystyle er_{k}={\frac {D}{\beta _{k}}}p_{k}>R(S)} then insert k {\displaystyle k} -th outcome into the set: S = S ∪ { k } {\displaystyle S=S\cup \{k\}} , recalculate R ( S ) {\displaystyle R(S)} according to the formula: R ( S ) = D ∑ k ∉ S p k D − ∑ k ∈ S β k {\displaystyle R(S)={\frac {D\sum _{k\notin S}p_{k}}{D-\sum _{k\in S}\beta _{k}}}} and then set k = k + 1 {\displaystyle k=k+1} , Otherwise, set S o = S {\displaystyle S^{o}=S} and stop the repetition. If the optimal set S o {\displaystyle S^{o}} is empty then do not bet at all. If the set S o {\displaystyle S^{o}} of optimal outcomes is not empty, then the optimal fraction f k o {\displaystyle f_{k}^{o}} to bet on k {\displaystyle k} -th outcome may be calculated from this formula:

f i = p i − β i ∑ k ∉ S p k ( D − ∑ k ∈ S β k ) . {\displaystyle f_{i}=p_{i}-\beta _{i}{\frac {\sum _{k\notin S}p_{k}}{\left(D-\sum _{k\in S}\beta _{k}\right)}}.}

One may prove that

R ( S o ) = 1 − ∑ i ∈ S o f i o {\displaystyle R(S^{o})=1-\sum _{i\in S^{o}}{f_{i}^{o}}}

where the right hand-side is the reserve rate. Therefore, the requirement e r k = D β k p k > R ( S ) {\displaystyle er_{k}={\frac {D}{\beta _{k}}}p_{k}>R(S)} may be interpreted as follows: k {\displaystyle k} -th outcome is included in the set S o {\displaystyle S^{o}} of optimal outcomes if and only if its expected revenue rate is greater than the reserve rate. The formula for the optimal fraction f k o {\displaystyle f_{k}^{o}} may be interpreted as the excess of the expected revenue rate of k {\displaystyle k} -th horse over the reserve rate divided by the revenue after deduction of the track take when k {\displaystyle k} -th horse wins or as the excess of the probability of k {\displaystyle k} -th horse winning over the reserve rate divided by revenue after deduction of the track take when k {\displaystyle k} -th horse wins. The binary growth exponent is

G o = ∑ i ∈ S p i log 2 ⁡ ( e r i ) + ( 1 − ∑ i ∈ S p i ) log 2 ⁡ ( R ( S o ) ) , {\displaystyle G^{o}=\sum _{i\in S}{p_{i}\log _{2}(er_{i})}+\left(1-\sum _{i\in S}{p_{i}}\right)\log _{2}(R(S^{o})),}

and the doubling time is

T d = 1 G o . {\displaystyle T_{d}=

Tags

  • 1956 introductions
  • Formulas
  • Gambling mathematics
  • Information theory
  • Optimal decisions
  • Portfolio theories
  • Wagering