3.LectureNotes ExpectedUtility
3.LectureNotes ExpectedUtility
3.LectureNotes ExpectedUtility
Microeconomic Theory
Expected Utility
1 Introduction
In consumer theory under certainty, it was assumed that prices, income,
and all other parameters influencing consumer choice were known with cer-
tainty. Further, the outcome resulting from any consumption or investment
decision by the consumer was deterministic. However, in the real world, a
consumer must make choices in an environment involving either uncertainty
about some parameter influencing the decision problem (for example, the
price of an asset that a consumer wants to purchase tomorrow may not be
known with certainty today, future income required to finance a current pur-
chase may be random) or there may be uncertainty about the consequences
stemming from an action (the returns from choosing a portfolio of stocks
may not be known with certainty today due to fluctuations in the value of
the stocks). In this chapter, we will formalize the choices confronting a con-
sumer in an environment of uncertainty by means of simple and compound
lotteries. We will then develop the foundations of expected utility theory in
order to choose among lotteries.
2 Lotteries
The first step in describing the behavior of the consumer under uncertainty
is to identify the objects of choice facing the consumer. For example,
the objects of choice when studying the behavior of the consumer under
certainty were consumption bundles representing non-negative quantities of
the goods under consideration. Under uncertainty, the objects of choice
are lotteries (or gambles). Lotteries are probability distributions over
outcomes (or consequences). The set of outcomes can be a discrete set
or a continuous interval. In the discrete case, outcomes can take a finite
or countably infinite number of values while in the continuous case they can
take any value on the real line (−∞ +∞) or some subset of it (i.e. they
1
can assume an uncountably infinite number of values).1 We will concentrate
here on the discrete case and assume for simplicity that there are a finite
number of outcomes given by the set = {1 2 }. At this stage
there is no restriction on the outcomes other than that they are discrete.
They could be monetary rewards, wealth levels, or consumption bundles.
x1
p1
x2
p2
p3 x3
...
Chance
Node ...
pn
xn
Probabilities
Outcome
2
Such a lottery that concentrates all probability mass on a single outcome is
called a degenerate lottery. From now on will denote both an outcome
as well as the degenerate lottery, , that gives with probability 1. The
set of all simple lotteries on is denoted as L . Also, since each outcome
is a degenerate simple lottery, ⊂ L .
3
Preferences º are assumed to satisfy three fundamental axioms. These are
also referred to as the rationality axioms.
Recall that each outcome in the finite set = {1 2 } can be
thought of as a degenerate lottery. Then under completeness and transi-
tivity of º, we can order the finite number of degenerate lotteries in
from best to worst according to º.2 We will assume that the outcomes are
indexed such that:
1 º 2 º · · · º −1 º (3)
It will be convenient to denote the best outcome, 1 , as and the worst
outcome, , as . Therefore º 2 º · · · º −1 º . In addition, to
rule out indifference throughout, we will assume that:
 (4)
2
Start with 1 and 2 . From completeness, either 1 º 2 or 2 º 1 . Suppose
1 º 2 . Let us call 1 the “winner” of this pairwise comparison. We now compare 1
with 3 to determine the winner. (If both 1 º 2 and 2 º 1 hold, then arbitrarily pick
either as the winner.) By transitivity, the winner of 1 with 3 will be at least as good
as 2 as well. Next compare the winner of 1 with 3 with 4 . Continue inductively to
determine the winner in a pairwise comparison in this way until the final comparison is
made with . The final winner is then the best in the finite set . After removing the
best lottery from , the reasoning can be repeated to determine the second-best element
in . Continuing in this way allows all elements in to be ranked from best to worst.
4
Indifference between two simple lotteries is denoted by ∼. Given any two
lotteries 1 2 ∈ L , 1 ∼ 2 is interpreted as 1 is indifferent to 2 or
both lotteries are equally good. The indifference relation ∼ can be induced
from the preference relation º as follows:
1 ∼ 2 ⇐⇒ 1 º 2 and 2 º 1 (5)
The properties of the indifference relation can be deduced from the assump-
tions imposed on º. In particular, if º satisfies reflexivity, completeness and
transitivity, then the indifference relation ∼ satisfies reflexivity, transitivity
and symmetry (if 1 ∼ 2 , then 2 ∼ 1 ).3
Strict preference for one simple lottery over another is denoted by Â. For
1 2 ∈ L , 1 Â 2 is interpreted as 1 is strictly preferred to 2 . Strict
preference can be induced from the preference relation º as follows:
1 Â 2 ⇐⇒ 1 º 2 and 2 ² 1 (6)
The properties of the strict preference relation can be inferred from the
assumptions imposed on º. In particular, if º satisfies reflexivity, com-
pleteness and transitivity, then strict preference  satisfies irreflexivity
(1 ¨ 1 ) and transitivity.4
1 ∼ 2 ⇐⇒ 1 % 2 and 2 % 1
2 ∼ 3 ⇐⇒ 2 % 3 and 3 % 2
Now from the RHS and the transitivity of % it follows that 1 % 3 and 3 % 1 and
therefore 1 ∼ 3 . The symmetry of ∼ follows similarly.
4
Irreflexivity and transitivity of  can be shown by contradiction. If 1  1 for some
lottery, then by definition 1 º 1 and 1 ² 1 . But 1 ² 1 contradicts reflexivity of º.
Next consider transitivity. Suppose 1 Â 2 , 2 Â 3 but 1 ¨ 3 . Note that 1 ¨ 3
is equivalent to 3 º 1 from completeness of º. Also note that 1 Â 2 is equivalent to
1 º 2 and 2 ² 1 . Now combining 3 º 1 and 1 º 2 yields 3 º 2 from the
transitivity of º. But 3 º 2 contradicts the starting hypothesis that 2 Â 3 .
5
for any third lottery 3 , either 1 Â 3 or 3 Â 2 or both)5 . We can then
induce the preference orders º and ∼ as follows:
1 º 2 ⇐⇒ 2 ¨ 1
1 ∼ 2 ⇐⇒ 1 ¨ 2 and 2 ¨ 1
5
The statements “ ⇒ ” and “ ⇒ ” are logically equivalent and the
latter statement is called the contrapositive of the former. It can be verified that negative
transitivity of  is the contrapositive of the transitivity of º.
6
We have already seen that negative transitivity of  is equivalent to transitivity of º.
Similarly, asymmetry of  is equivalent to completeness of º (“for no pair of lotteries 1
and 2 is it possible that 1 Â 2 and 2 Â 1 ” is equivalent to “1 ¨ 2 or 2 ¨ 1
for all pair of lotteries 1 and 2 ”. But note that 1 ¨ 2 or 2 ¨ 1 is the same as
2 º 1 or 1 º 2 or both.
6
5 Compound Lotteries
The next step is to develop more complex lotteries. A compound lottery
or multistage lottery is one in which the outcomes themselves are lotteries
(called sublotteries). That is, unlike the simple lottery in which all un-
certainty is resolved in one stage, the uncertainty in a compound lottery is
resolved in multiple stages. For instance, the structure of a two-stage lottery
is shown in Figure 2.
q x
p y
1-q
1-p r w
1-r z
7
x
pq
p(1-q) y
(1-p)r
(1-p)(1-r) w
Remark: While we will only work with simple lotteries, for the sake of
completeness we describe how to formally construct compound lotteries.
This is accomplished recursively as follows. Let L1 = L . Let L2 denote the
set of two-stage compound lottories which are probability distributions
P over
simple lotteries in L . Therefore for ≥ 0 = 1 2 and =1 = 1:
L2 = {(1 ◦ 1 ; 2 ◦ 2 ; ; ◦ ) : ∈ L1 = 1 2 }
Continuing inductively in this manner we have the set of ( + 1)-stage com-
pound lotteries that are probability distributions over -stage compound
lotteries:
L+1 = {(1 ◦ 1 ; 2 ◦ 2 ; ; ◦ ) : ∈ L = 1 2 }
7
The reduction of compound lotteries assumption is violated when an individual has a
preference for early or late resolution of uncertainty. This has been formally examined by
Kreps and Porteus (1978).
8
6 The Continuity Assumption
The next assumption is a technical restriction on preferences called conti-
nuity.
9
1 ∼ 2 ⇔ (1 ) = (2 ) (8)
1 Â 2 ⇔ (1 ) (2 ) (9)
The existence of such a utility function follows from a general result first
established by Debreu (1954)9 :
10
Therefore many authors do not distinguish between the two utility functions
and refer to as the vNM utility function over outcomes and as the vNM
utility function over lotteries. Further:
X
() = ( ) = 1 (1 ) + 2 (2 ) + · · · + ( ) (12)
=1
i.e. the same notation is used when referring to the utility from the outcome
or from the lottery. Both (10) and (12) are equivalent representations of
expected utility. We will use either form according to convenience. ¥
S1 S2
p
p
1-p
1-p
L1 L* L2 L*
11
The independence assumption is based on the observation that the events
that yield the sublottery , = 1 2 and ∗ in the lotteries above are mutu-
ally exclusive. Therefore the two sublotteries are not “consumed” together.
Since they are non-complementary, we can analyze preferences over sublot-
teries in the upper branch of the probability tree separately from the
outcome corresponding to the mutually exclusive lower branch of the prob-
ability tree. If 1 is at least as good as 2 , then irrespective of the common
sublottery in the lower branch, 1 is at least as good as 2 . Another way of
stating this assumption is that one lottery is at least as good as another if
and only if the realizations of the former lottery are at least as good as real-
izations of the latter, and these realizations occur with the same probability.
A detailed discussion is available in Machina (1987).
= ( ◦ 1 ; ◦ 2 ; ◦ 3 ; ; ◦ −1 ; ◦ )
º ( ◦ 1 ; 2 ◦ 2 ; ◦ 3 ; ; ◦ −1 ; ◦ )
º ( ◦ 1 ; 2 ◦ 2 ; 3 ◦ 3; ; ◦ −1 ; ◦ )
······························
º ( ◦ 1 ; 2 ◦ 2 ; 3 ◦ 3; ; −1 ◦ −1 ; ◦ )
º ( ◦ 1 ; 2 ◦ 2 ; 3 ◦ 3; ; −1 ◦ −1 ; ◦ )
=
12
Similarly it follows that º for any ∈ L . Therefore º º for
all ∈ L .
pL
1-pL
W
1 = { ∈ [0 1] : ( ◦ ; ◦ (1 − )) º }
2 = { ∈ [0 1] : ( ◦ ; ◦ (1 − )) ¹ }
Both 1 and 2 are closed from continuity. By definition of the best and
worst outcomes, 1 ∈ 1 and 0 ∈ 2 and therefore these sets are non-empty.
Further, since preferences º are complete, each ∈ [0 1] belongs to either
1 or 2 . Therefore 1 ∪ 2 = [0 1]. Since [0 1] is connected11 , it follows
10
Some authors use this implication as the definition of continuity to simplify the expo-
sition.
11
A set is disconnected if = 1 ∪ 2 where 1 and 2 are non-empty, and
1 ∩ 2 = ∅. A set is connected if it is not disconnected. Any interval in the real line
is connected.
13
that 1 ∩ 2 6= ∅ and thus there exists some ∈ 1 ∩ 2 .12 By definition
of the sets 1 and 2 :
∈ 1 =⇒ ( ◦ ; ◦ (1 − )) º
∈ 2 =⇒ ( ◦ ; ◦ (1 − )) ¹
B B
p
q
1-q
1-p
L1 W L2 W
First of all note that since  , then from the independence assumption
it follows that for 0 1:
= ( ◦ ; ◦ (1 − ))
 ( ◦ ; ◦ (1 − )) (13)
−
(⇐=) Suppose . Let = 1− . Consider Figure 7:
12
There is no assertion at this point that is unique. Uniqueness will follow later as
a consequence of the monotonicity result.
13
Equivalently, 1 º 2 if and only if ≥ .
14
q B
B B
p r r W
1-q
(indifferent to) (Strictly preferred
q B from independence q B
1-p 1-r and (12) to) 1-r
W W
1-q W 1-q
Figure 7: Monotonicity
Figure 7 shows that the lottery on the left, 1 , is indifferent to the one in
the middle (from the reduction of compound lotteries assumption) which in
turn is strictly preferred to the lottery on the right (which is simply 2 from
the reduction of compound lotteries assumption). We have therefore shown
that if , then 1 Â 2 .
These implications help establish the expected utility theorem of the next
section.
15
We will give a simple constructive graphical proof of this result for the case
where a simple lottery has only two possible outcomes: an outcome with
probability and the outcome with probability 1 − , where  . This
lottery is shown in Figure 8 below. The proof is easily generalized to any
simple lottery on the set .
x
p
1-p
L y
This fixes the utility numbers for the best and worst outcomes.
px B py B
1-px 1-py W
W
Degenerate lottery y
Degenerate lottery x
16
Consider the outcome which is indifferent to the simple lottery on the left
in Figure 9 from Implication 2. We will assign a utility number to in the
following way:
() = (15)
Note that the utility number is unique.14 Moreover, ( ) ≤ () ≤ ().
This rule of assigning utility numbers preserves the consumer’s ranking of
outcomes. For example, suppose outcome is preferred to . From Impli-
cation 2, there exists a probability 0 ≤ ≤ 1 such that is indifferent
to the simple lottery on the right in Figure 9. From the rule of assigning
probabilities:
() = (16)
From Implication 3, Â is equivalent to . Therefore, () ()
and the utility function preserves the preference ranking over outcomes.
We can now construct the von Neumann - Morgenstern utility function over
simple lotteries. Consider the lottery in Figure 8. Using the independence
assumption, the lottery in Figure 8 is indifferent to the one in Figure 10:
px B
p W
1-px
1-p
17
px B
p
1-px W
1-p py B
1-py W
ppx + (1-p)py
p(1-px) + (1-p)(1-py)
W
We have shown that the simple lottery of Figure 8 is indifferent to the one
in Figure 12. According to our rule of assigning utility numbers, any lottery
that is indifferent to some mix of and is assigned a utility number equal
to the probability of the outcome . Therefore the utility number assigned
18
to is:
and we have derived an expected utility form for the vNM utility function.
To complete the argument, we now have to show that the expected utility
form is a numerical representation of preferences, i.e. if º 0 , then
() ≥ (0 ). Noting that () = + (1 − ) , the lottery in Figure
11 can be written as:
∼ ( ◦ (); ◦ (1 − ()))
( ◦ (); ◦ (1 − ())) ∼
º 0
∼ ( ◦ (0 ); ◦ (1 − (0 )))
and therefore:
() ≥ (0 )
19
on the set of consumption bundles, then = ( ), 0 0, was an equiva-
lent utility function reflecting the same preference ranking. The implication
was that the utility numbers allotted to consumption bundles by themselves
had no connotation of utility or satisfaction but were just a means of re-
flecting the consumer’s ranking of bundles. More than one utility function
allotting a different set of numbers to consumption bundles could equally
well suffice to represent preferences as long as they preserved the underlying
ranking of consumption bundles.
= + 0 (18)
It will be convenient at this point to write expected utility in the form given
by (12). We will now prove:
(⇐=) Suppose there exists constants 0 and such that () = ()+.
Consider any simple lottery, = (1 ◦ 1 ; 2 ◦ 2 ; ; −1 ◦ −1 ; ◦ ).
Since has the expected utility form:
X
X
() = ( ) = 1 (1 ) + 2 (2 ) + · · · + ( ) = 1
=1 =1
20
() = () +
" #
X X
= ( ) +
=1 =1
X
= [ ( ) + ]
=1
X
= ( ) (20)
=1
() ≥ () ≥ ( )
() − ( )
= (22)
() − ( )
( ◦ ; ◦ (1 − )) = () + (1 − ) ( ) = ()
and therefore:
∼ ( ◦ ; ◦ (1 − ))
Since represents the same preferences, it follows that:
() = ( ◦ ; ◦ (1 − ))
21
and since also has an expected utility representation:
() = () + (1 − ) ( )
= ( ) + [ () − ( )]
∙ ¸
() − ( )
= ( ) + [ () − ( )]
() − ( )
∙ ¸ ∙ ¸
() − ( ) () − ( )
= () + ( ) − ( )
() − ( ) () − ( )
= () +
() − ( )
= 0
() − ( )
This proves the theorem. Another way of stating this result is that the
expected utility form is unique up to an increasing linear transformation.
The fact that the expected utility form is unique only up to an increasing
linear transformation means that the expected utility property is cardinal
in nature. The utility numbers attached to outcomes and lotteries - and in
particular the differences between the numbers - have significance and cannot
be changed in an arbitrary way without destroying the ranking implied by
the expected utility form. For example, suppose there are four possible
outcomes, and and the utility numbers attached to them are such
that:
() − () () − () (23)
A simple rearrangement of the above inequality gives the equivalent condi-
tion that:
1 1 1 1
() + () () + () (24)
2 2 2 2
Now consider the two simple lotteries shown in Figure 13. Note that 1 Â 2
since:
1 1 1 1
(1 ) = () + () () + () = (2 ) (25)
2 2 2 2
22
x y
1/2
1/2
1/2
1/2
L1 z L2 w
23
Of course, the new vNM utility function no longer has an expected utility
representation. But if all that we are interested in is preserving the prefer-
ence ranking of simple lotteries under , then this ranking is respected by
any arbitrary monotonic increasing function as well. ¥
12 Distribution Functions
In formal analysis, a lottery can be represented by a distribution function
on the set of outcomes. The advantage of letting the objects of choice under
uncertainty be a distribution function is that it permits the outcomes to be
either discrete or continuous. When the outcomes are discrete, the set of all
possible outcomes is either finite or countably infinite; when the outcomes
are continuous, the set of all possible outcomes is uncountably infinite.
In words, () is the probability that the random variable takes a value
that is less than or equal to the real number .
0 1 2 4
1 1 1
() 0 4 2 4
24
Then the distribution function corresponding to the above probability mass
function is given by:
0 1 2 4
1 3
() 0 4 4 1
It can be verified that () = 0, () = 1, and 0 () = () 0 on [ ].
¥
25
The expected value or mean of the random variable can be defined in
the discrete case as: X
[] = () (34)
:()0
References
[1] A. Barten and V. Böhm, “Consumer Theory”. In Handbook of Mathe-
matical Economics, K. Arrow and M. Intrilligator (eds), (1982), 382-429,
North Holland.
26
[4] D.M. Kreps and E.L. Porteus, “Temporal Resolution of Uncertainty and
Dynamic Choice Theory”, Econometrica, 46 (1978), 185-200.
27