The Nash Equilibrium
The Nash Equilibrium
The Nash Equilibrium
Edited by Vernon L. Smith, George Mason University, Fairfax, VA, and approved January 28, 2004 (received for review January 7, 2004)
In 1950, John Nash contributed a remarkable one-page PNAS article that defined and characterized a notion of equilibrium for n-
person games. This notion, now called the ‘‘Nash equilibrium,’’ has been widely applied and adapted in economics and other behav-
ioral sciences. Indeed, game theory, with the Nash equilibrium as its centerpiece, is becoming the most prominent unifying theory
of social science. In this perspective, we summarize the historical context and subsequent impact of Nash’s contribution.
n a brief 1950 communication to The notion of a strategy is quite gen- advice is an equilibrium, however, this
www.pnas.org兾cgi兾doi兾10.1073兾pnas.0308738101 PNAS 兩 March 23, 2004 兩 vol. 101 兩 no. 12 兩 3999 – 4002
the agreement if the others do. Viewed Equilibrium and Social Dilemmas is not an equilibrium, is going to be un-
in this way, the Nash equilibrium has The Nash equilibrium is useful not just stable in ways that can make coopera-
helped to clarify a distinction sometimes when it is itself an accurate predictor of tion difficult to maintain. This observa-
still made between ‘‘cooperative’’ and how people will behave in a game but tion has been confirmed in many
‘‘noncooperative’’ games, with coopera- also when it is not, because then it iden- subsequent experiments on this and
tive games being those in which agree- tifies situations in which there is a ten- more general ‘‘social dilemmas’’ (see,
ments can be enforced (e.g., through the sion between individual incentives and e.g., refs. 21–23). You can put yourself
courts), and noncooperative games be- other motivations. A class of problems into a social dilemma game by going to
ing those in which no such enforcement that have received a good deal of study the link: http://veconlab.econ.virginia.
mechanism exists, so that only equilib- from this point of view is the family of edu/tddemo.htm and playing against
rium agreements are sustainable. One ‘‘social dilemmas,’’ in which there is a decisions retrieved from a database.
trend in modern game theory, often re- socially desirable action that is not a This Traveler’s Dilemma game is some-
ferred to as the ‘‘Nash program,’’ is to Nash equilibrium. Indeed, one of the what more complex than a prisoner’s
erase this distinction by including any first responses to Nash’s definition of dilemma, in that the best decision is not
relevant enforcement mechanisms in the equilibrium gave rise to one of the best independent of your beliefs about what
known models in the social sciences, the strategy might be selected by the other
model of the game, so that all games
Prisoners’ Dilemma. This model began player (24).
can be modeled as noncooperative.
Nash took initial steps in this direction life as a simple experiment conducted in
Design of Markets and Social Institutions
in his early and influential model of bar- January 1950 at the Rand Corporation
by mathematicians Melvin Dresher and One of the ways in which research on
gaining as a cooperative game (9) and dilemmas and other problems of collec-
then as a noncooperative game (10). Merrill Flood, to demonstrate that the
Nash equilibrium would not necessarily tive action has proceeded is to look for
Nash’s 1950 PNAS paper not only the social institutions that have been
formulated the definition of equilibrium be a good predictor of behavior. Each
of the two players in that game had to invented to change games from prison-
but also announced the proof of exis- er’s dilemmas to games in which cooper-
tence that he obtained using Kakutani’s choose one of two decisions, which, for
expositional purposes, we will call ‘‘co- ation is sustainable as an equilibrium;
(11) fixed point theorem. This technique see e.g., Elinor Ostrom’s 1998 presiden-
of proof subsequently became standard operate’’ or ‘‘defect.’’ The game speci-
fies the payoffs for each player for each tial address to the American Political
in economics, e.g., the notion of a com- Science Association (25). For example,
of the four possible outcomes: (cooper-
petitive equilibrium as a vector of antici- just as firms selling similar products may
ate, cooperate), (cooperate, defect), (de-
pated prices resulting in production and undercut each other’s price until price is
fect, cooperate), and (defect, defect).
Downloaded from https://www.pnas.org by 201.141.109.122 on February 27, 2023 from IP address 201.141.109.122.
consumption decisions that generate the driven down to cost, it is possible for a
The payoffs used were such that each
same vector of prices. In a personal series of actions and reactions to force
player’s best counter to either of the
communication to one of the authors, other’s choices was to defect, but both players in a game into a situation that is
Nash remarked, ‘‘I know that S. Kaku- players would earn more if they both relatively bad for all concerned, which
tani’s generalized fixed point theorem cooperated than if they both chose their provides strong incentives for restric-
was actually inspired to improve on equilibrium decision and defected. tions on unilateral actions. This kind of
some arguments made by von Neumann ‘‘unraveling’’ is encountered in some
Nash’s thesis advisor, Albert Tucker,
in an economic context in the 1930s.’’ labor markets in which employers may
was preparing a talk on recent develop-
Nash shared the 1994 Nobel Prize try to gain an advantage by making
ments in game theory to be given to the
with John Harsanyi and Reinhard early offers. In the market for federal
Stanford Psychology Department when
Selten. Harsanyi was cited for extending appellate court clerks, for example, posi-
he saw the Dresher and Flood payoff
the Nash equilibrium to the larger class tions began to be arranged earlier and
numbers on a blackboard at the Rand
of games called games of incomplete earlier, as some judges tried to hire
Corporation. Tucker then devised the
information, in which players need not clerks just before their competitors. This
famous story of the dilemma faced by
be assumed to know other players’ pref- continued until offers (for jobs that
two prisoners who are each given incen-
erences and feasible choices (12). Selten would begin only on graduation from
tives by the prosecutor to confess, even
was cited for his work on equilibrium law school) were being made to law stu-
though both would be better off if nei-
refinements, which takes the point of dents 2 years in advance, only on the
ther confesses than if they both do (16,
basis of first-year law school grades (see
view that the requirements of the Nash 17). In the initial experiment (18) and in
ref. 26). This situation was widely
equilibrium are necessary conditions for innumerable experiments that followed,
viewed as unsatisfactory, because it
advice to perfectly rational players but players often succeed, at least to some
forced both judges and law students to
are not sufficient conditions, and there degree, in cooperating with one another
make decisions far in advance, on the
may be superfluous equilibria that can and avoiding equilibrium play (19).‡
basis of too little information. The most
be removed from consideration by ap- Social scientists across many disci- recent of many attempts to reform this
propriate refinements that focus atten- plines have found prisoner’s dilemmas market took the form of a year-long
tion on a nonempty subset of Nash helpful in thinking about phenomena moratorium on the hiring of clerks by
equilibria (13, 14). The Nash equilib- ranging from ecological degradation appellate judges, which ended the day
rium has been extended, refined, and (20) to arms races. What the Nash equi- after Labor Day 2003, with only third-
generalized in other directions as well. librium makes clear, even in a game like year law students to be hired. It is still
One noteworthy generalization of mixed the prisoner’s dilemma in which it may too early to know whether this relatively
strategy equilibrium is ‘‘correlated equi- not be an accurate point predictor, is mild intervention will finally solve the
librium’’ (15), which considers not only that the cooperative outcome, because it unraveling of the law clerk market. But
independently randomized strategies for a moratorium by itself does not change
each player but also jointly randomized ‡H. Raiffa independently conducted experimens with a Pris-
the rules of the game sufficiently to al-
strategies that may allow coordination oner’s Dilemma game in 1950, but he did not publish them ter the dilemma-like properties of the
among groups of players. (see ref. 19). equilibrium, and so we predict that fur-
Participation in such a clearinghouse 2002 Economics Nobel Prize that was 40 and 41). Another has been the begin-
is even more straightforward if the awarded to a psychologist, Daniel Kah- ning of attempts to develop models of
clearinghouse is constructed so that it is neman (see, e.g., ref. 38) and an econo- learning that can predict observed be-
a Nash equilibrium for applicants to mist, Vernon Smith (see, e.g., ref. 39). havior in simple experimental games
simply put down their true preferences, Before Smith’s experiments, it was (see, e.g., ref. 42). In particular, learning
regardless of how likely they think they widely believed that the competitive models are useful for explaining pat-
are to receive each of the jobs for which predictions of supply兾demand intersec- terns of adjustment, e.g., whether prices
they have applied, or how other appli- tions required very large numbers of converge from above or below, as well
cants are ranking those jobs. For match- well-informed traders. Smith showed as the ultimate steady-state distributions
ing markets like these entry level labor that competitive efficient outcomes (e.g., refs. 43 and 44).
markets, this kind of equilibrium is pos- could be observed with surprisingly Some games are played only once,
sible for an appropriately designed small numbers of traders, each with no e.g., the exact strategic environments in
clearinghouse. Thus the current version direct knowledge of the others’ costs or many military, legal, and political con-
of the National Resident Matching Pro- values. An important developing area of flicts are unique to the particular time
gram algorithm, designed by Roth and game theory is to explain these and and place. In that case, there is no his-
Peranson (31), has the property that other experimental results in the context tory that can be used to form precise
applicants can confidently be advised it of well-specified dynamic models of the predictions about others’ decisions.
is in their best interest to submit rank interaction of strategic traders. Therefore, learning must occur by intro-
order lists of residencies that correspond Another emerging connection be- spection, or thinking about what the
to their true preferences. That game tween game theory and experimentation other person might do, what they think
theorists have started to play a role in is the increased use of experimental you might do, etc. Such introspection is
designing such clearinghouses and other methods in teaching. A well designed likely to be quite imprecise, especially
markets is an indication of how game classroom experiment shows students when thinking about others’ beliefs or
theory has grown from a conceptual to that the seemingly abstract equilibrium their beliefs about your beliefs. There
a practical tool. models can have surprising predictive has been some recent progress in for-
Auctions are another kind of market power. The Internet makes it much eas- mulating models of noisy introspection,
in which it is becoming increasingly ier to run complex games with large which can then be used to predict and
common for game theorists to be asked groups of students. For example, ⬎30 explain ‘‘non-Nash’’ behavior in experi-
for design advice (see, e.g., refs. 32 and different types of games, auctions, and ments using games played only once
33). And the economic theory of auc- markets can be set up and run from a (24, 45).
tions [for which a Nobel Prize was given site, (http:兾兾veconlab.econ.virginia.edu兾 If a game is repeated, e.g., with ran-
to William Vickrey in 1996, in large part admin.htm) that also provides sample dom matchings from a population of
for his seminal 1961 paper (34)] is a data displays from classroom experi- players, some noise may persist even
perfect example of how game theory ments. Most of the data displays and after average tendencies have stabilized.
and the Nash equilibrium have changed dynamically generated data graphs have The ‘‘quantal response equilibrium’’ is
economics. Before game theory, econo- options for hiding the relevant Nash based on the idea that players’ responses
mists often analyzed markets simply in predictions when the results are being to differences in expected payoffs are
Holt and Roth PNAS 兩 March 23, 2004 兩 vol. 101 兩 no. 12 兩 4001
sharper when such differences are large bargaining experiments is that people situations as competitive equilibrium is
and are more random when such differ- are often as concerned with fairness is- used in large markets. Students in eco-
ences are small (see ref. 46 for an exis- sues as they are with their own payoffs nomics classes today probably hear John
tence proof and ref. 47 for application (see, e.g., ref. 48). The incorporation of Nash’s name as much as or more than
to bidding in an auction). This notion of fairness and other notions of nonselfish that of any economist.
equilibrium is a generalization of the preferences into standard models often In the half century after the publica-
Nash equilibrium in the sense that the brings economic game theory into con- tion of Nash’s PNAS paper, game the-
quantal response predictions converge tact with evolutionary explanations ory moved into center stage in eco-
to a Nash equilibrium as the noise is of human behavior (see, e.g., refs. 49 nomic theory. Game theory has also
diminished. But the effect of nonnegli- and 50). become part of a lively scientific conver-
gible noise is not merely to spread deci- sation with experimental and other em-
sions around Nash predictions; strategic Nash’s Contributions in Perspective pirical scientists and, increasingly, the
interactions cause feedbacks in some In the last 20 years, the notion of a source of practical advice on the design
games that magnify and distort the ef- Nash equilibrium has become a required of markets and other economic environ-
fects of noise. This approach has been part of the tool kit for economists and ments. Looking ahead, if game theory’s
used to explain data from some labora- other social and behavioral scientists, so next 50 years are to be as productive,
tory experiments in which observed be- well known that it does not need explicit the challenges facing game theorists in-
havior deviates from a unique Nash citation, any more than one needs to clude learning to incorporate more var-
equilibrium and ends up on the oppo- cite Adam Smith when discussing com- ied and realistic models of individual
site side of the set of feasible decisions petitive equilibrium. There have been behavior into the study of strategic be-
(24, 43). modifications, generalizations, and re- havior and learning to better use analyt-
Still another approach seeks to recon- finements, but the basic equilibrium ical, experimental, and computational
cile experimental evidence and equilib- analysis is the place to begin (and some- tools in concert to deal with complex
rium predictions by considering how times end) the analysis of strategic inter- strategic environments.
those predictions would differ if system- actions, not only in economics but also
atic regularities in participants’ prefer- in law, politics, etc. The Nash equilib- This work was funded in part by National
ences were modeled. One lesson that rium is probably invoked as often in Science Foundation Infrastructure Grant SES
consistently emerges from small-group small-group (and not-so-small-group) 0094800.
1. Nash, J. F. (1950) Proc. Natl. Acad. Sci. USA 36, 21. Rapaport, A. & Chammah, A. M. (1965) Prisoner’s 36. Kagel, J. H. & Roth, A. E., eds. (1995) Handbook
48–49. Dilemma: A Study in Conflict and Cooperation of Experimental Economics (Princeton Univ. Press,
Downloaded from https://www.pnas.org by 201.141.109.122 on February 27, 2023 from IP address 201.141.109.122.
2. von Neumann, J. & Morgenstern, O. (1944) The- (Univ. of Michigan Press, Ann Arbor). Princeton).
ory of Games and Economic Behavior (Princeton 22. Axelrod, R. (1984) The Evolution of Cooperation 37. Davis, D. D. & Holt, C. A. (1993) Experimental
Univ. Press, Princeton). (Basic Books, New York). Economics (Princeton Univ. Press, Princeton).
3. von Neumann, J. (1928) Math. Annal. 100, 295–320. 23. Ledyard, J. (1995) in Handbook of Experimental 38. Kahneman, D. & Tversky, A. (1979) Econometrica
4. Nash, J. F. (1951) Ph.D. thesis (Princeton Univer- Economics, eds. Kagel, J. & Roth, A. (Princeton 47, 263–291.
sity, Princeton). Univ. Press, Princeton), pp. 111–194. 39. Smith, V. L. (1962) J. Polit. Econ. 70, 111–137.
5. Nash, J. F. (1951) Ann. Math. 54, 286–295. 24. Goeree, J. K. & Holt, C. A. (1999) Proc. Natl. 40. Fudenburg, D. & Kreps, D. (1993) Games Econ.
6. Maynard-Smith, J. (1974) J. Theor. Biol., 47, 209– Acad. Sci. USA 96, 10564–10567. Behav. 5, 320–367.
221. 25. Ostrom, E. (1998) Am. Polit. Sci. Rev. 92, 1–22. 41. Fudenberg, D. & Levine, M. (1998) Learning in
7. Hoffbauer, J. & Sigmund, K. (1988) The Theory of 26. Avery, C., Jolls, C., Posner, R. A. & Roth, A. E. Games (MIT Press, Boston).
Evolution and Dynamical Systems (Cambridge (2001) Univ. Chicago Law Rev. 68, 793–902. 42. Erev, I. & Roth, A. E. (1998) Am. Econ. Rev. 88,
Univ. Press, Cambridge, U.K.).
27. Roth, A. E. (1984) J. Polit. Econ. 92, 991–1016. 848–881.
8. Weibull, J. W. (1995) Evolutionary Game Theory
28. Roth, A. E. (1990) Science 250, 1524–1528. 43. Capra, C. M., Goeree, J. K., Gomez, R. & Holt,
(MIT Press, Cambridge, MA).
29. Gale, D. & Lloyd, S. (1962) Am. Math. Month. 69, C. A. (2002) Int. Econ. Rev. 43, 613–636.
9. Nash, J. F. (1950) Econometrica 18, 155–162.
9–15. 44. Goeree, J. K. & Holt, C. A. (2002) in Encyclopedia
10. Nash, J. F. (1953) Econometrica 21, 128–140.
30. Roth, A. E. & Sotomayor, M. (1990) Two-Sided of Cognitive Science, ed. Nadel, L. (McMillan,
11. Kakutani, S. (1941) Duke Math. J. 8, 457–459.
Matching: A Study in Game-Theoretic Modeling and London), Vol. 2, pp. 1060–1069.
12. Harsanyi, J. (1967–68) Manage. Sci. 14, 159–182,
320–334, 486–502. Analysis, Econometric Society Monograph Series 45. Goeree, J. K. & Holt, C. A. (2003) Games Econ.
13. Selten, R. (1965) Z. Gesamte Staatswissenschaft (Cambridge Univ. Press, Cambridge, U.K.). Behav., in press.
121, 301–324, 667–689. 31. Roth, A. E. & Peranson, E. (1999) Am. Econ. Rev. 46. McKelvey, R. M. & Palfrey, T. R. (1995) Games
14. Selten, R. (1975) Int. J. Game Theor. 4, 25–55. 89, 748–780. Econ. Behav. 10, 6–38.
15. Aumann, R. J. (1974) J. Math. Econ. 1, 67–96. 32. Milgrom, P. R. (2004) Putting Auction Theory to 47. Goeree, J. K., Holt, C. A. & Palfrey, T. R. (2002)
16. Straffin, P. D., Jr. (1980) UMAP J. 1, 102–103. Work (Cambridge Univ. Press, Cambridge, U.K.). J. Econ. Theor. 104, 247–272.
17. Tucker, A. W. (1950) UMAP J. 1, 101. 33. Wilson, R. B. (2002) Econometrica 70, 1299–1340. 48. Bolton, G. E. & Ockenfels, A. (2000) Am. Econ.
18. Flood, M. M. (1958) Manage. Sci., 5, 5–26. 34. Vickrey, W. (1961) J. Finance 16, 8–37. Rev. 90, 166–193.
19. Raiffa, H. (1992) in Toward a History of Game 35. Kalisch, G. K., Millnor, J. W., Nash, J. F. & Nering, 49. Fehr, E. & Gächter, S. (2002) Nature 415, 137–
Theory, ed. Weintraub, E. R. (Duke Univ. Press, E. D. (1954) in Decision Processes, eds. Thrall, 140.
Durham, NC), pp. 165–175. R. M., Coombs, C. H. & Davis, R. L. (Wiley, New 50. Nowak, M. A. & Sigmund, K. (1998) Nature 393,
20. Hardin, G. (1968) Science 162, 1243–1248. York), pp. 513–518. 573–577.