Jump to content

Quantal response equilibrium

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by WeakTrain (talk | contribs) at 19:38, 2 August 2022 (rm from see also (unrelated)). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Quantal response equilibrium
Solution concept in game theory
Relationship
Superset ofNash equilibrium, Logit equilibrium
Significance
Proposed byRichard McKelvey and Thomas Palfrey
Used forNon-cooperative games
ExampleTraveler's dilemma

Quantal response equilibrium (QRE) is a solution concept in game theory. First introduced by Richard McKelvey and Thomas Palfrey,[1][2] it provides an equilibrium notion with bounded rationality. QRE is not an equilibrium refinement, and it can give significantly different results from Nash equilibrium. QRE is only defined for games with discrete strategies, although there are continuous-strategy analogues.

In a quantal response equilibrium, players are assumed to make errors in choosing which pure strategy to play. The probability of any particular strategy being chosen is positively related to the payoff from that strategy. In other words, very costly errors are unlikely.

The equilibrium arises from the realization of beliefs. A player's payoffs are computed based on beliefs about other players' probability distribution over strategies. In equilibrium, a player's beliefs are correct.

Application to data

When analyzing data from the play of actual games, particularly from laboratory experiments, particularly from experiments with the matching pennies game, Nash equilibrium can be unforgiving. Any non-equilibrium move can appear equally "wrong", but realistically should not be used to reject a theory. QRE allows every strategy to be played with non-zero probability, and so any data is possible (though not necessarily reasonable).

Logit equilibrium

The most common specification for QRE is logit equilibrium (LQRE). In a logit equilibrium, player's strategies are chosen according to the probability distribution:

is the probability of player choosing strategy . is the expected utility to player of choosing strategy under the belief that other players are playing according to the probability distribution . Note that the "belief" density in the expected payoff on the right side must match the choice density on the left side. Thus computing expectations of observable quantities such as payoff, demand, output, etc., requires finding fixed points as in mean field theory.[3]

For dynamic games

For dynamic (extensive form) games, McKelvey and Palfrey defined agent quantal response equilibrium (AQRE). AQRE is somewhat analogous to subgame perfection. In an AQRE, each player plays with some error as in QRE. At a given decision node, the player determines the expected payoff of each action by treating their future self as an independent player with a known probability distribution over actions. As in QRE, in an AQRE every strategy is used with nonzero probability.

Applications

The quantal response equilibrium approach has been applied in various settings. For example, Goeree et al. (2002) study overbidding in private-value auctions,[4] Yi (2005) explores behavior in ultimatum games,[5] Hoppe and Schmitz (2013) study the role of social preferences in principal-agent problems,[6] and Kawagoe et al. (2018) investigate step-level public goods games with binary decisions.[7]

Critiques

Non-falsifiability

Work by Haile et al. has shown that QRE is not falsifiable in any normal form game, even with significant a priori restrictions on payoff perturbations.[8] The authors argue that the LQRE concept can sometimes restrict the set of possible outcomes from a game, but may be insufficient to provide a powerful test of behavior without a priori restrictions on payoff perturbations.

However the authors say "this should not be mistaken for a critique of the QRE notion itself. Rather, our aim has been to clarify some limitations of examining behavior one game at a time and to develop approaches for more informative evaluation of QRE." This "non-falsifiability" is a result of showing multiple probability distributions for player strategies may be consistent with expected values from QRE, and that more conditions, such as requiring identically distributed and independent perturbations, are needed to guarantee a unique probability distribution for individual behavior such as a logit distribution. This is essentially the same as the refinement problem when multiple Nash equilibria occur.

Loss of Information

As in statistical mechanics the mean-field approach, specifically the expectation in the exponent, results in a loss of information.[9] More generally, differences in an agent's payoff with respect to their strategy variable result in a loss of information.

See also

References

  1. ^ McKelvey, Richard; Palfrey, Thomas (1995). "Quantal Response Equilibria for Normal Form Games". Games and Economic Behavior. 10: 6–38. CiteSeerX 10.1.1.30.5152. doi:10.1006/game.1995.1023.
  2. ^ McKelvey, Richard; Palfrey, Thomas (1998). "Quantal Response Equilibria for Extensive Form Games" (PDF). Experimental Economics. 1: 9–41. doi:10.1007/BF01426213.
  3. ^ Anderson, Simon P.; Goeree, Jacob K.; Holt, Charles A. (2004). "Noisy Directional Learning and the Logit Equilibrium". The Scandinavian Journal of Economics. 106 (3): 581–602. CiteSeerX 10.1.1.81.8574. doi:10.1111/j.0347-0520.2004.00378.x.
  4. ^ Goeree, Jacob K.; Holt, Charles A.; Palfrey, Thomas R. (2002). "Quantal Response Equilibrium and Overbidding in Private-Value Auctions" (PDF). Journal of Economic Theory. 104 (1): 247–272. doi:10.1006/jeth.2001.2914. ISSN 0022-0531.
  5. ^ Yi, Kang-Oh (2005). "Quantal-response equilibrium models of the ultimatum bargaining game". Games and Economic Behavior. 51 (2): 324–348. doi:10.1016/s0899-8256(03)00051-4. ISSN 0899-8256.
  6. ^ Hoppe, Eva I.; Schmitz, Patrick W. (2013). "Contracting under Incomplete Information and Social Preferences: An Experimental Study". Review of Economic Studies. 80 (4): 1516–1544. doi:10.1093/restud/rdt010.
  7. ^ Kawagoe, Toshiji; Matsubae, Taisuke; Takizawa, Hirokazu (2018). "Quantal response equilibria in a generalized Volunteer's Dilemma and step-level public goods games with binary decision". Evolutionary and Institutional Economics Review. 15 (1): 11–23. doi:10.1007/s40844-017-0081-6. ISSN 1349-4961.
  8. ^ Haile, Philip A.; Hortaçsu, Ali; Kosenok, Grigory (2008). "On the Empirical Content of Quantal Response Equilibrium". American Economic Review. 98 (1): 180–200. CiteSeerX 10.1.1.193.7715. doi:10.1257/aer.98.1.180.
  9. ^ Jessie, Daniel T.; Saari, Donald G. (2016). "From the Luce Choice Axiom to the Quantal Response Equilibrium". Journal of Mathematical Psychology. 75: 3–9.