Adversarial Search - University of California, Berkeley

Adversarial Search - University of California, Berkeley

Adversarial Search Chapter 6 Section 1 4 Outline Optimal decisions - pruning Imperfect, real-time decisions

Games vs. search problems "Unpredictable" opponent specifying a move for every possible opponent reply Time limits unlikely to find goal, must approximate Game tree (2-player,

deterministic, turns) Minimax Perfect play for deterministic games Idea: choose move to position with highest minimax value = best achievable payoff against best play E.g., 2-ply game:

Minimax algorithm Properties of minimax

Complete? Yes (if tree is finite) Optimal? Yes (against an optimal opponent) Time complexity? O(bm) Space complexity? O(bm) (depth-first exploration) For chess, b 35, m 100 for "reasonable" games

exact solution completely infeasible - pruning example

- pruning example - pruning example - pruning example - pruning example Properties of -

Pruning does not affect final result Good move ordering improves effectiveness of pruning With "perfect ordering," time complexity = O(bm/2) doubles depth of search A simple example of the value of reasoning about which computations are relevant (a form of metareasoning)

Why is it called -? is the value of the best (i.e., highestvalue) choice found so far at any choice point along the path for max

If v is worse than , max will avoid it prune that branch Define similarly for min The - algorithm

The - algorithm Resource limits Suppose we have 100 secs, explore 104 nodes/sec 106 nodes per move Standard approach: cutoff test:

e.g., depth limit (perhaps add quiescence search) evaluation function = estimated desirability of position Evaluation functions For chess, typically linear weighted sum of features

Eval(s) = w1 f1(s) + w2 f2(s) + + wn fn(s) e.g., w1 = 9 with f1(s) = (number of white queens) (number of black queens), etc. Cutting off search MinimaxCutoff is identical to MinimaxValue except

1. Terminal? is replaced by Cutoff? 2. Utility is replaced by Eval Does it work in practice? bm = 106, b=35 m=4 4-ply lookahead is a hopeless chess player!

4-ply human novice 8-ply typical PC, human master 12-ply Deep Blue, Kasparov Deterministic games in practice

Checkers: Chinook ended 40-year-reign of human world champion Marion Tinsley in 1994. Used a precomputed endgame database defining perfect play for all positions involving 8 or fewer pieces on the board, a total of 444 billion positions.

Chess: Deep Blue defeated human world champion Garry Kasparov in a six-game match in 1997. Deep Blue searches 200 million positions per second, uses very sophisticated evaluation, and undisclosed methods for extending some lines of search up to 40 ply. Othello: human champions refuse to compete against computers,

who are too good. Go: human champions refuse to compete against computers, who are too bad. In go, b > 300, so most programs use pattern knowledge bases to suggest plausible moves.

Summary Games are fun to work on! They illustrate several important points about AI perfection is unattainable must approximate good idea to think about what to think about

Recently Viewed Presentations

  • Curriculum Night Dallington Public School Grade 3 - Room 209 ...

    Curriculum Night Dallington Public School Grade 3 - Room 209 ...

    Elementary Progress Report in November. Term 1 Report Card (February); Term 2 Report Card (June) Report Card Learning Skills - important to develop their work habits, study skills and organizational skills as the building blocks to school success (Responsibility, Organization,...
  • 2019 PRESENTATION PURSUING STATE OF NM CAPITAL OUTLAY

    2019 PRESENTATION PURSUING STATE OF NM CAPITAL OUTLAY

    The pursuit of capital outlay funding by non profit organizations from the New Mexico State Legislature involves a local governmental agency serving as the fiscal agent.Several preparation and coordination steps for this to occur will be discussed in this presentation.....
  • LyncConf report Enterprise Voice Best Practices

    LyncConf report Enterprise Voice Best Practices

    Skype for Business Online has a significant infrastructure, so while we have started with these changes, it will take some time to be completed. We strongly recommend to open the IP subnets and ports today, to avoid any negative impact...
  • Four Elements of Style - Alsobrook's AP English Info

    Four Elements of Style - Alsobrook's AP English Info

    Four Elements of Style:DictionSyntaxTonePoint of View. Developed by Mrs. Stacey Reaves. Sumter, SC. Adapted by Adrien Alsobrook. Memphis, TN. Diction: Word Choice "The difference between the right word and almost the right word is like the difference between lightning and...
  • Weathering, Erosion , & Deposition - Change Happens...

    Weathering, Erosion , & Deposition - Change Happens...

    Erosion by Water. Moving water is one of the most powerful agent of erosion. Erosion by water can have destructive results. Rill erosion develops when running water cuts small channels into the side of a slope. Gully erosion is when...
  • Lesson 1a - Italian Fascism

    Lesson 1a - Italian Fascism

    Matteotti assassination (1924) Suppression of independent forces. Opposition outlawed (1926) ... Effect of the Abyssinian Crisis on Italy. Diplomatically and economically isolated. Pushed closer to central and southeastern Europe and Germany.
  • Asynchronous Remote Execution

    Asynchronous Remote Execution

    Trading Storage for Communication Immediate Closure: Synchronous I/O Bounded Closure: GASS, AFS, transaction Indeterminate Closure: UNIX buffer cache Imprecise Exceptions Human Closure: Coda -> Failures invoke email Trading Computation for Communication Time Warp Simulation Model All nodes checkpoint frequently. All...
  • The Efficacy and Safety of Varenicline, a Selective ...

    The Efficacy and Safety of Varenicline, a Selective ...

    The Efficacy and Safety of Varenicline, a Selective α4β2 Nicotinic Receptor Partial Agonist, for Smoking Cessation in Patients Hospitalized with Acute Coronary Syndrome: A Randomized Controlled Trial. Mark J. Eisenberg, Sarah B. Windle, Nathalie Roy, Wayne Old, François Grondin, Iqbal...