SummarV of Contents
J of Contents
I Artificial intelligence
1 Introduction 1
2 IntelligentAgents 32
11 Problem-solving
3 Solving Problems by Searching 59
4 Informed Search and Exploration 94
5 Constraint Satisfaction Problems 137
6 Adversarial Search 161
Ill Knowledge and reasoning
7 Logical Agents 194
8 First-Order Logic 240
9 Inference in First-Order Logic 272
10 Knowledge Representation 320
IV Planning
11 Planning 375
12 Planning and Acting in the Real WOrld 417
V Uncertain knowledge and reasoning
13 Uncertainty 462
14 Probabilistic Reasoning 492
15 Probabilistic Reasoning over Time 537
16 Making Simple Decisions 584
17 Making Complex Decisions 613
VI Learning
18 Learning from Observations 649
19 Knowledge in Learning 678
20 Statistical Learning Methods -- -- 712
21 Reinforcement Learning 763
Vll Communicating, perceiving, and acting
22 Communication 790
23 Probabilistic Language Processing 834
24 Perception 863
25 Robottes 901
Vlll ConCluSionS
26 Philosophical Foundations 947
27 Al: Present and Future 968
A Mathematical background 977
B Notes on Languages and Algorithms. 984
Bibliography 987
Index 1045
...
xIII
Contents
I Artificial intelligence
1 Introduction 1
l.l What is Al? I
Acting humanly f The Turing Test approach 2
o j: foe Turing Test approach 2
Thinking humanly f The cognitive modeling approach 3
e humanly f The cognitive modeling approach 3
Thinking rationally f The "laws of thought" approach 4
e lationallyf The "laws of thought" approach 4
Acting rationally; The rational agent approach 4
o J: foe rational agent approach 4
l.2 The Foundations of Artificial intelligence 5
o
Philosophy (428 B .C.--present) 5
Mathematics (c. 800--present) 7
Economics (1776--present) 9
Neuroscience (1861--present) 10
Psychology (1879--present) 12
Computer engineering (1940--preseflt) 14
Control theory and CVbernetics (1948--present) 15
j and Cybernetics (1948--present) 15
Linguistics (1957--present) 16
.uistics (1957--present) 16
l.3 The HistorV of Artificial intelligence 16
J 6
The gestation of artificial intelligence (1943--1955) 16
o u
The birth of artificial intelligence (1956) 17
dance (1956) 17
Early enthusiasm. great expectations (1952--1969) 18
J, great expectations (1952--1969) 18
A dose of realitV (1966--1973) 21
.
Knowledge--based systems f The key to power? (1969--1979) 22
o J >terns; rhe key to power? (1969--1979) 22
Al becomes an industrV (1980--present) 24
.
The return of neural networks (1986--present) 25
Al becomes a science (1987--present) 25
The emergence of intelligent agents (1995--present) 27
6
1.4 The State of the Art 27
1.5 SummarV 28
y -8
Biblioeraphical and Historical Notes 29
.laphical and Historical Notes 29
Exercises 30
2 Intelligent Agents 32
2.1 Agents and Environments 32
5
2.2 Good Behavior f The Concept of Rationality 34
pt of Rationality 34
Performance measures 35
Rationalitv 35
j ac
Omniscience, learning, and autonomy 36
2.3 The Nature of Environments 38
Specifying the task environment 38
Properties of task environments 40
2.4 The Structure of Agents 44
u
Agent programs 44
Simple reflex agents 46
Model-based reflex agents 48
to
XV
.
xvi Contents
Goal-based agents 49
6 fi
Utility-based aZents FI
j based agents sl
LearninZ agents sl
o agents sl
1 < q
2'5 Summary sa
J 34
Biblioaraphical and Historical Notes 55
.laphical and Historical Notes 55
Exercises 56
36
11 Problem-solving
3 Solving Problems by Searching 59
,, n.
3'l Problem-Solving Agents 59
e agents 59
Well-defined problems and solutions 62
Formulating problems 62
o problems 62
ac ry v, r
3.2 Example Problems 64
m hi
Yoy problems 64
j problems 64
Real-world problems 67
ry ry Q 1.
3'3 Searching for Solutions 69
o
MeasurinZ Droblem-solvinZ Derformance 71
o problem-solving performance 71
ac 4 T T.
3'4 Uninformed Search Strategies 73
ales 73
Breadth-first search 73
Depth-first search 75
Depth-limited search 77
Iterative deepening depth-first search 78
Bidirectional search 79
Comparing uninformed search strategies sl
paring uninformed search strategies sl
ac F'.'..
3'5 AvoidinZ Repeated States FI
o Repeated States sl
ac
3'6 Searching with Partial information 83
o
c less Droblems 84
oensorless problems 84
problems 84
ContinZencV Droblems 86
o: problems 86
ac
3'7 Summary R7
J 87
Bibliographical alld Historical Notes 88
.laphical alld Historical Notes 88
Exercises 89
4 Informed Search and Exploration 94
4.1 Informed (Heuristic) Search Strategies 94
GreedV best-first search QS
J best-hrst search 95
A* searchs Minimizing the total estimated solution cost 97
o
MemorV-bounded heuristic search 1 of
. 101
Learning to search better 104
e LO search better 104
4.2 Heuristic Functions 105
ac rs
1 he effect of heuristic accuracy on performance 106
y on performance 106
InventinZ admissible heuristic functions 107
o admissible heuristic functions 107
Learning heuristics from experience 109
o perience 109
4.3 Local Search A12orithms and Optimization Problems 110
o ptimization Problems 1 10
Hill-climbinZ search 1 1 1
o >earch 1 11
Rimllloted annealings R h 1 1 F
simulated annealing search 1 15
e .earch 1 15
Local beam search 1 15
Genetic algorithms 1 16
b 1 16
4.4 Local Search in Continuous Spaces 1 19
paces 1 19
Contents xvii
4.5 Online Search Agents and Unknown Environments 122
cents and Unknown Environments 122
Online search problems 123
Online search agents 125
6
Online local search 126
Learning in online search 127
o in online search 127
4.6 Summary 129
J
Bibliographical and Historical Notes 130
.laphical and Historical Notes 130
Exercises 134
5 Constraint Satisfaction Problems 137
5. I Constraint Satisfaction Problems 137
5.2 Backtracking Search for CSPs 141
to
Variable and value ordering 143
Propagating information through constraints 144
IntelliZent backtracking: looking backward 148
o e: looking backward 148
5.3 Local Search for Constraint Satisfaction Problems 150
5.4 The Structure of Problems 151
5.5 SummarV 155
j
Biblioeraphical and Historical Notes 156
.laphical and Historical Notes 156
Exercises 158
6 Adversarial Search 161
6. 1 Games 161
6.2 Optimal Decisions in Games 162
ptimal Decisions in Games 162
Optimal strategies 163
mh.. 1.
foe minimax algorithm 165
.orithm 165
Optimal decisions in multiplayer games 165
6.3 Alpha--Beta Pruning 167
pha--Beta Pruning 167
6.4 Imperfect, Real-Time Decisions 171
Evaluation functions 171
CuttinZ off search 173
o
6.5 Games That include an Element of Chance 175
Position evaluation in games with chance nodes 177
earnes with chance nodes 177
Complexity of expectiminimax 177
pie-city of expectiminimax 177
Card games 179
earnes 179
6.6 State-of--the-Art Game Programs 180
6.7 Discussion 183
6.8 SummarV 185
J
Bibliouraphical and Historical Notes 186
.laphical and Historical Notes 186
Exercises 189
Ill Knowledge and reasoning
7 Logical Agents 194
- 1 T'
7.1 KnowledZe-Based AZents 195
ac o
- ry m, IT'
7.2 The Wumpus WOrld 197
~ ac T.
7.3 Logic 200
o
~' n
7.4 Propositional Logic f A Very Simple Logic 204
ac/ntax 204
oVntax 204
.
...
xvill Contents
semantics 206
oemantlcs 206
A simple knowledge base 208
Inference 208
Equivalence, validity, and satisfiability 210
- <,
7.5 Reasoning Patterns in Propositional Logic ZI I
o positional Logic ZI I
Resolution 213
Forward and backward chaininZ 217
u
7.6 Effective propositional inference 220
A complete backtracking algorithm 221
Local-search aIZorithms 222
o
Hard satisllabilitV Problems 224
. I
7.7 Agents Based on Propositional Logic 225
o positional Logic 225
FindinZ Dits and wumDUses using logical inference 225
o pits and wumpuses using logical inference 225
Keeping track of location and orientation 227
Circuit-based agents 227
o
A comparison 231
- Q
7.8 Summary 232
J
Bibliographical and Historical Notes 233
u I
Exercises 236
8 First-Order Logic 240
8.1 Representation Revisited 240
8.2 SVntax and Semantics of First--Order LoZic 245
J olc 245
Models for first-order logic 245
q-c/mbols and internretations 246
symbols and internretations 246
J pretations 246
m 1 4 R
germs 248
Atomic sentences 248
Complex sentences 249
Quantifiers 249
Equality 253
8.3 Using First-Order Logic 253
o first-Order Logic 253
Assertions and queries in first-order logic. 253
ac 1. h. l.,F 4
foe kinship domain 254
Numbers, sets, and lists 256
ac 1 J ry5R
foe wumpus world -- - - -- - -- - - - 258
pusworld ~ ~ ~ ~ ~ ~ - - - 258
8.4 Knowledge Engineering in First-Order Logic 260
al 1 1 1..,A 1
foe knowledZe enZineering process 261
o .ineering process 261
ac 1...
Yhe electronic circuits domain 262
8.5 Summary 266
J
Bibliographical and Historical Notes 267
u
Exercises 268
9 Inference in First-Order Logic 272
9.1 Propositional vs. First--Order inference 272
Inference rules for Quantifiers 273
1
Reduction to propositional inference 274
9.2 Unification and Lifting 275
A first--order inference rule 275
Unification 276
Contents xix
ctoracre and retrieval 97o
storage and retrieval 97R
6 - / 8
9'3 Forward Chaining 280
First-order definite clauses 280
A simple forward-chaining algorithm 281
'
Efficient forward chaining 283
5 283
9'4 Backward Chaining 287
5 287
A backward chaining algorithm 287
o
Logic proZramming ado
.ic programming 289
Efficient imDlementation of logic proZrams 9Q0
plementation of logic programs 290
Redundant inference and infinite loops 292
Constraint logic proZramminZ,Od
o t .ramming 294
9'5 Resolution,oF
-as
Conjunctive normal form for first-order loZic 7Q5
,unctive normal form for first-order logic 295
ac 1.
foe resolution inference rule 9Q7
-y 7
Example proofS 297
'
Completeness of resolution 300
'
Dealing with equality 7flq
a with equality 303
Resolution stfategies 304
ales 304
ac
theorem provers 306
'
9'6 Summary q 10
j 310
Bibliographical and Historical Notes 310
J 10
Exercises 315
10 Knowledge Representation 320
10'l Ontological Engineering 320
10'2 Categories and Objects 7ry,
a sects 322
PhVsical comDosition qry4
,aleal composition 324
Measurements 325
,25
Q'lhstances and oh j
substances and objects 327
Jects 327
10.3 Actions, Situations, and Events 328
,28
FI
Yhe ontology of situation calculus 329
by of situation calculus 329
Describing actions in situation calculus 330
e actions in situation calculus 330
Q l-c!iri or the reprpoRorit"I
solving the representational frame problem qqry
e presentational frame problem 332
c l-c!iricr the inferential frame Dwnk
solving the inferential frame problem aam
e the inferential frame problem 333
m.,
nine and event calculus 234
J34
Generalized events 315
J35
Processes 337
Intervals 338
Fluents and obiects 719
,Gets 339
10.4 Mental Events and Mental Objects 341
J J41
A formal theory of beliefs 141
j J41
Knowledge and belief 343
5 a43
Knowledge, time, and action 344
6,.
10.5 The internet Shopping World 344
pping World 344
Comparing offers 348
10.6 Reasoning Systems for Categories 349
e systems for Categories 349
R.
oemantlc networks 150
J30
Description logics 353
ption logics 353
10.7 Reasoning with Default information 1<4
o J34
xx Contents
Open and closed worlds 354
Negation as failure and stable model semantics 356
Circumscription and default logic 358
10.8 Truth Maintenance Systems 360
10.9 Summary 362
Bibliographical and Historical Notes 363
Exercises 369
IV Planning
11 Planning 375
11.1 The Planning Problem 375
The language of planning problems 377
Expressiveness and extensions 378
Example: Air cargo transport 380
Exampled The spare tire problem 381
Example: The blocks world 381
l l.2 Planning with State-Space Search 382
Forward state-space search 382
Backward state-space search 384
Heuristics for state-space search 386
l 1.3 Partial-Order Planning 387
A partial-order planning example 391
l planning example 391
Partial-order alanning with unbound variables 393
planning with unbound variables 393
Heuristics for partial-order planning 394
l l.4 Planning Graphs 395
Planning graphs for heuristic estimation 397
ac
foe GRAPHPLAN algorithm 398
b
m..
Fermination of GRAPHPLAN 401
11.5 Planning with Propositional Logic 402
Describing planning problems in propositional logic 402
Complexity of propositional encodings 405
l l.6 AnalVsis of Planning Approaches 407
J .is of Planning Approaches 407
l l.7 Summary 408
Bibliographical and Historical Notes 409
Exercises 412
12 Planning and Acting in the Real World 417
12.1 Time, Schedules, and Resources 417
c hedulinZ with resource constraints 420
scheduling with resource constraints 420
o kith resource constraints 420
12.2 Hierarchical Task Network Planning 422
ReDresenting action decompositions 423
presenting action decompositions 423
ModifVing the planner for decompositions 425
ding the planner for decompositions 425
Discussion 427
12.3 Planning and Acting in Nondeterministic Domains 430
12.4 Conditional Planning 433
Conditional planning in fully observable environments 433
Conditional planning in partially observable environments 437
12.5 Execution Monitoring and Replanning 441
Contents xxi
12.6 Continuous Planning 445
12.7 MultiAgentplanning 449
5 o f49
Cooperation: Joint goals and plans 450
MultibodV planning 451
y planning 451
Coordination mechanisms 452
Competition 454
12.8 SummarV 454
J f34
Bibliographical and Historical Notes 455
Exercises 459
V Uncertain knowledge and reasoning
13 Uncertainty 462
13.1 Acting under Uncertainty 462
Handling uncertain knowledge 463
e uncertain knowledge 463
UncertaintV and rational decisions 465
J and rational decisions 465
Design for a decision-theoretic agent 466
an for a decision-theoretic agent 466
13.2 Basic ProbabilitV Notation 466
J 1
Propositions 467
Atomic events 468
Prior probability 468
Conditional probability 470
13.3 The Axioms ofprobabilitV 471
J [ 71
Using the axioms of probability 473
WhV the axioms of probability are reasonable 473
J the axioms of probability are reasonable 473
13.4 Inference Using Full Joint Distributions. 475
13.5 Independence 477
pendence 477
13.6 BaVes' Rule and its Use 479
bes' Rule and its Use 479
Applying Bayes' rule: The simple case 480
Using Bayes' ale: Combining evidence 481
13.7 The Wumpus World Revisited 483
13.8 SummarV 486
j
Bibliogranhical and Historical Notes 487
.raphical and Historical Notes 487
Exercises 489
14 Probabilistic Reasoning 492
14.1 Representing Knowledge in an Uncertain Domain 492
14.2 The Semantics of Bavesian Networks 495
J
Representing the full joint distribution 495
t e the full joint distribution 495
Conditional independence relations in Bayesian networks 499
14.3 Efficient Representation of Conditional Distributions 500
14.4 Exact inference in Bavesian Networks 504
j
Inference by enumeration 504
J
ac. hi liar..
Fhe variable elimination algorithm 507
o
ac 1.
she complexity of exact inference 509
Clustering algorithms 510
14.5 Approximate inference in Bayesian Networks sl I
Direct sampling methods sl I
piing methods sl I
Inference by Markov chain simulation 516
j .Aarkov chain simulation 516
..
xxll Contents
14.6 Extending Probability to First-Order Representations 519
14.7 Other Approaches to Uncertain Reasoning 523
Rule-based methods for uncertain reasoning 524
Representing ignorance: Dempster--Shafer theory 525
Representing vagueness: Fuzzy sets and fuzzy logic 526
14.8 Summary 528
J
Bibliographical and Historical Notes 528
Exercises 533
15 Probabilistic Reasoning over Time 537
15.1 Time and Uncertainty 537
j J37
abates and observations 538
states and observations 538
ctotionanr rirocesses and the Markov assumotion 538
stationals processes and the Markov assumption 538
J processes and the Markov assumption 538
15.2 Inference in Temporal Models 541
Filtering and prediction 542
smoothing 544
smoothing 544
6
Finding the most likely sequence 547
15.3 Hidden Markov Models 549
Rimrilified matrix alaorithms 549
simplified matrix algorithms 549
15.4 Kalman Filters 551
Updating Gaussian distributions 553
A simple one-dimensional example 554
ac I <<
Fhe general case 556
o
Applicability of Kalman filtering 557
15.5 Dvnandc Bavesian Networks 559
j namic Bayesian Networks 559
ConstrUcting DBNs 560
Exact inference in DBNs 563
Approximate inference in DBNs 565
15.6 Speech Recognition 568
beseech sounds 570
breech sounds 570
peech sounds 570
WOrds 572
Rrentences 574
sentences 574
Building a speech recognizer 576
15.7 SummarV 578
J J78
Bibliographical and Historical Notes 578
Exercises 581
16 Making Simple Decisions 584
16.1 Combining Beliefs and Desires under Uncertainty 584
o Beliefs and Desires under Uncertainty 584
16.2 The Basis of UtilitV Theory 586
J theory 586
Constraints on rational preferences 586
And then there was Utility 588
y a88
16.3 Utility Functions 589
J runctlons 589
ac 'liar r r yi < CO
she utility of money 589
j J J89
UtilitV scales and utilitV assessment 591
J .cafes and utility assessment 591
16.4 Multiattribute Utility Functions 593
; functions 593
Dominance 594
Preference strUcture and multiattribute utilitV 596
J J96
16.5 Decision Networks 597
Contents xxiii
Representing a decision problem with a decision network 598
Evaluating decision networks 599
16.6 The Value of information 600
A simple example 600
pie example 600
A general formula 601
o
Properties of the value of information 602
Implementing an information-gathering agent 603
16.7 Decision-Theoretic Expert Systems 604
16.8 Summary 607
J
Bibliographical and Historical Notes 607
Exercises 609
17 Making Complex Decisions 613
17.1 Sequential Decision Problems 613
An example 613
OntimalitV in seQuential decision problems 616
ptimality in sequential decision problems 616
17.2 Value iteration 618
Utilities of states 619
ac 1,. o i+. 1.
foe value iteration algorithm 620
o
Convergence of value iteration 620
6
17.3 Policy iteration 624
J iteration 624
17.4 PartiallV observable MDPs 625
.
17.5 Decision-Theoretic Agents 629
6
17.6 Decisions with Multiple Agents: Game Theory 631
pie Agents: Game Theory 631
17.7 MechanismDesign 640
17.8 SummarV 643
J o43
Bibliographical and Historical Notes 644
.laphical and Historical Notes 644
Exercises 646
VI Learning
18 Learning from Observations 649
18.1 Forms of Learning 649
o
18.2 Inductive LearninZ 651
o
18.3 Learning Decision Trees 653
Decision trees as performance elements 653
Expressiveness of decision trees 655
Inducing decision trees from examples 655
e pies 655
Choosing attribute tests 659
Assessing the performance of the learning algorithm 660
Noise and overfitting 661
Broadening the applicability of decision trees 663
18.4 Ensemble Learning 664
o
18.5 Why Learning WOrksi ComDutational Learning Theory 668
J Learning Whrksf Computational Learning Theory 668
How manV examples are needed? 669
J examples are needed? 669
Learning decision lists 670
Discussion 672
18.6 SummarV 673
J o73
BiblioaraDhical and Historical Notes 674
.laphical and Historical Notes 674
.
xxlv Contents
Exercises 676
19 Knowledge in Learning 678
19.1 A Logical Formulation of Learning 678
.ical Formulation of Learning 678
Examples and hypotheses 678
pies and hypotheses 678
Current-best-hVpothesis search 680
Jpothesis search 680
Least-commitment search 683
19.2 Knowledge in Learning 686
6 6
c. ie examDles 687
come simple examples 687
q I schemes 688
come general schemes 688
o
19.3 Explanation-Based Learning 690
planation-Based Learning 690
Extracting general rules from examples 691
o e pies 691
Improving efficiency 693
19.4 Learning Using Relevance information 694
Determining the hypothesis space 695
Learning and using relevance information 695
u
19.5 Inductive LoZic Programming 697
.ic Programming 697
An example 699
m 1. 1..
fop-down inductive learning methods 701
Inductive learning with inverse deduction 703
e with inverse deduction 703
Making discoveries with inductive logic programming 705
o
19.6 SummarV 707
.
Bibliographical and Historical Notes 708
.raphical and Historical Notes 708
Exercises 710
20 Statistical Learning Methods 712
run 1 Q'.. 1 r. ac 1 ry
20. I Statistical LearninZ 712
O 1 12
.n ry T.. 1
20.2 Learning with Complete Data 716
e with Complete Data 716
Maximum-likelihood parameter learning f Discrete models 716
Naive BaVes models 718
J
Maximum-likelihood parameter learning f Continuous models 719
Bavesian Darameter learning 720
,c>ian parameter learning 720
Learning Bayes net structures 722
& Bayes net structures 722
ac abeT"IT T '.11 T',,m '~ 'l
20.3 Learning with Hidden Variables f The EM Algorithm 724
o
Unsupervised clustering f Learning mixtures of Gaussians 725
Learning Bayesian networks with hidden variables 727
Learning hidden Markov models 731
ac 1 f c
foe general form of the EM algorithm 731
5 o
Learning Bayes net structures with hidden variables 732
In 4 T
20.4 Instance-Based Learning 733
o
Nearest-neighbor models 733
Kernel models 735
.n c Neural Networks 736
20.5 Neural Networks 736
Units in neural networks 737
Network structures 738
finale layer feed-forward neural networks (perceptrons) 740
finale layer feed-forward neural networks (perceptrons) 740
.ie layer feed-forward neural networks (perceptrons) 740
Multilaver feed-forward neural networks 744
J or feed-forward neural networks 744
Learning neural network structures 748
e lleural network structures 748
.n
20.6 Kernel Machines 749
Contents xxv
, n ac n Q, 1 T T 1.
20.7 Case StudVf Handwritten Digit Recognition 752
J: Handwritten Digit Recognition 752
rvri o Q ryF'
20.8 Summary 754
J
Bibliographical and Historical Notes 755
.raphical and Historical Notes 755
Exercises 759
21 Reinforcement Learning 763
1 1 1 T
21.1 Introduction 763
1 1 ry n.. T,. r'
21.2 Passive Reinforcement LearninZ 765
o
Direct utilitV estimation 766
y estimation 766
Adaptive dynamic programming 767
m 1 aide 1. 7A7
femporal difference learning 767
, 1,..
ZI .3 Active Reinforcement Learning 771
o
Exploration 771
Learning an Action-Value Function 775
, 1 4
ZI .4 Generalization in Reinforcement Learning 777
o I 1 7
Applications to game-playing 780
l plications to game-playing 780
Application to robot control 780
pplication to robot control 780
1 1 < ac 1. Q, ado 1
21.5 PolicV Search 781
j search 781
1 1
21.6 SummarV 784
, 184
Bibliographical and Historical Notes 785
.laphical and Historical Notes 785
Exercises 788
Vll Communicatillg, perceiving, and acting
22 Communication 790
ac 1 1
22.1 Communication as Action 790
Fundamentals of lanZuaQe 791
ouage 791
ac
she component steps of communication 792
1, 9 ^ v 1 n c v
22.2 A Formal Grammar for a Fragment of English 795
o
ac T'. c C 7O'
foe Lexicon of SO 795
ac
she Grammar of SO 796
11 ? Q.
22.3 Syntactic AnalVsis (Parsing) 798
J J>is (Parsing) 798
Efficient parsing 800
,1 A 4 1
22.4 Augmented Grammars 806
.Inented Grammars 806
Verb subcategorization 808
5
Generative capacity of augmented grammars 809
fbi < 9.
22.5 Semantic interpretation 810
pretation 810
ac.
foe semantics of an English fragment sl 1
.iish fragment sl 1
fi~ 1 f R 1,
dime and tense 812
Quantification 813
Pragmatic interpretation 815
ematlc interpretation 815
Language generation with DCGs 817
o
1,
22.6 Ambiguity and Disambiguation 818
.uity and Disambiguation 818
Disambiguation 820
1 O 7 ac. T T, 1. OI 1
22.7 Discourse Understanding 821
o
Reference resolution 821
ac
foe structure of coherent discourse 823
1 1 o rs. x 1.
22.8 Grammar induction 824
,, Q Q cry
22.9 Summary 826
J 826
.
xxvi Contents
Bibliographical and Historical Notes 827
Exercises 831
23 Probabilistic Language Processing 834
17 1 n 1' '1.. T A X, 1 R, 4
23.1 Probabilistic Language Models 834
buage Models 834
Probabilistic context-free grammars 836
grammars 836
Learning probabilities for PCFGs 839
e probabilities for PCFGs 839
Learning rule strUcture for PCFGs 840
23.2 Information Retrieval 840
Evaluating iR systems 842
IR refinements 844
Presentation of result sets 845
Implementing iR systems 846
ry ac ac T C.
23.3 Information Extraction 848
17' A' 1. m 1.
23.4 Machine Translation 850
Machine translation systems 852
;items 852
egotistical machine translation 853
statistical machine translation 853
LearninZ probabilities for machine translation 856
e probabilities for machine translation 856
aam < q o'ry
23.5 SummarV 857
j
Biblioeraphical and Historical Notes 858
.raphical and Historical Notes 858
Exercises 861
24 Perception 863
ac 4 1 T'
24.1 Introduction 863
ry 4 1 T v.
24.2 Image Formation 865
o
Images without lenses f the pinhole camera 865
Lens sVstems 866
J>tems 866
Light: the photometry of image formation 867
.lit: the photometry of image formation 867
Color: the spectrophotometry of image formation 868
1 4 ac V 1 T n...
24.3 EarlV Image Processing Operations 869
j - e e perations 869
Edge detection 870
o
Image segmentation 872
o .Inentatlon 872
ry
24.4 ExtractinZ Three-Dimensional information 873
e three-Dimensional information 873
Motion 875
Binocular stereopsis 876
m h
Fexture gradients 879
.radients 879
QhodinZ 880
chading 880
6
Contour 881
ry 4 <
24.5 Object Recognition 885
,ect Recognition 885
Brightness-based recognition 887
.litness-based recognition 887
Feature-based recognition 888
Pose Estimation 890
ac 4
24.6 Using Vision for Manipulation and Navigation 892
o vision for Manipulation and Navigation 892
ac 4 ~ q OO'
24.7 SummarV 894
J 894
Bibliographical and Historical Notes 895
.laphical and Historical Notes 895
Exercises 898
25 Robottes 901
1 < 1 T
25.1 Intfoduction 901
Contents xxvii
,' ry n 1
25.2 Robot Hardware 903
9 Q03
censors 903
Effectors 904
1 < ry n 1.
25.3 Robotic Perception 907
Localization 908
Mapping 913
Other tVves of DerceDtion 915
apes of perception 915
ry <' of.,
25.4 Planning to Move 916
e LO Move 916
Configuration space 916
Cell decomposition methods 919
qkeletonization methods 922
okeletonization methods 922
1< F of..
25.5 Planning uncertain movements 923
o
Robust methods 924
, <
25.6 Moving 926
6 y26
Dynamics and control 927
ynamlcs and control 927
Potential field control 929
Reactive control 930
,< ac n,.
25.7 Robotic Software Architectures 932
c',hsumDtion architecture 932
subsumption architecture 932
aam 1 ac k.
Yhree-laver architecture 933
yer architecture 933
Robotic programming languages 934
, F o ^,.'.'
25.8 Application Domains 935
Ic O 9' riryR
25.9 Summary 938
y y38
Bibliographical and Historical Notes 939
Exercises 942
Vlll Conclusions
26 Philosophical Foundations 947
1
26.1 Weak Al: Can Machines Act intelligently? 947
o J
ac
foe argument from disability 948
wument from disability 948
ac k. 1 k..
foe mathematical obiection 949
J
ac
foe argument from informalitv 950
b j y50
,< 1 q, 4 T
26.2 Strong Al: Can Machines Really Think? 952
s Al: Can Machines Really Think? 952
ac. I k lxr ac hi O< 4
Yhe band--bodV problem 954
J problem 954
ac "k..,,.
foe "brain in a vat" experiment 955
ac h..
she brain prosthesis experiment 956
ac
foe Chinese room 958
la ry al v,
26.3 The Ethics and Risks of Developing Artificial intelligence 960
ping Artificial intelligence 960
26.4 Summary 964
y y64
Bibliographical and Historical Notes 964
Exercises 967
27 Al: Present and Future 968
rvry 1 ^
27.1 Agent Components 968
cent Components 968
Iap 1 ^
27.2 Agent Architectures 970
6
aam ac 4 11 r
27.3 Are We Going in the Right Direction? 972
b in the Right Direction? 972
...
xxvill Contents
fry 4 11 rl. c' T ac 9, ic Oaf
27.4 What if Al Does Succeed? 974
A Mathematical background 977
A.l Complexity Analysis and OO Notation 977
AsvmDtotic analVsis 977
J ptotic analysis 977
NP and inherentlV hard problems 978
. I
A.2 Vectors, Matrices, and Linear Algebra 979
A.3 Probability Distributions 981
J
Bibliographical and Historical Notes 983
B Notes on Languages and Algorithms 984
B.l Defining Languages with Backus--Naur Form (BNF) 984
B.2 Describing Algorithms with Pseudocode 985
B.3 Online Help 985
Bibliography 987
Index 1045
