Coverart for item
The Resource Approximate dynamic programming : solving the curses of dimensionality, Warren B. Powell

Approximate dynamic programming : solving the curses of dimensionality, Warren B. Powell

Label
Approximate dynamic programming : solving the curses of dimensionality
Title
Approximate dynamic programming
Title remainder
solving the curses of dimensionality
Statement of responsibility
Warren B. Powell
Creator
Subject
Genre
Language
eng
Summary
Understanding approximate dynamic programming (ADP) is vital in order to develop practical and high-quality solutions to complex industrial problems, particularly when those problems involve making decisions in the presence of uncertainty. Approximate Dynamic Programming, Second Edition uniquely integrates four distinct disciplines-Markov decision processes, mathematical programming, simulation, and statistics-to demonstrate how to successfully approach, model, and solve a wide range of real-life problems using ADP. The book continues to bridge the gap between computer science, simulation, and operations research and now adopts the notation and vocabulary of reinforcement learning as well as stochastic search and simulation optimization. The author outlines the essential algorithms that serve as a starting point in the design of practical solutions for real problems. The three curses of dimensionality that impact complex problems are introduced and detailed coverage of implementation challenges is provided. The Second Edition also features: A new chapter describing four fundamental classes of policies for working with diverse stochastic optimization problems: myopic policies, look-ahead policies, policy function approximations, and policies based on value function approximations; A new chapter on policy search that brings together stochastic search and simulation optimization concepts and introduces a new class of optimal learning strategies; Updated coverage of the exploration exploitation problem in ADP, now including a recently developed method for doing active learning in the presence of a physical state, using the concept of the knowledge gradient; A new sequence of chapters describing statistical methods for approximating value functions, estimating the value of a fixed policy, and value function approximation while searching for optimal policies. The presented coverage of ADP emphasizes models and algorithms, focusing on related applications and computation while also discussing the theoretical side of the topic that explores proofs of convergence and rate of convergence. A related website features an ongoing discussion of the evolving fields of approximation dynamic programming and reinforcement learning, along with additional readings, software, and datasets. Requiring only a basic understanding of statistics and probability, Approximate Dynamic Programming, Second Edition is an excellent book for industrial engineering and operations research courses at the upper-undergraduate and graduate levels. It also serves as a valuable reference for researchers and professionals who utilize dynamic programming, stochastic programming, and control theory to solve problems in their everyday work
Member of
Cataloging source
DG1
http://library.link/vocab/creatorDate
1955-
http://library.link/vocab/creatorName
Powell, Warren B.
Dewey number
519.7/03
Illustrations
illustrations
Index
index present
LC call number
T57.83
LC item number
.P76 2011
Literary form
non fiction
Nature of contents
  • dictionaries
  • bibliography
Series statement
Wiley series in probability and statistics
http://library.link/vocab/subjectName
  • Dynamic programming
  • MATHEMATICS
  • Dynamic programming
Label
Approximate dynamic programming : solving the curses of dimensionality, Warren B. Powell
Instantiates
Publication
Bibliography note
Includes bibliographical references and index
Carrier category
online resource
Carrier category code
  • cr
Carrier MARC source
rdacarrier
Color
multicolored
Content category
text
Content type code
  • txt
Content type MARC source
rdacontent
Contents
Frontmatter -- The Challenges of Dynamic Programming -- Some Illustrative Models -- Introduction to Markov Decision Processes -- Introduction to Approximate Dynamic Programming -- Modeling Dynamic Programs -- Policies -- Policy Search -- Approximating Value Functions -- Learning Value Function Approximations -- Optimizing While Learning -- Adaptive Estimation and Stepsizes -- Exploration Versus Exploitation -- Value Function Approximations for Resource Allocation Problems -- Dynamic Resource Allocation Problems -- Implementation Challenges -- Bibliography -- Index -- Wiley Series in Probability and Statistics
Control code
757486955
Dimensions
unknown
Edition
2nd ed.
Extent
1 online resource (xviii, 627 pages)
Form of item
online
Isbn
9781118029169
Media category
computer
Media MARC source
rdamedia
Media type code
  • c
Other control number
  • 9786613273703
  • 40020215287
Other physical details
illustrations
http://library.link/vocab/ext/overdrive/overdriveId
10.1002/9781118029176
Specific material designation
remote
System control number
(OCoLC)757486955
Label
Approximate dynamic programming : solving the curses of dimensionality, Warren B. Powell
Publication
Bibliography note
Includes bibliographical references and index
Carrier category
online resource
Carrier category code
  • cr
Carrier MARC source
rdacarrier
Color
multicolored
Content category
text
Content type code
  • txt
Content type MARC source
rdacontent
Contents
Frontmatter -- The Challenges of Dynamic Programming -- Some Illustrative Models -- Introduction to Markov Decision Processes -- Introduction to Approximate Dynamic Programming -- Modeling Dynamic Programs -- Policies -- Policy Search -- Approximating Value Functions -- Learning Value Function Approximations -- Optimizing While Learning -- Adaptive Estimation and Stepsizes -- Exploration Versus Exploitation -- Value Function Approximations for Resource Allocation Problems -- Dynamic Resource Allocation Problems -- Implementation Challenges -- Bibliography -- Index -- Wiley Series in Probability and Statistics
Control code
757486955
Dimensions
unknown
Edition
2nd ed.
Extent
1 online resource (xviii, 627 pages)
Form of item
online
Isbn
9781118029169
Media category
computer
Media MARC source
rdamedia
Media type code
  • c
Other control number
  • 9786613273703
  • 40020215287
Other physical details
illustrations
http://library.link/vocab/ext/overdrive/overdriveId
10.1002/9781118029176
Specific material designation
remote
System control number
(OCoLC)757486955

Library Locations

    • Ellis LibraryBorrow it
      1020 Lowry Street, Columbia, MO, 65201, US
      38.944491 -92.326012
    • Engineering Library & Technology CommonsBorrow it
      W2001 Lafferre Hall, Columbia, MO, 65211, US
      38.946102 -92.330125
Processing Feedback ...