POMDPs: Partially Observable Markov Decision Processes | Decision Making Under Uncertainty POMDPs.jl

Описание: Github: https://github.com/JuliaAcademy/Decis...
Julia Academy course: https://juliaacademy.com/courses/deci...

Decision Making Under Uncertainty using POMDPs.jl | Robert Moss

For more info on the Julia Programming Language, follow us on Twitter:   / julialanguage   and consider sponsoring us on GitHub: https://github.com/sponsors/JuliaLang

0:00 Intro
0:11 POMDP definition
1:17 POMDP vs. MDP
1:59 Crying Baby POMDP
1:59 QuickPOMDP
2:51 POMDP solvers
3:20 Pluto notebook
3:58 Crying Baby problem
5:37 Crying Baby states, actions, and observations
6:32 Crying Baby transition function
7:55 Crying Baby observation function
8:57 Crying Baby reward function
10:08 Crying Baby discount
10:15 Crying Baby POMDP
10:42 Policies
11:58 Beliefs
13:10 Belief updating
16:04 Solutions (offline)
17:14 Alpha vectors
19:58 Solutions (online)
21:45 References