What Does Partially Observable Markov Decision Process (POMDP) Mean?
A partially observable Markov decision process (POMPD) is a Markov decision process in which the agent cannot directly observe the underlying states in the model. The Markov decision process (MDP) is a mathematical framework for modeling decisions showing a system with a series of states and providing actions to the decision maker based on those states.
Techopedia Explains Partially Observable Markov Decision Process (POMDP)
In the partially observable Markov decision process, because the underlying states are not transparent to the agent, a concept called a “belief state” is helpful. The belief state provides a way to deal with the ambiguity inherent in the model.
