Practice Mdp Definition (5.3.1) - Planning and Decision Making

Practise this section

9 questions

Flashcard drill
2 cards from this section. Quick, good the night before a test.
Exercise
6 questions · about 4 min · pass mark 70%. Hints available.
Sign up to start the exercise
Quiz
3 questions · about 2 min · pass mark 70%. Hints available.
Sign up to start the quiz

6 sample questions

Question 1.
Define what an MDP is.
Show hintHide hint
Think about what happens when outcomes are unpredictable.
Question 2.
What does 'S' represent in MDPs?
Show hintHide hint
Consider all the possible situations the agent could find itself in.
3Question 3.
What does MDP stand for?
- Markov Decision Probability
- Markov Decision Process
- Markov Distribution Process
Show hintHide hint
Look for the full form of the acronym.
4Question 4.
True or False: The discount factor (γ) can be greater than 1.
- True
- False
Show hintHide hint
Remember what the range for γ is.
Question 5.
Design an MDP for a board game scenario where players can win or lose points based on landing on different squares. Identify states, actions, rewards, and transition probabilities.
Show hintHide hint
Draw the board to visualize states and actions clearly.
Question 6.
Evaluate the impact of increasing the discount factor on an agent's decision-making process in an MDP. How does this change the optimal policy?
Show hintHide hint
Consider how more weight on future rewards influences agent behavior.

5 more questions in this section. Enroll free to practise them all.