Practice Objective Of Mdps (5.3.2) - Planning and Decision Making - AI Course Fundamental

Practice: Objective of MDPs

Lesson 5.3.2Planning and Decision Making

Practise this section

10 questions

Flashcard drill
4 cards from this section. Quick, good the night before a test.
Exercise
6 questions · about 4 min · pass mark 70%. Hints available.
Sign up to start the exercise
Quiz
4 questions · about 3 min · pass mark 70%. Hints available.
Sign up to start the quiz

6 sample questions

Question 1.
What does policy (π) refer to in the context of MDPs?
Show hintHide hint
Think about how decisions are made from different situations.
Question 2.
Why is the discount factor (γ) important?
Show hintHide hint
Consider how immediate choices affect long-term outcomes.
3Question 3.
What is the primary objective of MDPs?
- To minimize costs
- To maximize expected utility
- To create deterministic environments
Show hintHide hint
Think about what you'd want to achieve in an uncertain environment.
4Question 4.
True or False: The discount factor γ must always be between 0 and 1.
- True
- False
Show hintHide hint
Recall the mathematical definition of γ.
Question 5.
Consider an MDP with two states, A and B. The action taken in state A leads to state B with a 70% chance and remains in A with a 30% chance. If the rewards are 5 for reaching B and 1 for remaining in A, calculate the expected utility for taking the action in state A.
Show hintHide hint
Consider how probabilities of transitions impact rewards.
Question 6.
If an agent's discount factor is 0.9, and the immediate rewards for actions are 4 and 6, what would be the expected utility considering one future reward of 10 from the current state?
Show hintHide hint
Remember, the discount factor reduces the value of future rewards.

6 more questions in this section. Enroll free to practise them all.