Practice Introduction To Model Evaluation (28) - Introduction to Model Evaluation

Practise this section

9 questions

Flashcard drill
3 cards from this section. Quick, good the night before a test.
Exercise
6 questions · about 4 min · pass mark 70%. Hints available.
Sign up to start the exercise
Quiz
3 questions · about 2 min · pass mark 70%. Hints available.
Sign up to start the quiz

6 sample questions

Question 1.
Define what model evaluation is.
Show hintHide hint
Think about why we test models.
Question 2.
What is the main purpose of the training set?
Show hintHide hint
What do we do with data before we test it?
3Question 3.
What is model evaluation?
Show hintHide hint
Recall what we do after training a model.
4Question 4.
Which of the following is used to assess the performance of models?
- Training set
- Validation set
- Test set
Show hintHide hint
Consider which dataset isn't used during training.
Question 5.
You have a dataset with 90% class A and 10% class B. Your model predicts all as class A. Discuss how it would score on accuracy, precision, and recall.
Show hintHide hint
Remember the definitions of each metric.
Question 6.
Design a plan for evaluating a new machine learning model intended for medical diagnosis showing both potential overfitting and underfitting.
Show hintHide hint
Think about what methods help in avoiding each problem.

5 more questions in this section. Enroll free to practise them all.