You work as a machine learning specialist for a small startup software company. You are the only machine learning specialist in the company. The founder of the company needs you to quickly build a machine learning model to test one of the team’s minimum viable products with the intent of persevering or pivoting depending on the outcome of your model experiment. You have decided to use SageMaker Autopilot to create your experiment. You are creating your experiment in SageMaker Autopilot. You have selected the S3 bucket, data source, and target feature for which to make predictions. You are now ready to select the machine learning problem type and objective metric. Which are viable combinations for your selections?

Answer options:

A.Problem type: Multiclass Classification; Objective: AUC
B.Problem type: Regression; Objective: F1
C.Problem type: Binary Classification; Objective: MSE
D.Problem type: Regression; Objective: MSE

Correct Answer: D
Option A is incorrect. When running a Multiclass Classification algorithm-based model, the only options that make sense in the SageMaker Autopilot available choices are Accuracy and F1macro.
Option B is incorrect. When running a Regression algorithm-based model, the only option that makes sense in the SageMaker Autopilot available choices is MSE.Option C is incorrect. When running a Binary Classification algorithm-based model, the only options that make sense in the SageMaker Autopilot available choices are F1, Accuracy, and AUC.Option D is correct. When running a Regression algorithm-based model, the option that makes sense in the SageMaker Autopilot available choices is MSE.References:
Please see the Amazon SageMaker developer guide titled Automate model development with Amazon SageMaker Autopilot (https://docs.aws.amazon.com/sagemaker/latest/dg/autopilot-automate-model-development.html),
The AWS Getting Started Resource Center titled Create a machine learning model automatically (https://aws.amazon.com/getting-started/hands-on/create-machine-learning-model-automatically-sagemaker-autopilot/)