You work as a machine learning specialist for an oil refining and exploration company. You are building a machine learning model to predict the viability of various potential drilling sites around the world. You have training data with many features for which you are performing feature engineering to ensure you don’t have any target leakage. You plan to use both a regression and a classification model to see which gives you better predictive results. When using SageMaker Data Wrangler to visualize your target leakage report, which two metrics (for regression and classification) can you use to measure your target leakage? (Select TWO)

Answer options:

A.MSE
B.R2
C.AOC-ROC
D.F1
E.Accuracy

Correct Answers: B and C
Option A is incorrect. The two metrics used by the SageMaker Data Wrangler target leakage analysis visualization are AOC-ROC and R2. MSE is not used in the target leakage analysis visualization.
Option B is correct. The two metrics used by the SageMaker Data Wrangler target leakage analysis visualization are AOC-ROC and R2.
Option C is correct. The two metrics used by the SageMaker Data Wrangler target leakage analysis visualization are AOC-ROC and R2.
Option D is incorrect. The two metrics used by the SageMaker Data Wrangler target leakage analysis visualization are AOC-ROC and R2. F1 is not used in the target leakage analysis visualization.
Option E is incorrect. The two metrics used by the SageMaker Data Wrangler target leakage analysis visualization are AOC-ROC and R2. Accuracy is not used in the target leakage analysis visualization.
Reference:
Please see the Amazon SageMaker developer guide titled Analyze and Visualize (https://docs.aws.amazon.com/sagemaker/latest/dg/data-wrangler-analyses.html), the Amazon SageMaker developer guide titled Prepare ML Data with Amazon SageMaker Data Wrangler (https://docs.aws.amazon.com/sagemaker/latest/dg/data-wrangler.html)