A supermarket chain had a big data analysis system deployed in AWS. The system has the raw data such as clickstream or process logs in S3. An m3.large EC2 instance transformed the data into other formats and saved it to another S3 bucket. It was then moved to Amazon Redshift.

Answer options:

A.AWS Glue contains a crawler that connects to the S3 bucket and scans the dataset. Then the service creates metadata tables in the data catalog.
B.AWS Glue automatically generates code in Java to extract data from the source and transform it to match the target schema.
C.By default, AWS Glue creates a scheduler to trigger the activated tasks every minute.
D.AWS Glue has a central metadata repository (Glue Data Catalog). The Glue Data Catalog is available for analysis immediately.

Correct Answer – A, D
AWS Glue is a service to discover data, transform it, and make it available for search and querying. AWS Glue can make all your data in S3 immediately available for analytics without moving the data.
Option A is CORRECT because Crawler is a key component in AWS Glue that can scan data in all kinds of repositories, classify it, extract schema information from it, and store the metadata automatically in the AWS Glue Data Catalog.
Option B is incorrect because AWS Glue will generate ETL code in Scala or Python rather than Java.
Option C is incorrect because AWS Glue does not generate triggers by default. Moreover, Cron expressions that lead to rates faster than 5 minutes are not supported.
Option D is CORRECT because the Glue Data Catalog stores the metadata in the AWS Cloud which is readily available for analysis.