URetail, a leading local retail chain works with more than 200 suppliers to procure their products and sell in the market. The suppliers share the price listing of the products in <SUPPLIER_NAME>-<DDMMYYHHMISS>.csv format not more than 5 times a day with updated offerings, that they supply to URetail through a FTP Interface “ShareUrPrice” built on EFS.This information is captured (both new files, new updates), standardized in real-time using Kinesis Data Streams during ingestion, loaded into Redshift using KCL library. This information is evaluated, compared and processed to finalize the orders using data pipeline, uses EMR and send notifications to relevant suppliers.How can the following ingestion mechanism be established?
Capture of data in files and standardize the data into JSON before loading into kinesis data streams
Ingestion of data in kinesis data streams into Redshift
Select 2 options

Answer options:

A.KPL Library
B.KCL Library can load the data into Redshift
C.COPY Command
D.Kinesis Connector Library
E.Kinesis Agent

Answer : D, E
Option A is incorrect - KPL library cannot be used to capture files. The Kinesis Producer Library (KPL) simplifiesproducer application development, allowing developers to achieve high write throughput to a Kinesis data stream. The KPL can incur an additional processing delay of up to RecordMaxBufferedTime within the library (user-configurable). Larger values of RecordMaxBufferedTime results in higher packing efficiencies and better performance.
https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-kpl.html
Option B is incorrect - This is a pre-built library that helps you easily build Amazon Kinesis Applications for reading and processing data from an Amazon Kinesis stream. This library handles complex issues such as adapting to changes in stream volume, load-balancing streaming data, coordinating distributed services, and processing data with fault-tolerance, enabling you to focus on business logic while building applications.
This needs Kinesis Connector library to integrate with other AWS services. Kinesis Connector library is a pre-built library that helps you easily integrate Amazon Kinesis Data Streams with other AWS services and third-party tools. Amazon Kinesis Client Library (KCL) is required for using this library. The current version of this library provides connectors to Amazon DynamoDB, Amazon Redshift, Amazon S3, and Elasticsearch.
https://aws.amazon.com/kinesis/data-streams/resources/
Option C is incorrect - COPY command is used to copy the data into Redshift from DynamoDB or S3. Loads data into a Redshift table from data files or from an Amazon DynamoDB table. The files can be located in an Amazon Simple Storage Service (Amazon S3) bucket, an Amazon EMR cluster, or a remote host that is accessed using a Secure Shell (SSH) connection.
https://docs.aws.amazon.com/redshift/latest/dg/r_COPY.html
Option D is correct - This is a pre-built library that helps you easily integrate Amazon Kinesis Data Streams with other AWS services and third-party tools. Amazon Kinesis Client Library (KCL) is required for using this library. The current version of this library provides connectors to Amazon DynamoDB, Amazon Redshift, Amazon S3, and Elasticsearch.
https://aws.amazon.com/kinesis/data-streams/resources/
Option E is correct - Kinesis Agent is a stand-alone Java software application that offers an easy way to collect and send data to Kinesis Data Streams. The agent continuously monitors a set of files and sends new data to your stream. The agent handles file rotation, check pointing, and retry upon failures. It delivers all of your data in a reliable, timely, and simple manner. It also emits Amazon CloudWatch metrics to help you better monitor and troubleshoot the streaming process.
Configure the agent to monitor multiple file directories and send data to multiple streams. The agent can pre-process the records parsed from monitored files before sending them to your stream.
https://docs.aws.amazon.com/streams/latest/dev/writing-with-agents.html#sim-writes