Gluebush.com is a British online confidential advertisement and public website. Classified ads are either free or paid for depending on the product category and the geographical market.
While the largest category of advertisements on Gluebush.com is "goods for sale”, the site also supports around 100,000 motors listings across the UK at any one time, with an extensive social media presence on Twitter and Facebook, with 22,000 and 471,000 followers, respectively. Gluebush.com uses social media for communications and information about the brand as well as competitions and campaigns.
Gluebush.com runs multiple business applications both web and mobile based on AWS. Gluebush.com wants to collect log and event data from web servers, mobile devices, pre-process the data and process the data to feed live dashboards, and load data into data warehouse build on Redshift and on S3 for long term storage. The DWH process the data for further analytics. Gluebush.com want to extend the capabilities like search, document management, integration into Data Lake built on EMR, etc using the same stream without impacting performance besides above 3 purposes mentioned above. Please advise key artifacts of end to end architecture. select 1 option.

Answer options:

A.data collection, pre-processing, and writing of data into data streams using KPL and reading of data using shared fan-out consumers using KCL library and writing to downstream applications using connector libraries. New consumer applications need to be added.
B.data collection, pre-processing, and writing of data into data streams using KPL and reading of data using shared enhanced fan-out consumers using KCL library and writing to downstream applications using connector libraries. existing consumer applications would be sufficient.
C.data collection, pre-processing, and writing of data into data streams using Kinesis Agents and reading of data using enhanced fan-out consumers built using kinesis Applications and writing to downstream applications using connector libraries. New consumer applications need to be added.
D.data collection, pre-processing, and writing of data into data streams using Kinesis Agents and reading of data using shared fan-out consumers built using kinesis Applications and writing to downstream applications using connector libraries. Existing consumer applications would be sufficient.
E.data collection, pre-processing, and writing of data into data streams using API’s and reading of data using shared fan-out consumers built on API’s and writing to downstream applications using connector libraries. Existing consumer applications would be sufficient.

Answer : C
Option A is incorrect - Kinesis data stream producer library cannot be used to read log files. we need kinesis agent to collect the information from the log files.
Enhanced Fan-out consumers is mandatory if we need to ensure performance is not degraded with additional consumers. shared fan-out basically distributes the total shard read capacity to any number of consumers and eventually impact performance.
Kinesis data streams producer is any application that puts user data records into a Kinesis data stream. The KPL is an easy-to-use, highly configurable library that helps you write to a Kinesis data stream and acts as an intermediary between your producer application code and the Kinesis Data Streams API actions. KPL library cannot be used to continuously monitors a set of files and sends new data to your stream.
https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-kpl.html
An Amazon Kinesis Data Streams application is a consumer of a stream that commonly runs on a fleet of EC2 instances.
The shard Read throughput is fixed at a total of 2 MiB/sec per shard. If there are multiple consumers reading from the same shard, they all share the throughput
https://docs.aws.amazon.com/streams/latest/dev/building-consumers.html
Option B is incorrect - Kinesis data stream producer library cannot be used to read log files. we need kinesis agent to collect the information from the log files.
Enhanced Fan-out consumers is mandatory if we need to ensure performance is not degraded with additional consumers.
Kinesis data streams producer is any application that puts user data records into a Kinesis data stream. The KPL is an easy-to-use, highly configurable library that helps you write to a Kinesis data stream and acts as an intermediary between your producer application code and the Kinesis Data Streams API actions. KPL library cannot be used to continuously monitors a set of files and sends new data to your stream.
https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-kpl.html
An Amazon Kinesis Data Streams application is a consumer of a stream that commonly runs on a fleet of EC2 instances.
Scales as consumers register to use enhanced fan-out. Each consumer registered as enhanced fan-out gets its own read throughput per shard, up to 2 MiB/sec, independently of other consumers
https://docs.aws.amazon.com/streams/latest/dev/building-consumers.html
Option C is correct -we need kinesis agent to collect the information from the log files. Enhanced Fan-out consumers is mandatory if we need to ensure performance is not degraded with additional consumers.
Kinesis Agent is a stand-alone Java application that allows to collect and process data to Kinesis Data Streams. The agent continuously monitors a set of files and sends new data to your stream
https://docs.aws.amazon.com/streams/latest/dev/writing-with-agents.html
An Amazon Kinesis Data Streams application is a consumer of a stream that commonly runs on a fleet of EC2 instances.
Scales as consumers register to use enhanced fan-out. Each consumer registered as enhanced fan-out gets its own read throughput per shard, up to 2 MiB/sec, independently of other consumers
https://docs.aws.amazon.com/streams/latest/dev/building-consumers.html
Option D is incorrect -we need kinesis agent to collect the information from the log files. Enhanced Fan-out consumers is mandatory if we need to ensure performance is not degraded with additional consumers. shared fan-out basically distributes the total shard read capacity to any number of consumers and eventually impact performance.
Kinesis Agent is a stand-alone Java application that allows to collect and process data to Kinesis Data Streams. The agent continuously monitors a set of files and sends new data to your stream
https://docs.aws.amazon.com/streams/latest/dev/writing-with-agents.html
An Amazon Kinesis Data Streams application is a consumer of a stream that commonly runs on a fleet of EC2 instances.
The shard Read throughput is fixed at a total of 2 MiB/sec per shard. If there are multiple consumers reading from the same shard, they all share the throughput
https://docs.aws.amazon.com/streams/latest/dev/building-consumers.html
Option E is incorrect - we need kinesis agent to collect the information from the log files. API’s cannot read data from log files.
Enhanced Fan-out consumers is mandatory if we need to ensure performance is not degraded with additional consumers. shared fan-out basically distributes the total shard read capacity to any number of consumers and eventually impact performance.
We can develop producers using the Amazon Kinesis Data Streams API with the AWS SDK for Java but API SDK cannot be used to continuously monitors a set of files and sends new data to your stream.
https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-sdk.html
An Amazon Kinesis Data Streams application is a consumer of a stream that commonly runs on a fleet of EC2 instances.
The shard Read throughput is fixed at a total of 2 MiB/sec per shard. If there are multiple consumers reading from the same shard, they all share the throughput
https://docs.aws.amazon.com/streams/latest/dev/building-consumers.html