A company has a set of EC2 Instances that host web applications. The web servers used are NGINX and Apache. The IT Security team need to stream the log files from these servers and perform real time analytics from the log files to check for any abnormal behaviour. Which of the following would be the easiest way to get the log file data and the right storage platform for the streaming data?

Answer options:

A.Use a Lambda function to poll the servers. The Lambda files will then strip the data and send the required streaming data to AWS Kinesis
B.Use a Lambda function to poll the servers. The Lambda files will then strip the data and send the required streaming data to AWS Redshift.
C.Use the AWS Kinesis Agent and install it on the EC2 Instances. Ensure the Kinesis agent file is configured to send data from the log files to a Kinesis stream.
D.Use the AWS Kinesis Agent and install it on the EC2 Instances. Ensure the Kinesis agent file is configured to send data from the log files to Amazon Redshift.

Answer – C
The AWS Documentation mentions the following
Kinesis Agent is a stand-alone Java software application that offers an easy way to collect and send data to Kinesis Data Streams. The agent continuously monitors a set of files and sends new data to your stream. The agent handles file rotation, checkpointing, and retry upon failures. It delivers all of your data in a reliable, timely, and simple manner. It also emits Amazon CloudWatch metrics to help you better monitor and troubleshoot the streaming process.
Option A is incorrect since using the Kinesis Agent would be a more efficient tool rather than using the Lambda functions
Options B and D are incorrect since Amazon Redshift is used as a data warehousing system
For more information on working with agents, please refer to the below URL
https://docs.aws.amazon.com/streams/latest/dev/writing-with-agents.html