Your company releases new features with high frequency while demanding high application availability. As part of the application’s A/B testing, logs from each updated Amazon EC2 instance of the application need to be analyzed in near real-time to ensure that the application is working flawlessly after each deployment. If the logs show any anomalous behavior, the application version of the instance is changed to a more stable one. Which of the following methods should you use for shipping and analyzing the logs in a highly available manner?

Answer options:

A.Ship the logs to Amazon S3 for durability and use Amazon EMR to analyze the logs in a batch each hour.
B.Ship the logs to Amazon CloudWatch Logs and use Amazon EMR to analyze the logs in a batch each hour.
C.Ship the logs to an Amazon Kinesis stream and analyze the logs in real-time.
D.Ship the logs to a large Amazon EC2 instance and analyze the logs in real-time.

Answer – C
You can use Kinesis Streams for rapid and continuous data intake and aggregation. The type of data used includes IT infrastructure log data, application logs, social media, market data feeds, and web clickstream data. Because the response time for the data intake and processing is in real-time, the processing is typically lightweight.
The following are typical scenarios for using Kinesis Streams:
Accelerated log and data feed intake and processing - You can have producers push data directly into a stream. For example, push system and application logs and they`ll be available for processing in seconds. This prevents the log data from being lost if the front end or application server fails. Kinesis Streams provides accelerated data feed intake because you don`t batch the data on the servers before you submit it for intake.
Real-time metrics and reporting - You can use data collected into Kinesis Streams for simple data analysis and reporting in real-time. For example, your data-processing application can work on metrics and reporting for system and application logs as the data is streaming in rather than waiting to receive data batches.
For more information on Amazon Kinesis and SNS, please refer to the below link:
http://docs.aws.amazon.com/streams/latest/dev/introduction.html