AWS Kinesis Agent Monitoring

Kinesis Agent Monitoring

Question

HikeHills.com (HH) is an online specialty retailer that sells clothing and outdoor refreshment gear for trekking, go camping, boulevard biking, mountain biking, rock hiking, ice mountaineering, skiing, avalanche protection, snowboarding, fly fishing, kayaking, rafting, road and trace running, and many more. HHruns their entire online infrastructure on multiple java based web applications and other web framework applications running on AWS.

The HH is capturing click stream data and use custom- build recommendation engine to recommend products which eventually improve sales, understand customer preferences and already using AWS Kinesis Streams (KDS) to collect events and transaction logs and process the stream.

Multiple departments from HH use different streams to address real-time integration and induce analytics into their applications and uses Kinesis as the backbone of real-time data integration across the enterprise. HHunderstand that Monitoring plays a major role in monitoring and managing the streaming platform.

HH using kinesis agent to process events and uses consumer library to collect and disseminate streams.

What kind of monitoring is enabled by kinesis agent? Select 2 options.

Answers

Explanations

Click on the arrows to vote for the correct answer

A. B. C. D.

Answer: C, D.

Option A is incorrect -Metrics configured for streams are automatically collected and pushed to CloudWatch every minute.

These metrics are published by CloudWatch, not by Kinesis Agent.

https://docs.aws.amazon.com/streams/latest/dev/monitoring-with-cloudwatch.html

Option B is incorrect -Metrics configured for streams are automatically collected and pushed to CloudWatch every minute.

These metrics are published by CloudWatch, not by Kinesis Agent.

https://docs.aws.amazon.com/streams/latest/dev/monitoring-with-cloudwatch.html

Option C is correct - The agent publishes custom CloudWatch metrics with a namespace of AWSKinesisAgent.

These metrics help you assess whether the agent is submitting data into Kinesis Data Streams as specified, and whether it is healthy and consuming the appropriate amount of CPU and memory resources on the data producer.

https://docs.aws.amazon.com/streams/latest/dev/agent-health.html

Option D is correct -The agent publishes Bytes sent, number of records attempted, number of records that returned failure and the number of calls to PutRecords that resulted in a service error

https://docs.aws.amazon.com/streams/latest/dev/agent-health.html

The Kinesis agent is a pre-built Java application that helps to simplify the process of ingesting data into Kinesis data streams from various sources such as log files, syslog servers, and other data sources. When it comes to monitoring the Kinesis streaming platform, the Kinesis agent plays a crucial role in enabling certain types of monitoring. Here are the two types of monitoring that are enabled by the Kinesis agent:

A. Metrics configured for streams are automatically collected and pushed to CloudWatch every minute

The Kinesis agent enables automatic collection and publishing of CloudWatch metrics for the streams that it processes. These metrics provide visibility into the performance and health of the data stream, which is essential for monitoring and managing the streaming platform. These metrics are collected every minute and pushed to CloudWatch, where they can be used to create custom dashboards, set alarms, and perform various other monitoring and analysis tasks.

B. The kinesis agent publishes Bytes sent, number of records attempted, number of records that returned failure and the number of calls to PutRecords that resulted in a service error.

The Kinesis agent also publishes custom CloudWatch metrics with a namespace of AWSKinesisAgent. These metrics provide detailed insights into the performance of the Kinesis agent itself, such as the number of records processed, bytes sent, and the number of PutRecords calls that resulted in service errors. These metrics can be used to identify bottlenecks and performance issues in the Kinesis agent, which can help improve the overall performance and reliability of the streaming platform.

In summary, the Kinesis agent enables automatic collection and publishing of CloudWatch metrics for streams it processes and also publishes custom CloudWatch metrics with a namespace of AWSKinesisAgent. These metrics provide valuable insights into the performance and health of the data stream and the Kinesis agent itself, which is crucial for monitoring and managing the streaming platform.