Transferring EC2 Instance Logs to S3 Bucket
Question
You are a developer for a company.
You have to develop an application that would transfer the logs from several EC2 Instances to an S3 bucket.
Which of the following would you use for this purpose?
Answers
Explanations
Click on the arrows to vote for the correct answer
A. B. C. D.Answer - C.
This is mentioned in the AWS Documentation.
AWS Data Pipeline is a web service that you can use to automate data movement and transformation.
With AWS Data Pipeline, you can define data-driven workflows so that tasks can depend on the successful completion of previous tasks.
You define the parameters of your data transformations, and AWS Data Pipeline enforces the logic that you've set up.
Option A is incorrect since this is used specifically for migrating databases.
Option B is incorrect since this is used for performing SQL queries in data stored on S3.
Option D is incorrect since this is used for Big data applications.
For more information on AWS Pipeline, please visit the following URL-
https://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/what-is-datapipeline.html
The correct answer for this question is C. AWS Data Pipeline.
AWS Data Pipeline is a fully-managed service that enables you to move data between different AWS data stores and compute services. It allows you to create complex data processing workloads that can transfer data from various sources to your destination location such as Amazon S3, Amazon RDS, or Amazon Redshift.
In the given scenario, the application needs to transfer logs from several EC2 instances to an S3 bucket, and AWS Data Pipeline can perform this task efficiently. You can use AWS Data Pipeline to create a pipeline that would move data from EC2 instances to an S3 bucket using pre-built data connectors for Amazon EC2 and Amazon S3.
AWS Database Migration Service (A) is used to migrate databases from on-premises data centers to AWS or from one type of database to another within AWS. Therefore, it's not the correct choice for transferring logs from EC2 instances to an S3 bucket.
AWS Athena (B) is a serverless query service that enables you to analyze data stored in Amazon S3 using SQL. It's not suitable for transferring data from EC2 instances to S3 buckets.
AWS EMR (D) is a managed big data processing service that helps you to process vast amounts of data using open-source frameworks such as Apache Hadoop, Apache Spark, and Apache Hive. It's not designed to transfer logs from EC2 instances to an S3 bucket.