Tuesday, November 21, 2017

Query Flat Files in S3 with Amazon Athena

Amazon Athena enables you to access data present in flat files stored in S3 (Simple Storage Service) as if it were in a table in the database. That and you don't have to set up any server or any other software to accomplish that.

That's another glowing example of being 'Serverless.'

So if a telecommunication has hundreds of thousands or more call detail record file in CSV or Apache Parquet or any other supported format, it can just be uploaded to S3 bucket, and then by using AWS Athena, that CDR data can be queried using well known ANSI SQL.

Ease of use, performance, and cost savings are few of the benefits of AWS Athena service. True to the Cloud promise, with Athena you are charged for what you actually do; i.e. you are only charged for the queries. You are charged $5 per terabyte scanned by your queries. Beyond S3 there are no additional storage costs.

So if you have huge amount of formatted data in files and all you want to do is to query that data using familiar ANSI SQL then AWS Athena is the way to go. Beware that Athena is not for enterprise reporting and business intelligence. For that purpose we have AWS Redshift. Athena is also not for running highly distributed processing frameworks such as Hadoop. For that purpose we have AWS EMR. Athena is more suitable for running interactive queries on your supported formatted data in S3.

Remember to keep reading the AWS Athena documentation as it will keep improving, lifting limitations, and changing like everything else in the cloud.


rakesh manu said...

This website is really a walk-by way of for all of the information you wished about this and didn’t know who to ask. Glimpse right here, and also you’ll undoubtedly uncover it.
Aws Training in Hyderabad

velraj said...

the information is nice and got more ideas from this.im really happy to read this.
AWS Training in Chennai
AWS Certification in Chennai
AWS course in Chennai
Best AWS Training in Chennai

vijaykumar said...

thanks for giving a chance to read this.its very very helpful for study.good job
AWS Training in Tambaram
Best devOps Training in Chennai
DevOps Training institutes in Chennai
DevOps course in Chennai
DevOps Training in Chennai

sheela rajesh said...
This comment has been removed by the author.
sheela rajesh said...

Your blog is full of creative ideas and that shows your thoughts.thank you very much for giving us this blog.
PHP Training in Chennai
DOT NET Training in Chennai
Big Data Training in Chennai
Hadoop Training in Chennai
Android Training in Chennai
Selenium Training in Chennai
Digital Marketing Course in Chennai
JAVA Training in Chennai
German Classes in Chennai
SEO Training in Chennai
seo classes in chennai
SEO Training in Annanagar