3
vs15
8y

Query S3 based data and output result into S3.

Project Type
Project idea
Summary

Query S3 based data and output result into S3.

Description
the data size of file is 50GB plus. and the output generated is also of same size. Query to be executed is somewhat a rule like add a column based on some conditions or filter a dataset. I tried to use AWS Athena however, got time out after 30 mins.
Tech Stack
AWS Athena
Current Team Size
1
URL
Comments
Add Comment