My two cents on BIG DATA tools and features

Thanks for checking my blog. I am a software professional with 10+ years experience in SQL Server BI and Data warehousing domain. Now just recently started to explore BIG Data tools and technologies such as Hadoop, MapReduce, Spark, AWS EMR, Athena, etc. I would like to use this blog medium to share that I have learned in this arena and learn from the readers who are patient and kind enough to leave suggestions and feedback as comments in the blogs. See you out there! Happy exploring!

Sunday, July 9, 2017

AWS S3 Commands Reference

aws s3:

move a folder '20170531' from local file system to s3
aws s3 mv . s3://BucketName/KEY/ --recursive --exclude "*" --include "20170531*”
copy/download a folder '20170525' from s3 to local
aws s3 cp s3://BucketName/KEY/ . --recursive --exclude "*" --include "20170525*"
delete a folder '20170525' from s3
aws s3 rm s3://BucketName/KEY/ --recursive --exclude "*" --include "20170525*”
Sync a folder '20170525' from s3 to local
aws s3 sync s3://BucketName/KEY/ . --exclude "*" --include "20170525*"