Skip to content
/ s3-copy Public
forked from sarunask/s3-copy

Tool for faster transfer multiple files to AWS S3

License

Notifications You must be signed in to change notification settings

90poe/s3-copy

 
 

Repository files navigation

s3-copy

Tool for faster transfer multiple files to AWS S3, by using GO routines.

Install if you have go installed

go get github.com/sarunask/s3-copy

Usage

You will need setup your AWS access first. Please do one of the bellow:

  1. If you run on EC2 instance with IAM role, nothing is required to do
  2. If you run on your own PC, please setup ~/.aws/ with aws configure command
  3. You can export 2 env variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY which will grant you access to AWS

Dry run, with debug, nothing uploaded. You could check if exclude works as expected.

./s3-copy --path ~/Music/ --s3-bucket=ssss --dry-run --debug --sse-c-key 45123qwefawdfgddddadfqwefgqwegdd --exclude '.*\.mp4' --workers 50

If you want to use CSV file as input

./s3-copy --s3-bucket some-bucket --input-csv input.csv

CSV file format localFileName,s3ObjectNameWithPath:

../test/file1.bin,/customers/gu/upload/fileUp1.bin
../test/file2.bin,/customers/gu/upload/fileUp2.bin

About

Tool for faster transfer multiple files to AWS S3

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 87.5%
  • Makefile 12.5%