Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"aws s3 cp" hanging after suspend/resume #568

Closed
ehammond opened this issue Dec 19, 2013 · 1 comment
Closed

"aws s3 cp" hanging after suspend/resume #568

ehammond opened this issue Dec 19, 2013 · 1 comment

Comments

@ehammond
Copy link

I tried to copy a large file from S3 to local:

$ aws s3 cp s3://aws-publicdatasets/common-crawl/crawl-data/CC-MAIN-2013-20/segments/1368711605892/warc/CC-MAIN-20130516134005-00099-ip-10-60-113-184.ec2.internal.warc.gz .

It chugged along happily reporting progress:

Completed 103 of 111 part(s) with 1 file(s) remaining

At this point, I suspended my laptop, then resumed my laptop a while later.

No further progress updates were output to the terminal, so I attempted to interrupt, at which point it said:

^CCleaning up. Please wait...                          

It sat there for several hours. Further ^C did not produce any output, but ^\ did exit:

^C^\Quit (core dumped)

It would be nice if:

  1. It automatically resumed the copy after being suspended, or exited with an error that it could not continue.
  2. It did not hang forever when "cleaning up" after being interrupted.

Let me know if you have any questions or code you'd like me to test with. I am able to reproduce.

@jamesls
Copy link
Member

jamesls commented Jan 15, 2014

I believe this is fixed as a result of the work from #594

The issue was that we weren't setting timeouts on the .read() calls. Now that we are, when the laptop resumes, the .read() call will just timeout, which we will automatically retry. This might vary per platform, but I verified this works on a macbook.

@jamesls jamesls closed this as completed Jan 15, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants