Fileconveyor times out on only 1 file.

[free4653]

I am having a problem with file conveyor repeatedly timing out on one file. I have 11 connections configured, and while the first sync process took a long time, and would repeatedly fail, I just kept re-running the arbitrator and eventually all the files sync'd and the ones that had failed, processed through successfully.

All except for one file. The one file consistently fails, and is pushed back into the failed_files table. which is then moved into the transport queue, which fails and the process repeats.

I am getting the following error messages:

2014-12-03 11:51:54,057 - Arbitrator                - WARNING  - Moved 1 items from the 'failed_files' persistent list into the 'pipeline' persistent queue.
2014-12-03 11:51:54,264 - Arbitrator                - INFO     - Pipeline queue -> filter queue: '/app01/cdn/cms-elections/nvra/reports/monthly/reports-monthly/2009/8-august/san-francisco.pdf'.
2014-12-03 11:51:54,264 - Arbitrator                - INFO     - Filtering: '/app01/cdn/cms-elections/nvra/reports/monthly/reports-monthly/2009/8-august/san-francisco.pdf' matches the 'cms-elections' rule for the 'cms-elections' source!
2014-12-03 11:51:54,265 - Arbitrator                - INFO     - Filter queue -> transport queue: '/app01/cdn/cms-elections/nvra/reports/monthly/reports-monthly/2009/8-august/san-francisco.pdf' (rule: 'cms-elections').
2014-12-03 11:51:54,265 - Arbitrator                - INFO     - Transport queue: '/app01/cdn/cms-elections/nvra/reports/monthly/reports-monthly/2009/8-august/san-francisco.pdf' to transfer to server 'cms-elections' with transporter #1 (of 1), place 1 in the queue.
2014-12-03 11:51:59,593 - Arbitrator.Transporter    - ERROR    - The transporter 'Cloud Files' has failed while transporting the file '/app01/cdn/cms-elections/nvra/reports/monthly/reports-monthly/2009/8-august/san-francisco.pdf' (action: 1). Error: 'The read operation timed out'.
2014-12-03 11:51:59,675 - Arbitrator                - WARNING  - Retry queue -> 'failed_files' persistent list: '/app01/cdn/cms-elections/nvra/reports/monthly/reports-monthly/2009/8-august/san-francisco.pdf'. Retrying later.

I tried

• Reading the source to determine the potential causes of the "(action: 1). Error: 'The read operation timed out'. message", but could not find anything. There was barely anything in the transporters/transporter_cloudfiles.py file, I am assuming it imports its functions from somewhere else.
• I have tried connecting to the Cloudfiles container manually using the rackspace web portal, and connected to it using php code, and everything seems ok.
• I also manually cleared the entry from the failed_files table and then moved the file back into the directory. The fsmonitor saw the file appear, but ran into the same problem transporting it.
• I tried working with other files in the same container, and everything appears to work.

Any other hints or suggestions?

[free4653]

FWIW,

I also created a copy of the file into the same directory with another filename and it transferred correctly.

[shackra]

I'm experiencing this but with several HTML files instead of one.

[crasx]

I experience this with multiple files