Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pandas.read_sql_redshift() throws S3WaitObjectTimeout #114

Closed
simonstu opened this issue Jan 21, 2020 · 1 comment
Closed

pandas.read_sql_redshift() throws S3WaitObjectTimeout #114

simonstu opened this issue Jan 21, 2020 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@simonstu
Copy link

The function pandas.read_sql_redshift() throws a S3WaitObjectTimeout when the SQL query returns no rows.
Everything works fine when the query returns some rows. I am using awswrangler-layer-0.2.5-py3.7.zip.

Detailed Error Message:

Response:
{
  "errorMessage": "Waited for s3://XYZ/tmp2/temp_redshift_08f05b022cba42f5b3f5a159f5312bb7/manifest for 30.000000000000156 seconds",
  "errorType": "S3WaitObjectTimeout",
  "stackTrace": [
    "  File \"/var/task/functions/for_testing.py\", line 60, in lambda_handler\n    temp_s3_path=\"s3://\" + bucket_name + \"/tmp2\")\n",
    "  File \"/opt/python/awswrangler/pandas.py\", line 1598, in read_sql_redshift\n    raise ex\n",
    "  File \"/opt/python/awswrangler/pandas.py\", line 1587, in read_sql_redshift\n    connection=connection)\n",
    "  File \"/opt/python/awswrangler/redshift.py\", line 459, in to_parquet\n    self._session.s3.wait_object_exists(path=f\"{path}manifest\", timeout=30.0)\n",
    "  File \"/opt/python/awswrangler/s3.py\", line 103, in wait_object_exists\n    raise S3WaitObjectTimeout(f\"Waited for {path} for {time_acc} seconds\")\n"
  ]
}
@igorborgest igorborgest self-assigned this Jan 21, 2020
@igorborgest igorborgest added bug Something isn't working good first issue Good for newcomers WIP Work in progress labels Jan 21, 2020
@igorborgest
Copy link
Contributor

Thanks @simonstu. Valuable issue!

Already fixed and will be released in the next version on the weekend.

@igorborgest igorborgest removed the good first issue Good for newcomers label Jan 24, 2020
@igorborgest igorborgest removed the WIP Work in progress label Apr 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants