Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expose celery job timeout setting to env var #3912

Merged
merged 2 commits into from
Jun 19, 2019

Conversation

deecay
Copy link
Contributor

@deecay deecay commented Jun 18, 2019

What type of PR is this? (check all applicable)

  • Feature

Description

This PR allows users to define celery job timeout from environment variable. Environment variable is REDASH_CELERY_INIT_TIMEOUT and the default value is 10 seconds.

It should help people with limited computing resource seeing [ERROR][MainProcess] Process 'ForkPoolWorker-19' pid:63 exited with 'signal 9 (SIGKILL)' in their logs.

Related Tickets & Documents

This PR is an follow up of #3903.

Mobile & Desktop Screenshots/Recordings (if there are UI changes)

@deecay deecay requested review from arikfr and ranbena June 18, 2019 15:01
@cypress
Copy link

cypress bot commented Jun 18, 2019



Test summary

63 0 0 0


Run details

Commit 81e4aed
Started Jun 19, 2019 12:55 AM UTC
Ended Jun 19, 2019 1:02 AM UTC
Duration 07:55 💡
OS linux Debian - 8.10
Browser Electron 61.0.3163.100

View run in Cypress Dashboard ➡️


This comment has been generated by cypress-bot as a result of your project's GitHub integration settings. You can manage this integration in your project's settings in the Cypress Dashboard

@@ -31,6 +31,8 @@
CELERY_RESULT_EXPIRES = int(os.environ.get(
"REDASH_CELERY_RESULT_EXPIRES",
os.environ.get("REDASH_CELERY_TASK_RESULT_EXPIRES", 3600 * 4)))
CELERY_JOB_TIMEOUT = int(os.environ.get(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CELERY_JOB_TIMEOUT is a bit misleading here. How about CELERY_INIT_TIMEOUT?

@deecay deecay requested a review from arikfr June 19, 2019 00:45
@arikfr arikfr merged commit be580b2 into getredash:master Jun 19, 2019
@arikfr
Copy link
Member

arikfr commented Jun 19, 2019

Thanks!

@deecay deecay deleted the celery-async-timeout branch June 19, 2019 13:52
@jezdez
Copy link
Member

jezdez commented Jun 24, 2019

Just for record-keeping, this is considered a potential bug in Celery and may be fixed with an upstream fix: celery/celery#4323

harveyrendell pushed a commit to pushpay/redash that referenced this pull request Nov 14, 2019
* Expose celery job timeout to env

* Change variable name
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants