Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sample code to bypass twitcher to debug performance raven process timeout #5

Merged
merged 5 commits into from
Feb 10, 2021

Commits on Feb 4, 2021

  1. proxy: add /raven to bypass twitcher to test connection timeout

    Suspecting Twitcher is buffering the request and/or the response which
    makes Raven appears to take longer to respond to client request.
    
    This is meant as a temporary testing setup only, NOT to be enabled
    permanently on prod.
    tlvu committed Feb 4, 2021
    Configuration menu
    Copy the full SHA
    5f129b5 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2021

  1. proxy: disable the temporary debug bypass twitcher for raven

    Left the code commented out so we have a sample how to do this as documentation.
    tlvu committed Feb 8, 2021
    Configuration menu
    Copy the full SHA
    4cfb683 View commit details
    Browse the repository at this point in the history
  2. proxy: increase further proxy_read_timeout as more testing found out …

    …sometime 4 min was not enough
    
    Have to increase it here since this is an Ouranos prod environment
    specific problem therefore not appropriate to increase in the generic
    birdhouse-deploy repo.
    tlvu committed Feb 8, 2021
    Configuration menu
    Copy the full SHA
    8a7560c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5ab0ac6 View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2021

  1. proxy: rollback proxy_read_timeout in 8a7560c

    Could not set it here due to this error:
    
    ```
    + touch /etc/cron.d/canarieapi-cron
    + exec /bin/sh -c env >> /etc/environment &&     cron &&     nginx &&     gunicorn -b 0.0.0.0:2000 --workers 1 --log-level=DEBUG --timeout 30 -k geven
    t wsgi
    2021/02/08 16:32:23 [warn] 10#10: duplicate MIME type "text/html" in /etc/nginx/conf.d/all-services.include:47
    nginx: [warn] duplicate MIME type "text/html" in /etc/nginx/conf.d/all-services.include:47
    2021/02/08 16:32:23 [emerg] 10#10: "proxy_read_timeout" directive is duplicate in /etc/nginx/conf.extra.d/proxy/increase-proxy_read_timeout.conf:1
    nginx: [emerg] "proxy_read_timeout" directive is duplicate in /etc/nginx/conf.extra.d/proxy/increase-proxy_read_timeout.conf:1
    ```
    tlvu committed Feb 10, 2021
    Configuration menu
    Copy the full SHA
    82cecb1 View commit details
    Browse the repository at this point in the history