Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Databricks Schema Browser: Allow eventlet worker instead of RQ #5045

Merged
merged 15 commits into from
Jul 15, 2020

Conversation

gabrieldutra
Copy link
Member

What type of PR is this? (check all applicable)

  • Other

Description

Use eventlet worker in order to make the Databricks Schema Browser more responsive.

Related Tickets & Documents

--

Mobile & Desktop Screenshots/Recordings (if there are UI changes)

--

@gabrieldutra gabrieldutra self-assigned this Jul 13, 2020
@gabrieldutra gabrieldutra force-pushed the db-schema-browser--improve-timing branch from d1fdadb to 0f14712 Compare July 13, 2020 21:20
bin/docker-entrypoint Outdated Show resolved Hide resolved
}
return axios
.get(`api/databricks/databases/${id}`, { params })
.then(data => (has(data, "job.id") ? fetchDataFromJob(data.job.id, 300).catch(() => []) : data));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We still call fetchDataFromJob to make it easier to switch to RQ in the future?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea was on those lines, but I can actually remove it for now :)

@gabrieldutra gabrieldutra changed the title Databricks Schema Browser: Use eventlet worker instead of RQ Databricks Schema Browser: Allow eventlet worker instead of RQ Jul 14, 2020
gabrieldutra and others added 2 commits July 14, 2020 09:23
Comment on lines +111 to +115
- run:
name: "Failure: output container logs to console"
command: |
docker-compose logs
when: on_fail
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This part is because I had to debug when it failed. It's good to keep anyway.

@arikfr arikfr merged commit d12691d into master Jul 15, 2020
@arikfr arikfr deleted the db-schema-browser--improve-timing branch July 15, 2020 14:36
@arikfr
Copy link
Member

arikfr commented Jul 15, 2020

👍

andrewdever pushed a commit to andrewdever/redash that referenced this pull request Oct 5, 2020
…dash#5045)

* Add loading button in UI

* Handle databricks schema requests without RQ

* Don't use gevent worker

* Revert "Don't use gevent worker"

This reverts commit 9704c70.

* Use eventlet

* Use first column instead of 'namespace' one

* Revert "Add loading button in UI"

This reverts commit c0e4dfb.

* Remove databricks tasks

* Update eventlet

* Add libevent

* Display logs on failure

* Revert "Add libevent"

This reverts commit a00d067.

* Test updating gunicorn

* Don't set eventlet as the default for Redash

Co-authored-by: Arik Fraimovich <arik@arikfr.com>

* Remove fetchDataFromJob usage

Co-authored-by: Arik Fraimovich <arik@arikfr.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants