Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Select only relavant variables for the chart #4881

Merged
merged 1 commit into from
Sep 20, 2024
Merged

Select only relavant variables for the chart #4881

merged 1 commit into from
Sep 20, 2024

Conversation

jryu01
Copy link
Contributor

@jryu01 jryu01 commented Sep 20, 2024

Description

It looks like there's no way to filter or select data columns to reduce the size of the data using only vegalite chart spec. So , I just chopped off the unused variables from the datasets before passing it to the chart.

Before we had an issue of browser crashing when more than 3 variables are selected. Now more variables can be selected.

Screenshot 2024-09-20 at 2 15 58 PM

Note: We still have issues when too many variables are selected with large dataset. For this particular example (https://app.staging.terarium.ai/projects/f6a5af08-8d19-4462-bc5b-c12a9d6f6616/workflow/d7bf01c5-7c6e-4503-800c-f2d03dea9d1e?operator=bff38ac4-ca7a-44c4-8eca-e82f2a69dccb) , it will still crash the browser when all variables are selected. We may want to introduce the limit on the chart to prevent user from selecting too many variables.

Resolves #4731

@jryu01 jryu01 marked this pull request as ready for review September 20, 2024 18:24
Copy link
Member

@YohannParis YohannParis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, if this become an issue, we could just do the filtering in the back-end and only fetch what is needed for big dataset.

@jryu01 jryu01 merged commit de0a46b into main Sep 20, 2024
4 checks passed
@jryu01 jryu01 deleted the jryu/chart-perf branch September 20, 2024 18:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Chart performance and memory investigation
3 participants