Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WASM in Browser Performance Improvements #6570

Closed
brettsaunders21 opened this issue Oct 16, 2024 · 1 comment
Closed

WASM in Browser Performance Improvements #6570

brettsaunders21 opened this issue Oct 16, 2024 · 1 comment
Labels
question Further information is requested

Comments

@brettsaunders21
Copy link

brettsaunders21 commented Oct 16, 2024

Which part is this question about

Library performance when compiled for Web Assembly in the browser

Describe your question

We're building a browser based library with WASM to power a tabular data display in the browser. The plan is to allow the user to carry out actions like filter, sort, split/pivot and group-by

We've looked at libraries like polars, duck-db and data fusion, but they all seem to have a large footprint when compiled to WASM. Or there features like group by don't work quite right for us

We've been using this library so far to back our library, but would like to get the most performance out of it we can. So have the follow three questions

  • Does this support SIMD in WASM on browser? I see from looking at your code you use it, but seems to only work with a rust flag and seems to be 512 bit AVX512. From research I've only seen 128 bit support mentioned for WASM?
  • If yes to the following questions, do you have benchmarks in WASM environment, docs or any details on what uses SIMD?
  • Lastly, are there any other options for performance features I can make use of?

Additional context

@brettsaunders21 brettsaunders21 added the question Further information is requested label Oct 16, 2024
@tustvold
Copy link
Contributor

tustvold commented Oct 16, 2024

#6554 is probably relevant. I'm not hugely knowledgable about WASM's SIMD support, but presuming you set the appropriate target CPU it should work.

As for performance/support, I know people use this library in WASM contexts but it hasn't been a major development focus, and I am afraid I don't have any benchmarks. There are also possibly some kernels that assume 64-bit architectures, given this isn't actually tested, bugs may be present related to this.

That being said, efforts in this space are appreciated

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants