Skip to content
This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

Support WebGPU acceleration? #312

Open
richardanaya opened this issue Jun 13, 2023 · 1 comment
Open

Support WebGPU acceleration? #312

richardanaya opened this issue Jun 13, 2023 · 1 comment
Labels
topic:backend-support Support for alternate non-GGML backends, or for particular GGML backend features

Comments

@richardanaya
Copy link

WebGPU might allow llm to to process things faster and abstract away from all the different backends across various platforms and also one day support the web.

https://wgpu.rs/
@philpax
Copy link
Collaborator

philpax commented Jun 13, 2023

Yep, we're working on it! See #137 and #31.

@philpax philpax added the topic:backend-support Support for alternate non-GGML backends, or for particular GGML backend features label Jun 15, 2023
@philpax philpax mentioned this issue Jun 18, 2023
Closed
@philpax philpax mentioned this issue Jun 28, 2023
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
topic:backend-support Support for alternate non-GGML backends, or for particular GGML backend features
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@richardanaya @philpax