Skip to content

free-audio/web-clap

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 

Repository files navigation

GOALS

  • Define a standard for building CLAP plugins that:
    • targets WASM + WASI architecture
    • can run within a web browser
    • can run within a WASM JIT engine, like wasmer
  • Define a standard way to distribute web CLAP plugins

Why?

A WCLAP (meaning WEB-CLAP) can:

  • run on any OS and CPU archicture
    • build once, run everywhere
    • long term compatibility
    • good performance as the code can be optimized for the native CPU and use SIMD
  • use web technologies for the GUI
  • better user experience for installing and discovering plugins:
    • standard and unified way to distribute and install
    • Official plugin registry, with the possibility for the user to add unofficial plugin registries

How?

There are a set of constraints when targeting WCLAP:

  • the plugin may run on an OS that may not exist yet at the time of building the plugin
    • the host has to help the plugin to determine where to store files, like activation, user preset, caches, indexes, ...
  • we will probably need to be able to sandbox plugins:
    • restrict filesystem, network, hardware, ... access

The plugin will be a bundle.

We'll have an official root plugin registry, hosted by the CLAP project.

We'll provide a standard and opensource adapter for bridging wasm plugin to existing native hosts.

The bridge

It is unrealistic to expect every hosts to add support to wasm and undesirable because:

  • it is very hard to add the required dependencies to the build system
  • we want a consistent experience across all hosts
  • we want a universal solution

We will build an opensource bridge that the user will have to install and update.

---------------       ---------------       ----------------
| Native Host | <---> | WASM Bridge | <---> | WASM Plugins |
---------------       ---------------       ----------------

The bridge will:

  • provide web-ui support for the wasm plugins
  • provide wasi runtime via wasmer (or similar)
  • provide an application for:
    • browsing and installing/uninistalling wclap plugins
    • managing the plugin permissions
  • provide filesystem helper for the plugin to locate:
    • the plugin bundle (to load the factory content, ...)
    • the user preset directory
    • the cache directory
    • the "var" directory (to store indexes, activation files, preferences, ...)
    • this could be done via a virtual filesystem mapping (within wasmer) or via a getter.

The bridge will likely be implemented in rust, because cargo will make everything easier.

GUI

The GUI is optional, so 3 scenarios are planned:

  • headless
  • web gui
    • we can ship a web browser engine like tauri does, and spawn a window for the plugin with a webview, then connect the plugin to the webview
  • native gui
    • once wasi provides wgpu, mouse and keyboard using input and windowing system support

The Bundle file format

The bundle is a directory that contains a mandatory module.wasm file, and an arbitrary set of files. For example:

my-plugin.wclap/
|`- module.wasm
|`- factory-wavetables/...
|`- factory-presets/...
|`- gui/
|    `- images/...
|    `- html/...
|    `- js/...
 `- ...

Bundle should be available for download as an archive using .tar.gz file format.

Hosts running in the web browser might use Service Workers to transparently fetch and unpack this bundle and return its contents using fictitious URLs (e.g. my-plugin.wclap.tar.gz/module.wasm).

The registry

A WCLAP registry is a set of links to repositories.

It is defined by a json file:

{
        "name": "CLAP Official Registry",
        "repositories": [
                "https://u-he.com/clap-repository.json",
                "https://fabfilter.com/clap-repository.json",
                "https://surge-synthesizer.github.io/clap-repository.json",
                // etc...
        ]
}

There will be one official CLAP registry available at a static URL.

The registry will be a static file, which can be updated using a pull request or similar. We may do something similar to flathub.

The repository

A WCLAP repository is define by a json file:

{
        "name": "Official u-he repository",
        "plugins": [
                {
                        "ids": [
                                // all plugin ids within the shell plugin
                                "com.u-he.Zebra2",
                                "com.u-he.Zebrify",
                                "com.u-he.Zebralette",
                        ],
                        "version": "X.Y.Z",
                        "download-url": "https://u-he.com/wclap/Zebra2-X.Y.Z.wclap.tar.gz"
                },
                {
                        "ids": [
                                "com.u-he.Diva"
                        ],
                        "version": "X.Y.Z",
                        "download-url": "https://u-he.com/wclap/Diva-X.Y.Z.wclap.tar.gz"
                }
        ]
}

A repository can be served as a static file and it is the task of the plugin manufacturer to maintain this file.

The https protocol will provide trust that repository is provided by the plugin manufacturer as it should be hosted on the plugin's website.

TODO: we may consider providing a helper that can automatically build the repository json file.

About

sandbox repository for drafting web-clap

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages