[Nix] Frontend packaging

[yorickvP]

We have a JS/wasm target in one of the branches that should also be packaged with Nix. Furthermore, we should use buildYarnPackage to build the frontend code.

Branch: https://github.com/MinaProtocol/mina/tree/fix/kimchi-proof-js
build:

dune b src/lib/snarky_js_bindings/snarky_js_node.bc.js
dune b src/lib/snarky_js_bindings/snarky_js_chrome.bc.js

[yorickvP]

This branch has been merged into develop, it's now possible to work on this.

[yorickvP]

Update on this: the work has been rebased to the develop branch, which also contains frontend code: https://github.com/tweag/mina/tree/tweag-cleanup-develop.
I am working on cleaning up the changes necessary for this and pull-requesting them upstream.

[yorickvP]

Update:

• The js_of_ocaml packages are working, modulo an opam-nix bug concerning LD_LIBRARY_PATH.
• The wasm packages require some hopefully straightforward work

[yorickvP]

Status update:

• Work at https://github.com/tweag/mina/commits/yorickvp/nix-rust-wasm
• The wasm bindings use the cargo -Zbuild-std feature, which doesn't support the cargo vendor setup that we use yet. Github issue comments talk of a workaround, but the link seems to be gone. I'll contact the people involved.
• I've added an (impure) nix development shell in which the build succeeds.
• In the meantime, building without -Zbuild-std gets me somewhat further inside nix shell. I'll debug why wasm-pack can't find wasm-bindgen.

[yorickvP]

Back from having covid.

• @balsoft seems to have solved bindgen.
• Here's how dfinity solved the -Zbuild-std issue: Update Rust dfinity/motoko#2761 . I'll see if we can use this today.

[yorickvP]

• Fixed the mina_client_sdk_binding pkg output
• Will now work on packaging frontend/client_sdk and frontend/mina-signer

[yorickvP]

Ran into a nix-npm-buildPackage bug, that I should really fix (current workaround mixes nodejs version), but I did produce a PR containing the packages for the world to look at.

[yorickvP]

Update: nix-npm-buildPackage is not compatible with npm lockfile v2, adding this compatibility should be easy.

[yorickvP]

Produced serokell/nix-npm-buildpackage#44

[yorickvP]

Todo tomorrow: re-rebase

[yorickvP]

Update:

• spent all day getting dune+cargo to cooperate for incremental builds. The current detection based on cargo workspaces is non-deterministic (since it relies on some deps not making it into _build, which depends on the build order). My new plan is to hardcode the cargo target directory outside _build, per dune target.
• Produced fix(read): change lstat to stat to correctly evaluate file size npm/cacache#114, which was merged and should make it into nodejs upstream
• Produced buildNpmPackage: use symlink if supported by cacache serokell/nix-npm-buildpackage#45, which uses the above for more efficient cache creation when it's available.

[yorickvP]

I've split off some trivial changes that were pulling in a lot of reviewers:

• dune: add (sandbox none) to mina_version, ocaml-rocksdb #11173
• [develop] dune: add (sandbox none) to mina_version, ocaml-rocksdb #11174
• frontend/mina-signer: add 'jest' dev-dependency to run tests in CI #11175

This should cut down the reviewers to just protocol-eng.