Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(raiko): generalized build pipeline for ZkVMs guests #133

Merged
merged 44 commits into from
May 4, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
f5cf542
init + some taiko_util -> util
CeciliaZ030 Apr 27, 2024
e862305
pipeline
CeciliaZ030 Apr 27, 2024
8f757d7
example
CeciliaZ030 Apr 28, 2024
3ed89dc
r0 bins & tests done
CeciliaZ030 Apr 28, 2024
461eb5f
exmple-sp1 done
CeciliaZ030 Apr 28, 2024
6647994
gen proof with unittests
CeciliaZ030 Apr 29, 2024
831038c
test harness for sp1 doen + split the builder and driver
CeciliaZ030 Apr 29, 2024
24d76c6
make example a workspace
CeciliaZ030 Apr 29, 2024
1408f93
change dest param
CeciliaZ030 Apr 30, 2024
f09bdc6
harness upgrade
CeciliaZ030 May 1, 2024
160c973
image id compute
CeciliaZ030 May 1, 2024
7f708c0
cleanup
CeciliaZ030 May 1, 2024
ddecf10
pipeline api change
CeciliaZ030 May 2, 2024
abcf101
r0 switch builder-driver
CeciliaZ030 May 2, 2024
57d59d9
r0 switch builder-driver
CeciliaZ030 May 2, 2024
09e3d58
sp1 prover -> driver rename
CeciliaZ030 May 2, 2024
5bdd80f
sp1 builder
CeciliaZ030 May 2, 2024
1ea8993
Merge remote-tracking branch 'origin/taiko/unstable' into build-pipeline
CeciliaZ030 May 2, 2024
4c1be91
cargo check passed
CeciliaZ030 May 2, 2024
cc6a0b6
name changes
CeciliaZ030 May 2, 2024
7603cee
commented out sp1 & ris0 flags in irrelavent setup
CeciliaZ030 May 2, 2024
9ce1423
fixes + makefile
Brechtpd May 3, 2024
6dbb532
Merge pull request #152 from taikoxyz/build-pipeline-fixes
CeciliaZ030 May 3, 2024
fec0737
update
CeciliaZ030 May 3, 2024
d8520be
clean up
CeciliaZ030 May 3, 2024
32eb702
update CI r0
CeciliaZ030 May 3, 2024
8d4fc2b
update sp1
CeciliaZ030 May 3, 2024
c9db528
add builder to workspace
CeciliaZ030 May 3, 2024
eed6ce5
sp1 CI permission denied
CeciliaZ030 May 3, 2024
78987fe
add example test in guest + clippy
CeciliaZ030 May 3, 2024
f958cfe
add test to CI
CeciliaZ030 May 3, 2024
57c636c
fmt & fix CI bug
CeciliaZ030 May 3, 2024
fd091df
test with --release + toolchain
CeciliaZ030 May 3, 2024
ad73c33
fix
CeciliaZ030 May 3, 2024
0a10265
fix docker
Brechtpd May 4, 2024
68c8c0b
Merge remote-tracking branch 'origin/taiko/unstable' into build-pipeline
CeciliaZ030 May 4, 2024
fafe86b
add CC support for c-kzg
CeciliaZ030 May 4, 2024
9064772
trait Pipeline impl in specific builder
CeciliaZ030 May 4, 2024
a4daa5b
fix ci
CeciliaZ030 May 4, 2024
68341f4
download & verify riscv-gcc-prebuilt
CeciliaZ030 May 4, 2024
4b560dd
Update pipeline/src/lib.rs
CeciliaZ030 May 4, 2024
8c13c62
update script
CeciliaZ030 May 4, 2024
71201d3
Updated readme + fix local building
Brechtpd May 4, 2024
ab070a2
cargo: -> cargo::
Brechtpd May 4, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .dockerignore
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@
!/primitives
!/provers
!/host
!/pipeline
!/rust-toolchain
!/taiko.toml
!/tests
Expand Down
36 changes: 19 additions & 17 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,49 +20,51 @@ jobs:
name: Build and test risc0
runs-on: ubuntu-latest
timeout-minutes: 60
env:
CC: gcc
CC_riscv32im_risc0_zkvm_elf: /tmp/riscv/bin/riscv32-unknown-elf-gcc
steps:
- uses: actions/checkout@v4
with:
submodules: recursive
- run: scripts/toolchain-before.sh risc0
- run: scripts/toolchain.sh risc0
- uses: actions-rs/toolchain@v1
with:
profile: minimal
- run: scripts/toolchain-after.sh risc0
- uses: risc0/risc0/.github/actions/sccache@release-0.19
- name: Install cargo-binstall
uses: cargo-bins/cargo-binstall@v1.6.4
- run: cargo binstall -y --force cargo-risczero
- run: cargo risczero install
- run: cargo build -p risc0-prover --features enable
- run: cargo test -p risc0-prover --features enable
- name: Install cargo-risczero
run: |
cargo binstall -y --force cargo-risczero
cargo risczero install
- name: Build risc0 guest target
run: cargo run --bin risc0-builder
- name: Build risc0 prover
run: cargo build --release --features risc0
- name: Test risc0 prover
run: cargo test -p risc0-driver --features enable

build-test-sp1:
name: Build and test sp1
runs-on: ubuntu-latest
timeout-minutes: 60
env:
CC: gcc
CC_riscv32im_succinct_zkvm_elf: /tmp/riscv/bin/riscv32-unknown-elf-gcc
steps:
- uses: actions/checkout@v4
- run: scripts/toolchain-before.sh sp1
- uses: actions-rs/toolchain@v1
with:
profile: minimal
- run: scripts/toolchain.sh sp1
- run: scripts/toolchain-after.sh sp1
- name: Setup and build
- name: Install sp1
run: |
curl -L https://sp1.succinct.xyz | bash
echo "/home/runner/.config/.sp1/bin" >> $GITHUB_PATH
/home/runner/.config/.sp1/bin/sp1up
cargo build -p sp1-prover --features enable
cargo test -p sp1-prover --features enable
shell: bash
- name: Build sp1 guest target
run: cargo run --bin sp1-builder
- name: Build sp1 prover
run: cargo build --release --features sp1
- name: Test sp1 prover
run: cargo test -p sp1-driver --features enable --release

build-test-sgx:
name: Build and test sgx
Expand All @@ -78,7 +80,7 @@ jobs:
- name: Setup and build
run: |
cargo build --features sgx
cargo test -p sgx-prover --features enable
cargo test -p sgx-prover --features enable --release
shell: bash

build-test-sgx-with-docker:
Expand Down
162 changes: 86 additions & 76 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading