Code

[WIP] Bootstrappable FCMP++#9440

Code

Draft

tobtoht wants to merge 129 commits intomonero-project:mastermonero-project/monero:masterfrom tobtoht:guix-rusttobtoht/monero:guix-rustCopy head branch name to clipboard

+11,788-1,808

Commits

Commits on Dec 9, 2024

• rough fcmp++ tree impl (lots of work remaining to clean it up and fix)

  

  j-berman

  authored and

  tobtoht

  committed
  d7dcfa3

• remove whitespaces

  

  j-berman

  authored and

  tobtoht

  committed
  5eae425

• test validates lowest layer in tree

  

  j-berman

  authored and

  tobtoht

  committed
  264da8c

• fix c1 c2 layer indexing issue in test helper get_last_chunk

  

  j-berman

  authored and

  tobtoht

  committed
  c91cbc8

• actual indexing fix, tests now passing

  

  j-berman

  authored and

  tobtoht

  committed
  6891097

• Cleaner file organization

  

  j-berman

  authored and

  tobtoht

  committed
  ddae8bd

• template all curve_trees types & funcs, rename tower_cycle_types to tower_cycle

  

  j-berman

  authored and

  tobtoht

  committed
  b9bcf4b

• Implement CurveTrees & CurveTreesUnitTest classes to simplify callers

  

  j-berman

  authored and

  tobtoht

  committed
  5ca330c

• Add Curve class, and Helios & Selene classes that derive from Curve

  

  j-berman

  authored and

  tobtoht

  committed
  8a4e169

• Use widths from fcmp++ repo test & align tests with width

  

  j-berman

  authored and

  tobtoht

  committed
  af5a427

• slight simplification to CurveTrees::hash_layer

  

  j-berman

  authored and

  tobtoht

  committed
  694a0bf

• Consolidate hash_leaf_layer into hash_layer

  

  j-berman

  authored and

  tobtoht

  committed
  70b904a

• Move curve_trees.h implementations into curve_trees.cpp file

  

  j-berman

  authored and

  tobtoht

  committed
  8b59b45

• Cleaner template usage, moved static functions out of CurveTrees class

  

  j-berman

  authored and

  tobtoht

  committed
  0bd3299

• small cleanup

  

  j-berman

  authored and

  tobtoht

  committed
  27751b3

• start LMDB grow_tree

  

  j-berman

  authored and

  tobtoht

  committed
  31278ab

• Remove cxx and expose scalars/points directly

  

  kayabaNerve

  authored and

  tobtoht

  committed
  f1c3827

• fmt, clippy

  

  kayabaNerve

  authored and

  tobtoht

  committed
  0e1ac07

• Use statics on the Rust side for generators

  

  kayabaNerve

  authored and

  tobtoht

  committed
  6c91192

• Only pass a single prior child

  

  kayabaNerve

  authored and

  tobtoht

  committed
  276ef8a

• don't want to expose generator lengths in ffi

  

  j-berman

  authored and

  tobtoht

  committed
  506a2cc

• explicit type response to hash_grow 's

  

  j-berman

  authored and

  tobtoht

  committed
  ed110c0

• Remove reference from m_hash_init_point

  Show description for fea7727
  

  kayabaNerve

  authored and

  tobtoht

  committed
  fea7727

• Simplify edge case handling in hash_layer

  Show description for bbc69ab
  

  j-berman

  authored and

  tobtoht

  committed
  bbc69ab

• Implement get_tree_last_chunks in db, can now extend tree in db

  

  j-berman

  authored and

  tobtoht

  committed
  f62080b

• implement db->audit_tree, and flesh out db test to init/extend tree

  

  j-berman

  authored and

  tobtoht

  committed
  9082fd4

• cleaner lmdb test structure for curve trees

  

  j-berman

  authored and

  tobtoht

  committed
  45d92df

• CurveTreesUnitTest -> CurveTreesGlobalTree class

  

  j-berman

  authored and

  tobtoht

  committed
  53516d0

• Set up trim_tree_in_memory test

  

  j-berman

  authored and

  tobtoht

  committed
  cf7c435

• expose and test hash_trim from rust lib

  

  j-berman

  authored and

  tobtoht

  committed
  06f9102

• implement trim_tree_in_memory

  

  j-berman

  authored and

  tobtoht

  committed
  38a599c

• faster trim_tree tests

  

  j-berman

  authored and

  tobtoht

  committed
  ce930d4

• Fix grow_tree, restructure it, and clean the approach

  Show description for 5428c69
  

  j-berman

  authored and

  tobtoht

  committed
  5428c69

• Implement and test trim_tree algo in memory

  

  j-berman

  authored and

  tobtoht

  committed
  88d5c1f

• whitespace fixes

  

  j-berman

  authored and

  tobtoht

  committed
  1ae6b22

• Better tests for hash_trim

  

  j-berman

  authored and

  tobtoht

  committed
  bf4354a

• Better organization

  

  j-berman

  authored and

  tobtoht

  committed
  0d5f034

• trim_tree db impl + db test + some housekeeping

  

  j-berman

  authored and

  tobtoht

  committed
  08dafc5

• lmdb migration to init curve trees tree from existing outputs

  Show description for 3393139
  

  j-berman

  authored and

  tobtoht

  committed
  3393139

• Implemented growing the tree on sync + lots of cleaning

  Show description for 8b423e5
  

  j-berman

  authored and

  tobtoht

  committed
  8b423e5

• Guarantee insertion order into the tree using global output ID

  Show description for e5568b8
  

  j-berman

  authored and

  tobtoht

  committed
  e5568b8

• Match output unlock time (fix off by 1)

  

  j-berman

  authored and

  tobtoht

  committed
  ed418a9

• Remove leaves from locked leaves table upon insertion to tree

  

  j-berman

  authored and

  tobtoht

  committed
  4865087

• Remove copy in get_tree_extension and better named funcs

  

  j-berman

  authored and

  tobtoht

  committed
  122c513

• Use a pointer for the value in CResult

  Show description for 20c3c60
  

  kayabaNerve

  authored and

  tobtoht

  committed
  20c3c60

• use void * to try to fix CResult

  

  j-berman

  authored and

  tobtoht

  committed
  b9f38b4

• Rust cross compilation

  

  kayabaNerve

  authored and

  tobtoht

  committed
  b6bbf11

• Correct path to the staticlib

  

  kayabaNerve

  authored and

  tobtoht

  committed
  fa05ae8

• Increase misc discrepancies in ARM ARCH spec which we support

  

  kayabaNerve

  authored and

  tobtoht

  committed
  a6ffc64

• i386 -> i686, riscv64 -> riscv64gc

  Show description for 1ac5720
  

  kayabaNerve

  authored and

  tobtoht

  committed
  1ac5720

• Further match off RUST_ARCH, not ARCH_ID

  

  kayabaNerve

  authored and

  tobtoht

  committed
  d4c071c

• Install Rust when doing the Windows build

  

  kayabaNerve

  authored and

  tobtoht

  committed
  555276f

• Use the armv7 HF Rust toolchain

  

  kayabaNerve

  authored and

  tobtoht

  committed
  9dcbba0

• Cross-compile from Ubuntu 22.04

  Show description for ae35635
  

  kayabaNerve

  authored and

  tobtoht

  committed
  ae35635

• Ubuntu 20.04, Rust 1.72

  

  kayabaNerve

  authored and

  tobtoht

  committed
  47c5259

• Normalize x86-64 to x86_64

  

  kayabaNerve

  authored and

  tobtoht

  committed
  a81616f

• Rust 1.69

  

  kayabaNerve

  authored and

  tobtoht

  committed
  a02d5c7

• LTO off

  Show description for aca23ff
  

  kayabaNerve

  authored and

  tobtoht

  committed
  aca23ff

• Correct typo in MATCHES statement

  

  kayabaNerve

  authored and

  tobtoht

  committed
  5da6196

• Correct in-tree code to Rust 1.69

  

  kayabaNerve

  authored and

  tobtoht

  committed
  3edfd1c

• Link additional libs on Windows

  

  kayabaNerve

  authored and

  tobtoht

  committed
  64f4859

• Abort on panic, fix 32-bit Windows undefined reference

  

  kayabaNerve

  authored and

  tobtoht

  committed
  b7a3fcc

• Only provide dummy _Unwind_Resume on x86 Windows

  

  kayabaNerve

  authored and

  tobtoht

  committed
  15d899a

• Link additional libs on Windows (yet actually adding the relevant changes)

  

  kayabaNerve

  authored and

  tobtoht

  committed
  8b6f426

• Use a single target_link_libraries call

  

  kayabaNerve

  authored and

  tobtoht

  committed
  afb807b

• Touch up merge for cross-compilation fixes

  

  j-berman

  authored and

  tobtoht

  committed
  90f915b

• Resolve cross-compile errors

  Show description for 24a68cd
  

  j-berman

  authored and

  tobtoht

  committed
  24a68cd

• resolve rebase to master issues

  

  j-berman

  authored and

  tobtoht

  committed
  fbdb96d

• Instantiate m_curve_trees on BlockchainLMDB class in c'tor

  

  j-berman

  authored and

  tobtoht

  committed
  4754425

• include fcmp/curve_trees.h in db_lmdb.h

  

  j-berman

  authored and

  tobtoht

  committed
  6520e37

• Add * point from bytes

  

  kayabaNerve

  authored and

  tobtoht

  committed
  0a4b05c

• fcmp++: add support for new fcmp types in cryptonote::transaction

  Show description for b965059
  

  j-berman

  authored and

  tobtoht

  committed
  b965059

• fix json tagging in fcmp_pp serialization

  

  j-berman

  authored and

  tobtoht

  committed
  930f881

• Use explicit code instead of macro in custom fcmp_pp serialization

  Show description for d1a6e2c
  

  j-berman

  authored and

  tobtoht

  committed
  d1a6e2c

• Store points in the tree in compressed encoding (32 bytes)

  

  j-berman

  authored and

  tobtoht

  committed
  36507f5

• Store {O,C} for each leaf tuple instead of {O.x,I.x,C.x}

  Show description for 21e5e14
  

  j-berman

  authored and

  tobtoht

  committed
  21e5e14

• Optimize conversion from output to leaf tuple

  

  j-berman

  authored and

  tobtoht

  committed
  d4e6f8c

• Don't copy when flattening leaves

  

  j-berman

  authored and

  tobtoht

  committed
  ab85646

• cleaner crypto for converting output to leaf tuple

  

  j-berman

  authored and

  tobtoht

  committed
  14e5c42

• fcmp++: Restart migration from where it leaves off

  

  j-berman

  authored and

  tobtoht

  committed
  3b1782a

• fcmp++: compilation fixes + misc. cleanup

  Show description for 000128d
  

  j-berman

  authored and

  tobtoht

  committed
  000128d

• 32-bit platform compatibility in Rust FFI (untested)

  

  j-berman

  authored and

  tobtoht

  committed
  89863ce

• Revert DELETE_DB macro to original spot

  

  j-berman

  authored and

  tobtoht

  committed
  d1a2714

• Rename everything from fcmp* to fcmp_pp

  

  j-berman

  authored and

  tobtoht

  committed
  3556379

• fix clang compile errors

  

  j-berman

  authored and

  tobtoht

  committed
  0757712

• fcmp++: implement iterative audit_tree function

  Show description for 41273c7
  

  j-berman

  authored and

  tobtoht

  committed
  41273c7

• fcmp++: store {output pubkey, commitment} in db, pre-torsion clear

  Show description for 1e4c574
  

  j-berman

  authored and

  tobtoht

  committed
  1e4c574

• link correct cncrypto and ringct_basic libs

  

  j-berman

  authored and

  tobtoht

  committed
  de07924

• Remove ringct dep in fcmp_pp, impl in fcmp_pp_crypto

  

  j-berman

  authored and

  tobtoht

  committed
  d0203d2

• add missing files

  

  j-berman

  authored and

  tobtoht

  committed
  f7c1374

• Don't store output_id in locked_outpust table, table stays ordered

  

  j-berman

  authored and

  tobtoht

  committed
  71d9f37

• Clean lmbd impl

  Show description for a03a670
  

  j-berman

  authored and

  tobtoht

  committed
  a03a670

• lmdb touchup && OutputsByUnlockBlock map -> unordered_map

  

  j-berman

  authored and

  tobtoht

  committed
  31b98c9

• new_leaf_tuples -> new_outputs

  

  j-berman

  authored and

  tobtoht

  committed
  0759785

• fcmp++: proof len from inputs *AND merkle tree depth

  

  j-berman

  authored and

  tobtoht

  committed
  dfaf3d1

• Fix compile on arm-linux-androideabi (32-bit) using a newer NDK

  Show description for 5211960
  

  j-berman

  authored and

  tobtoht

  committed
  5211960

• fcmp++: trim tree when removing a block

  Show description for 9edfb7b
  

  j-berman

  authored and

  tobtoht

  committed
  9edfb7b

• fcmp++: Enable trimming to empty tree

  

  j-berman

  authored and

  tobtoht

  committed
  8ddb268

• fcmp++ LMDB: use dummy key optimization on leaves table

  Show description for bd297ab
  

  j-berman

  authored and

  tobtoht

  committed
  bd297ab

• fcmp++: LMDB touchups

  Show description for 82d0075
  

  j-berman

  authored and

  tobtoht

  committed
  82d0075

• fcmp++: tests now test trimming to empty tree

  

  j-berman

  authored and

  tobtoht

  committed
  483e0a2

• fcmp++: add test to trim the tree then grow again after trimming

  

  j-berman

  authored and

  tobtoht

  committed
  4db2f7d

• fcmp++: better test names

  

  j-berman

  authored and

  tobtoht

  committed
  348964c

• Use macro to de-dupe curve trees test logic

  

  j-berman

  authored and

  tobtoht

  committed
  71becc7

• fcmp++ tests: init tree once in memory and grow copy

  

  j-berman

  authored and

  tobtoht

  committed
  7cdc02b

• fcmp++ tests: init tree in db once, then copy db for tests

  Show description for 4677b71
  

  j-berman

  authored and

  tobtoht

  committed
  4677b71

• fix ubuntu 20 compile

  

  j-berman

  authored and

  tobtoht

  committed
  c0a4952

• fcmp++: multithreaded hashing children chunks into tree

  

  j-berman

  authored and

  tobtoht

  committed
  46358e1

• fcmp++: multithreaded convert valid outputs into leaf tuples

  

  j-berman

  authored and

  tobtoht

  committed
  3955f5f

• fcmp++: output may not be present in locked outputs table on remove

  Show description for 884e5f1
  

  j-berman

  authored and

  tobtoht

  committed
  884e5f1

• fcmp++ lmdb: migration touchups

  Show description for a6c2837
  

  j-berman

  authored and

  tobtoht

  committed
  a6c2837

• fcmp++: key image migration

  Show description for ff35fcb
  

  j-berman

  authored and

  tobtoht

  committed
  ff35fcb

• fcmp++: fix build errs for ki_context_t hash specialization

  Show description for fc0536a
  

  j-berman

  authored and

  tobtoht

  committed
  fc0536a

• crypto: fe_batch_invert using Montgomery's trick

  Show description for 7b9127e
  

  j-berman

  authored and

  tobtoht

  committed
  7b9127e

• fcmp++: use batch inversion when converting outputs to leaf tupels

  

  j-berman

  authored and

  tobtoht

  committed
  0cd6bd8

• Fix build errs + warnings

  

  j-berman

  authored and

  tobtoht

  committed
  fe6fe59

• fcmp++: use fe * instead of vector<fe> + clean up

  

  j-berman

  authored and

  tobtoht

  committed
  e705a42

• small touchups

  

  j-berman

  authored and

  tobtoht

  committed
  6a1350a

• crypto: test more batch inversions

  

  j-berman

  authored and

  tobtoht

  committed
  d415a80

• fcmp++: rename "PreWeiX" -> "EdYDerivatives" + small touchups

  Show description for bf83f8d
  

  j-berman

  authored and

  tobtoht

  committed
  bf83f8d

• missing ref

  

  j-berman

  authored and

  tobtoht

  committed
  55035bd

• fcmp++ tests: set up test for prove

  Show description for 625f88f
  

  j-berman

  authored and

  tobtoht

  committed
  625f88f

• fcmp++: fix trim_tree get_trim_layer_instructions logic err

  Show description for 6f608eb
  

  j-berman

  authored and

  tobtoht

  committed
  6f608eb

• fcmp++: fix migration batching to resize db as needed

  Show description for c7b9a64
  

  j-berman

  authored and

  tobtoht

  committed
  c7b9a64

Commits on Dec 12, 2024

• Bootstrappable Builds

  tobtoht

  committed
  e0ca4ed

• depends: freebsd_base: update to 12.3

  tobtoht

  committed
  c25f2dc

• guix: bump time-machine to 9d09b0cf841fb657a1aec12e9bab68e00c2b493c

  tobtoht

  committed
  bade043

• build: drop support for 32-bit windows target

  tobtoht

  committed
  8a7cdda

Commits on Dec 15, 2024

• Bootstrappable FCMP++

  tobtoht

  committed
  6b7869a