Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TestMinerDealMarshallUnMarshall #600

Draft
wants to merge 66 commits into
base: master
Choose a base branch
from
Draft

Conversation

dirkmc
Copy link
Contributor

@dirkmc dirkmc commented Aug 5, 2021

No description provided.

aarshkshah1992 and others added 30 commits July 13, 2021 12:53
* dag store lotus mount

* storage client code complete-tests remain

* storage miner first draft

* second draft

* provider state tests are now working

* most unit tests working and more unit tests

* refactor: car store trackers (#559)

* Apply suggestions from code review

Co-authored-by: dirkmc <dirkmdev@gmail.com>

* nits and review

* integration testing changes

* storage test harness changes

* added more TODOs

* fix itests for storage

* get offline deal tests working

* tests work

* more tests

* integration tests

* fix blockstore finalize

* Integrate CARv2 blockstore in the retrieval market (#560)

* refactor: integrate dag store into retrieval market

* fix all tests and the padding issue

* refactor: move mount from shared testutil to dagstore dir

* refactor: add tests for lazy blockstore

* refactor: code cleanup

* feat: update go-car to latest

* Dagstore lotus mount Implementation with tests (#564)

* dagstore lotus mount impl

* refactor: nicer error messages

* mount api tests

* refactor: integrate dag store (#565)

Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>

* some storage market fixes by aarsh

* fix: better error messages in DAG store wrapper

* refactor: simplify mock dag store wrapper

* fix: TestBounceConnectionDealTransferOngoing

* refactor: remove some commented out code

* refactor: closable blockstore interface to use full blockstore

* fix: TestBounceConnectionDealTransferUnsealing

* refactor: add comment explaining lotus mount template

* test: verify that the lazy blockstore is only initialized once

* fix: comment

* fix: always finalize blockstore before reaching complete state (#567)

Co-authored-by: aarshkshah1992 <aarshkshah1992@gmail.com>

Co-authored-by: dirkmc <dirkmdev@gmail.com>
…irst attempt fails with `ErrShardUnknown` (#571)

* register a shard during loading and attempt to load again

* use dagstore 0.1

* address nit
* integrate CARv2 blockstore  resumption

* fix: enable finalize blockstore after restart

* fix: use latest go-car

Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>
* feat: migration to register all active deals as shards

* feat: check if deal unsealed during register shard migration

* fix: register shards in parallel

* test: shard registration test

* refactor: dag store wrapper register shard

* fix: address review

* refactor: use map to check if deal in sealing state

* refactor: rename shard registration methods

* migration: start consuming results ASAP.

* simplify indirection.

* fix a bug; thanks @dirkmc

* fix: lint imports

Co-authored-by: Raúl Kripalani <raul@protocol.ai>
* remove badger from storage client

* fix test compilation

* update go.mod

* add docs

* fix go mod

* update carv2 and tests for the filestore adapter

* fix tests and update carv2
#575)

* fix isUnsealed check in shard migration

* changes as per review
* refactor: move lotus mount and dag store wrapper to lotus

* rebase

Co-authored-by: aarshkshah1992 <aarshkshah1992@gmail.com>
@raulk raulk force-pushed the feat/wip-markets-dagstore branch 2 times, most recently from bd6c99c to bcb4d1f Compare August 16, 2021 18:09
Base automatically changed from feat/wip-markets-dagstore to master August 16, 2021 18:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants