Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Register as a provider for stored CIDs to the network #631

Open
1 of 8 tasks
aarshkshah1992 opened this issue Sep 16, 2021 · 1 comment
Open
1 of 8 tasks

Register as a provider for stored CIDs to the network #631

aarshkshah1992 opened this issue Sep 16, 2021 · 1 comment
Assignees

Comments

@aarshkshah1992
Copy link
Collaborator

aarshkshah1992 commented Sep 16, 2021

Retrieval by any Cid(and not just the root Cid) from a single Storage Deal/Piece.

Miner announces all cids it can serve retrievals for to the Network Indexer.

  • Integrate chore(deps): use go-car master version #639. (nice to have)
  • CARv2 dep upgrade to allow iterable CAR Indices.
  • Miner makes Index announcements for all storage deals and also serves those Indices to the network Indexer. This is currently blocked on the reference provider being built by Data-systems. ETA September last week.
  • Build CLI support for:
    - [ ] Force an Index announcement for an existing storage deal to the network Indexer.

Required Migration/s

  • Miners will have to re-run the DAGStore shard migration they ran for M1 from scratch again. The reason is that the CARv2 lib now has a "breaking change" to the Index format to allow the Index to be iterable. The Index needs to be iterable so Miner can announce it's local Cid indices to the network Indexer.

  • We can piggy-back the "migration" of building the top-level Index in the DagStore and making announcements for them to the network Indexer on top of the above mentioned DAGStore shard migration. We should therefore do only one release for the entire M2 Ignite work so as to make life easy for users by not having them do multiple migrations.

@aarshkshah1992
Copy link
Collaborator Author

aarshkshah1992 commented Sep 16, 2021

cc @jacobheun @jennijuju for tracking/concerns.

@jacobheun jacobheun changed the title [M2 Ignite] Register as a provider for stored CIDs to the network Sep 24, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant