Polkadot Native Storage Updates

2024-08-27

What has the team done since last week?

Ongoing:

  • Testing the Phase 1 deliverables.
    • Integration tests development
    • Bug fixing as we find them
  • Writing documentation for publishing

Is this related to the bulletin chain presented by Gavin at the web3 summit? it seemed like a similar concept.

Hello everyone!

Today is a special and happy day. We’ve finished Phase 1 of our Polka Storage project.
We’ve prepared a book containing all you need to test our Phase 1 deliverable, which you can find in:

https://eigerco.github.io/polka-storage-book/

We did a bit more than initially planned and have already started working on Phase 2 tasks while documenting the deliverable. Work continues uninterrupted.

Check out the book and test it out! We’re looking forward to hearing some feedback!

4 Likes

Hello Kian! Our project is separate from the Bulletin Chain!

2024-09-10 Update!

The team has been at work, pushing forward the project:

  • The research and proof-of-concept for storage proving are under development
    • Proof Generation will be done by the Storage Provider
    • Proof Validation will be done by the Collator
  • We’re implementing batch versions of the pre-commit and prove-commit extrinsics
  • We’re researching testing methods for the chain
1 Like

2024-09-17 Update

  • We have adopted Zombienet SDK to test our parachain.
  • We’ve implemented our own CLI tool for CAR file handling in Rust (similar to go-car)
    • Currently it converts and extracts CAR files
    • Verifying CAR files against CIDs is up next
  • Started researching Graphsync
  • Storage proving is under research and development
    • PoRep verification and generation is being implemented
  • As for the storage provider pallet, we’ve been working on improving deal expiration
1 Like

2024-09-26 Update

We’ve finished:

  • Setting up testing infrastructure
  • The CAR tooling CLI
  • Implementing CommP

We’re working on:

  • Implementing the storage provider RPC for deal making
  • Finishing the storage
  • Testing the PoRep on-chain verification

2024-10-01 Update

We’ve finished the Piece Commitment generation.

We’re working on:

  • Finishing the storage provider pallet
  • Finishing deal making
  • PoRep generation and verification
  • Generating the Commitment of Data
1 Like

2024-10-08 Update

We’ve finished deal making.

We’re working on:

  • Finishing the storage provider pallet
  • PoRep generation and verification
  • Generating the Commitment of Data
  • Generating the Commitment of Replication
1 Like

2024-10-15 Update

We’ve finished:

  • Generation of the CommD (Commitment of Data)

We’re working on:

  • Finishing the storage provider pallet
  • The sector sealing pipeline
  • PoSt proof generation and verification
1 Like

2024-10-22 Update

We’re working on:

  • Storage provider pallet and testing it
  • Storage provider sealing pipeline
  • PoSt verification
  • PoRep on-chain verification
    • Researching randomness for the challenges
  • Improving the storagext library for our E2E testing

Started research for the Delia POC from the original research doc

1 Like

FYI, apologies if this is already on your radar…

My understanding is this is not (yet?) practical, but I thought your team may find it interesting nonetheless:

Hello @0mm-mark! Thanks for the share, we will be taking a look!

2024-10-29 Update

We’re working on:

  • Storage provider sealing pipeline
  • Improving the storagext library for our E2E testing
  • Improving the ergonomics of the storage provider setup process
    • Namely, polishing some aspects of the proofs
  • Researching the Delia POC
    • We have an initial working prototype
1 Like

2024-11-08 Update

We’re working on:

  • Polishing up our Phase 2 delivery, namely
    • Fixing remaining bugs
    • Working on documentation
    • Testing the deliverable

We’ve finishing the initial Delia POC

3 Likes

2024-11-12 Update

We’re working on finalizing the Phase 2 delivery:

  • Squashing final bugs
  • Documentation, documentation, documentation
  • Preparing artifacts
1 Like

2024-11-19 Update

We’re now handling tech debt and preparing a faucet for easy testing :eyes:

1 Like

Sounds good.

Will there be a place to ask questions - a Discord, GH discussions or something like that?

Hello @somedude, great question!

We’ll take advantage of GitHub Discussions, some reasons:

  • It allows us to keep everything in one place, for easier collaboration
  • It allows us to convert discussions and issues back and forth
  • It allows us to tie discussions to PRs and other pieces of code
1 Like

All right, I’ll watch this thread for future updates!