Polkadot Native Storage Updates

Tech Talk
21

2024-08-27

What has the team done since last week?

Ongoing:

  • Testing the Phase 1 deliverables.
    • Integration tests development
    • Bug fixing as we find them
  • Writing documentation for publishing
22

Is this related to the bulletin chain presented by Gavin at the web3 summit? it seemed like a similar concept.

23

Hello everyone!

Today is a special and happy day. We’ve finished Phase 1 of our Polka Storage project.
We’ve prepared a book containing all you need to test our Phase 1 deliverable, which you can find in:

https://eigerco.github.io/polka-storage-book/

We did a bit more than initially planned and have already started working on Phase 2 tasks while documenting the deliverable. Work continues uninterrupted.

Check out the book and test it out! We’re looking forward to hearing some feedback!

24

Hello Kian! Our project is separate from the Bulletin Chain!

25

2024-09-10 Update!

The team has been at work, pushing forward the project:

  • The research and proof-of-concept for storage proving are under development
    • Proof Generation will be done by the Storage Provider
    • Proof Validation will be done by the Collator
  • We’re implementing batch versions of the pre-commit and prove-commit extrinsics
  • We’re researching testing methods for the chain
26

2024-09-17 Update

  • We have adopted Zombienet SDK to test our parachain.
  • We’ve implemented our own CLI tool for CAR file handling in Rust (similar to go-car)
    • Currently it converts and extracts CAR files
    • Verifying CAR files against CIDs is up next
  • Started researching Graphsync
  • Storage proving is under research and development
    • PoRep verification and generation is being implemented
  • As for the storage provider pallet, we’ve been working on improving deal expiration
27

2024-09-26 Update

We’ve finished:

  • Setting up testing infrastructure
  • The CAR tooling CLI
  • Implementing CommP

We’re working on:

  • Implementing the storage provider RPC for deal making
  • Finishing the storage
  • Testing the PoRep on-chain verification
28

2024-10-01 Update

We’ve finished the Piece Commitment generation.

We’re working on:

  • Finishing the storage provider pallet
  • Finishing deal making
  • PoRep generation and verification
  • Generating the Commitment of Data
29

2024-10-08 Update

We’ve finished deal making.

We’re working on:

  • Finishing the storage provider pallet
  • PoRep generation and verification
  • Generating the Commitment of Data
  • Generating the Commitment of Replication
30

2024-10-15 Update

We’ve finished:

  • Generation of the CommD (Commitment of Data)

We’re working on:

  • Finishing the storage provider pallet
  • The sector sealing pipeline
  • PoSt proof generation and verification
31

2024-10-22 Update

We’re working on:

  • Storage provider pallet and testing it
  • Storage provider sealing pipeline
  • PoSt verification
  • PoRep on-chain verification
    • Researching randomness for the challenges
  • Improving the storagext library for our E2E testing

Started research for the Delia POC from the original research doc

32

FYI, apologies if this is already on your radar…

My understanding is this is not (yet?) practical, but I thought your team may find it interesting nonetheless:

33

Hello @0mm-mark! Thanks for the share, we will be taking a look!

34

2024-10-29 Update

We’re working on:

  • Storage provider sealing pipeline
  • Improving the storagext library for our E2E testing
  • Improving the ergonomics of the storage provider setup process
    • Namely, polishing some aspects of the proofs
  • Researching the Delia POC
    • We have an initial working prototype
35

2024-11-08 Update

We’re working on:

  • Polishing up our Phase 2 delivery, namely
    • Fixing remaining bugs
    • Working on documentation
    • Testing the deliverable

We’ve finishing the initial Delia POC

36

2024-11-12 Update

We’re working on finalizing the Phase 2 delivery:

  • Squashing final bugs
  • Documentation, documentation, documentation
  • Preparing artifacts
37

2024-11-19 Update

We’re now handling tech debt and preparing a faucet for easy testing :eyes:

38

Sounds good.

Will there be a place to ask questions - a Discord, GH discussions or something like that?

39

Hello @somedude, great question!

We’ll take advantage of GitHub Discussions, some reasons:

  • It allows us to keep everything in one place, for easier collaboration
  • It allows us to convert discussions and issues back and forth
  • It allows us to tie discussions to PRs and other pieces of code
40

All right, I’ll watch this thread for future updates!