Help Jack get access to storage for data.gov

[flyingzumwalt]

Jack (@mejackreed) at Stanford Libraries has just gotten the green light to download all of data.gov. While he's downloading it, we (IPFS team) will be running tests to prove that we can use IPFS to replicate the data across multiple institutions and also make it available for the broader network. Read the plans for those tests here

Jack is currently blocked, waiting for storage to be allocated. Once he gets the storage, he might run into bandwidth issues. Let's get him access to some storage with big pipes ASAP so he can start downloading and so we can start testing.

Since these things can be sensitive, feel free to contact me @flyingzumwalt privately if you have storage & bandwidth to offer. matt at protocol dot ai

Technical Info

• Jack's current guess is that there will be about 350TB, but there might be more
• There's a copy of the metadata records (~200k records) for the contents of data.gov at https://github.com/OpenGeoMetadata/gov.data

[flyingzumwalt]

Update: Storage Is Being Allocated

The initial volumes will be ready on Thurs, which is plenty of lead time. Thank you to everyone who's been trying to drum up lots of storage super fast. Please continue looking for the storage if you want to participate in the experiments described in the Main data.gov Epic