search

mrusme / superhighway84

USENET-inspired, uncensorable, decentralized internet discussion system running on IPFS & OrbitDB
https://xn--gckvb8fzb.com/superhighway84
GNU General Public License v3.0
694 stars 24 forks source link

Integrate with IPFS file management to share large content #7

Open a8underscore opened 2 years ago

a8underscore commented 2 years ago

is there a solution to "Key: 'Article.Body' Error:Field validation for 'Body' failed on the 'max' tag"?

thank you

mrusme commented 2 years ago

Not right now, because I limited the the maximum post size, in order to avoid the database growing too fast too early.

There are a few considerations that need to be thought about before the database grows too big. At some point there probably has to be sharding in place, in order for people to still be able to use it without dealing with gigabytes of data.

Anyway, how big was the post you were trying to submit? Afair I limited it to ~512kb, which should be fair enough for text posts.

a8underscore commented 2 years ago

I think it was a bit over 1GB

Maybe to help scaling, each "section" could be its own "file" (not sure how that works exactly, database?) that can optionally be downloaded?

mrusme commented 2 years ago

Oh, 1GB is certainly not going to work as an article. I see where you're coming from (the USENET, hehehe) but for this type of bin stuff we will need an integration with the IPFS file storage.

Ideally an article will only contain the hash to the file and make use of IPFS' file management capabilities to share/retrieve the file.

This is a rather complex topic (because integration needs to be really smooth, otherwise people will simply add a MEGA link to their article and call it a day) and more like something for the 0.1.0 or maybe even 1.0.0 version.