search

maxpert / marmot

A distributed SQLite replicator built on top of NATS
https://maxpert.github.io/marmot/
MIT License
1.86k stars 42 forks source link

Files managed using Marmot. #101

Closed gedw99 closed 10 months ago

gedw99 commented 10 months ago

Pocketbase also does file uploads to local and S3.

I would like to brain storm the idea of using Marmot to make file uploads distributed without S3.

suggested Logic:

PB upload to local , just like it does to SQLite.

Fike system watcher sees the new file and then proceeds to replicate it to any other system instances , just like It does to SQLite.

advanced upload logic:

A user uploads from their device to their browser . The browser then uploads in async chunks to the server.

maxpert commented 10 months ago

There are multiple tools available that will let you replicate files across your servers (Rsync, Unison, etc). I don't want Marmot to invest in a problem it's not supposed to deal with. It's a SQLite replication focused, and it should stick to SQLite replication. Anyone looking for replicating files should look into tool focused on doing that. Now it's totally possible to have a bundled configuration where PocketBase + Marmot + Unison can be used to have fully replicated copies, but that is bundling focused problem them. I recently helped someone exactly do that, hopefully they opensource it.

burggraf commented 10 months ago

@gedw99 are you on the Marmot Discord server?

gedw99 commented 10 months ago

@gedw99 are you on the Marmot Discord server?

sorry but I am not. You can contact me via telegram though. https://t.me/gedw999 if you need to discuss something.

gedw99 commented 10 months ago

Unison

There are multiple tools available that will let you replicate files across your servers (Rsync, Unison, etc). I don't want Marmot to invest in a problem it's not supposed to deal with. It's a SQLite replication focused, and it should stick to SQLite replication. Anyone looking for replicating files should look into tool focused on doing that. Now it's totally possible to have a bundled configuration where PocketBase + Marmot + Unison can be used to have fully replicated copies, but that is bundling focused problem them. I recently helped someone exactly do that, hopefully they opensource it.

@maxpert Ok fair enough. I prefer to use NATS ( as it has Obj store that is perfect for my use cases ) and so will investigate linking the Pocketbase file uploads to a NATS based system.