dckc / madmode-blog

my tinkering notebook (blog)
https://www.madmode.com
0 stars 2 forks source link

beyond crashplan: highly available persistent object capabilities #27

Open dckc opened 7 years ago

dckc commented 7 years ago

I don't want backups. I never did. I want highly available persistent objects.

GET is __uncall

e.g. the shortstory I wrote in macwrite or whatever in the early '90s - openoffice re-hydrated it as HTML just fine... it's like a GET on that original file with accept: application/html and openoffice can convert macwrite to html on the server side. Now I have little use for the macwrite format copy except for audit purposes. (though I didn't make any cryptographic commitments at the time, so there's not much value there.)

backup of large media files has bothered me for ages... but any number of providers will now turn those into highly available object capabilities: google drive, dropbox, probably amazon drive... sandstorm?

A name I control would be nice... IPFS has nice naming, but only for public stuff. I guess filecoin is the next step there? These decentralized storage marketplaces don't seem to be there

dckc commented 7 years ago

good formats for persistent objects, along with their protocols, and how their protocols relate to capTP (and waterken / HTTPS):

microformats fits in here somewhere...

dckc commented 7 years ago

and what of relational databases?

what is the network API for stuff like google's SQL offerings? spark / hive?

dckc commented 7 years ago

cloudabi hosting? how about nearlyfreespeech? they're a big freebsd shop

how do ssh keys relate to caps? they're sorta duals...

dckc commented 7 years ago

xchat irc logs... I was using crashplan... I got ubuntu's thingy working (duplicity?) but the interface I want is grep etc.; i.e. spark / HDFS textfiles; or maybe tables? google sheets? (maybe not CSV, but text lines and a function to parse them into columns)

dckc commented 7 years ago

how does Big Data fit in with blockchain and smart contracts and capabilities?

dckc commented 7 years ago

Kenton Varda announced JS at the edges... brings to mind interesting possibilities... https://blog.cloudflare.com/introducing-cloudflare-workers/

and there's filecoin and the like...

dckc commented 5 years ago

would be cool to pair this with Jessie / Monte ...

MinIO is a high performance object storage server compatible with Amazon S3 APIs. SSL termination, erasure coding... https://min.io/ https://docs.min.io/docs/minio-quickstart-guide.html https://github.com/minio/minio

dckc commented 5 years ago

bumping up the priority of this one... https://sandstorm.io/news/2019-09-15-shutting-down-oasis https://twitter.com/dckc/status/1187147653492158465

ski commented 3 years ago

I have been thinking along the same lines for a while now out in the 'wilderness'. Now if you take this Aug 30 comment, in of itself, this scheme requires you yourself to be the 'highly available' gestalt giving 'meaning' (ghost of ontologies and RDF here for you..) to it. However, if you added ERTP to it, you'd have something that allows a collective gestalt; improving the probability that the patterns that are worthwhile survives the gestalt keeper's own crash.

Is it not odd that privacy only makes sense when there are others there?

dckc commented 3 years ago

hm... not sure I agree, but closely related...

dckc commented 3 years ago

re a name for the short story - perhaps a text fingerprint?

dckc commented 3 years ago

perhaps spritely Porta & Bella: Portable Encrypted Storage spritely / golem · GitLab

dckc commented 2 years ago

minio / s3 looks good again today

dckc commented 1 year ago

https://crust.network/ looks interesting... looks like lots of usage (stats reproduced below) plus encryption.

A peek at the Polkadot ecosystem: not much XCM connectivity

There's a CRU ERC20 token, but it's natively a polkadot para-chain:

Lots of polkadot stuff looks really shiny...

I expected DOT and XCM to work like ATOM and IBC, allowing me to go from an exchange like Coinbase to CRU via DOT using some AMM like Osmosis. But the only XCM channel to CRU is from Equilibrium, where swap is "coming soon". The wallet situation is funky too... nothing multi-chain like Keplr or Cosmostation.

Many burgers sold

Storage capacity : 549,629.232 TB Globally distributed storage nodes : 1,307 Real-time storage fee : $ 0.004411 /GB/Year Storage orders : 1,733,615

dckc commented 1 year ago

I recently scanned some old notebooks for availability but I only put them in Google drive. So I have no local copy. Dropbox provides local copies as well as cloud backup. I wonder if I can get from Google drive to Dropbox via our clone. Sure enough... People are doing it at much larger scales than I need.

https://forum.rclone.org/t/accelerating-migration-gdrive-to-dropbox/30880

Now if I had endo plugins for Google drive and Dropbox, this would be a little bit like Tahoe LAFS. An endo Web user interface to browse my Google drive folders, select one, and copy it to Dropbox would be awesome.

cc @kriskowal @cwebber @michaelfig

dckc commented 11 months ago

GAM-team/got-your-back: Got Your Back (GYB) is a command line tool for backing up your Gmail messages to your computer using Gmail's API over HTTPS.

dckc commented 4 months ago

arweave... so close and yet so far...

https://academy.warp.cc/docs/sdk/advanced/smartweave-protocol