search

dweb-camp-2019 / projects

Projects @ DWeb Camp 2019 💻
https://riot.im/app/#/room/#dweb-camp-2019-projects:matrix.org
15 stars 0 forks source link

Package manager servers on the meshnet #20

Open pospi opened 5 years ago

pospi commented 5 years ago

Idea

There are likely going to be a lot of development-centered activities at the camp- as such, it would be cool if people were able to provide mirrors for npmjs.org / crates.io etc so that we can share code more easily... or some other way to sync the necessary dependencies for collaboration. Just putting this out there to see if anyone has lightweight & easily replicable solutions ;)

Skillsets

Devops / server admin experince

benhylau commented 5 years ago

I wonder if IPFS (debian mirror?) or open-registry.dev (npm?) may have solutions for this one. @victorb may know something about package mirrors on off-Internet local networks?

victorb commented 5 years ago

Yeah, Open-Registry could easily be used for this (and we can also easily add more things than just npm [like debian]).

Basically, running one instance on the mesh of Open-Registry, with other participants using Bolivar (https://github.com/open-services/bolivar) would enable everyone to download and re-share packages that have been cached in the Open-Registry instance, even without internet connection.

benhylau commented 5 years ago

Anyone interested in running this? We have a way to emulate the local network for testing https://github.com/dweb-camp-2019/meshnet/blob/master/testnet/README.md

sbillig commented 5 years ago

@pospi @benhylau

I started hacking together an ipfs-backed crates.io download api proxy/mirror a few weeks back, but sort of lost steam when I heard there would be a decent internet connection at the camp. I'll bring a copy of all of the crates (30-50GB? (still downloading)). Not sure if I'll continue with the api proxy; maybe I'll put them in an ipfs mfs and/or dat, and see how well that works with cargo-vendor or something. I'll ponder and poke at it a bit; definitely open to suggestions if you have any.

benhylau commented 5 years ago

I definitely would like to unplug the entire / segments of this network at certain hours during Camp if others are interested!

sbillig commented 5 years ago

Sounds good to me! With 500 dweb/dwebcurious people in one place, it seems like a useful exercise to force us to make things work sans internet infrastructure.

pospi commented 5 years ago

oh, looks like previous comment has been deleted but https://www.npmjs.com/package/friendpm sounded like a great solution for nodejs code sharing. I think https://www.npmjs.com/package/airtar would also be a good one for people to have pre-installed.

benhylau commented 5 years ago

oh, looks like previous comment has been deleted

Oh? Like an admin deleted or it didn't go in properly? I definitely didn't delete anything.

pospi commented 5 years ago

Based on the email notifications I think the author did, no dramas

On Sun, 30 Jun 2019 at 15:24, Benedict Lau notifications@github.com wrote:

oh, looks like previous comment has been deleted

Oh? Like an admin deleted or it didn't go in properly? I definitely didn't delete anything.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/dweb-camp-2019/projects/issues/20?email_source=notifications&email_token=AADK2JGB33ELEENZCFKKQ2TP5A7RRA5CNFSM4HNZYLG2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODY4FOPQ#issuecomment-507008830, or mute the thread https://github.com/notifications/unsubscribe-auth/AADK2JBJ46B7QRMD2FXRNUDP5A7RRANCNFSM4HNZYLGQ .

-- writings http://pospi.spadgos.com/ | twitter https://twitter.com/pospigos | github https://github.com/pospi ← where to find me ValueFlows https://www.valueflo.ws/ | HoloREA https://github.com/holo-rea/ ← things I'm working on

benhylau commented 5 years ago

Just making sure no one accidentally deleted things, lots of people on the org :)

My guess is friendpm would work only across same node on the mesh network as I see no bootstrap command, same reason all the other p2p apps won't auto-discover across subnets. Could still be useful!

momack2 commented 4 years ago

Love this idea! @achingbrain created "npm-on-ipfs-in-a-box" - which would be great to make npm available on the local network. Maybe he can ship it to me and I can bring it?

benhylau commented 4 years ago

Hey @momack2 having this on the network would be great, especially with an IPFS HTTP gateway on the local IP address.

momack2 commented 4 years ago

Sadly we can't make shipping work in time, but definitely planning to cache some useful content on my local node before attending to make accessible on the network. =]