e2b-dev / E2B

Secure open source cloud runtime for AI apps & AI agents
https://e2b.dev/docs
Apache License 2.0
7.02k stars 458 forks source link

E2B local use #239

Open Deph1 opened 11 months ago

Deph1 commented 11 months ago

Hi there,

is it possible for this to be ran locally? I'm aware of the horrors/dangers of it but that's entirely why I want to!

thanks

mlejva commented 11 months ago

Hey @Deph1,

We'll be open sourcing the whole infrastructure powering E2B soon which will make it possible to self-host it.

But running it locally on your machine might be a bit tricky if you're using macOS or Windows though. E2B is powered by Firecracker microVM. Firecrackers require KVM which isn't on macOS nor WIndows.

This means that you'd most likely run our E2B's infrastructure on Linux

microchipgnu commented 11 months ago

Good to hear that you're planning on letting folks self-host your infrastructure.

Will you consider a workaround with some virtualization to let us dev locally? I imagine there could exist a way to do with with VMWare ou Hyper-V

Would love to hear your thoughts

chymian commented 11 months ago

@mlejva , these are good news. can we track the progress here?

even so I just found out about E2B, it looks like what I've been searching for a while. So, when you need somebody to test, let me know.

mlejva commented 11 months ago

@microchipgnu

Will you consider a workaround with some virtualization to let us dev locally? I imagine there could exist a way to do with with VMWare ou Hyper-V

It's not currently on our roadmap but definitely doable (using VMWare for example). Our main focus will be to offer great DX for self-hosting on AWS, GCP, and Azure first.

@chymian

these are good news. can we track the progress here? We'll do a public announcement once we open source the infrastructure part. Should be soon. We're just backlogged with a few scaling issues and bugs with an unexpected traffic surge.

You mentioned that you've been searching for something like E2B for a while, would love to know what kind of use cases do you have in mind?

chymian commented 11 months ago

I want to establish a flexible Framework for exploring, developing & running AGIs, as well as LLMs/APIs. All locally hosted. Next to my interest to explore AGIs, it's to create a Low-/No-Code environment for self hosted AI-SaaS for SMEs. That woud be a programmatically deployable local infrastructure for both, AI-Backends and Apps.

chymian commented 10 months ago

@mlejva any roadmap/timeframe when you plan to opensource your framework? and a very happy 2024!

mlejva commented 10 months ago

@mlejva any roadmap/timeframe when you plan to opensource your framework? and a very happy 2024!

aiming for January

QuietRocket commented 3 months ago

Hi. I am interested in running the E2B's Firecracker based backend on GCP. Seems like it's re-emerging in demand. Any updates on development? I am open to testing if it's not polished yet. Thanks!

mlejva commented 3 months ago

Hey @QuietRocket it's not ready yet, sorry. We're tackling some scaling issues right now. We'd like to get first self-hosting version out soon though.