Hi, Would consider update an vllm image update to latest?

coreweave / ml-containers

MIT License

19 stars 3 forks source link

Hi, Would consider update an vllm image update to latest? #69

Open MonolithFoundation opened 2 months ago

MonolithFoundation commented 2 months ago

it introduce some nice new features.

sangstar commented 2 months ago

Hi! Yes, the image will no longer use our fork now that tensorizer is officially integrated in to vLLM's model loading. The updated image build is scheduled.

sangstar commented 2 months ago

I'm reopening this until our build succeeds and is stable, as there's a few extra things to account for with this update that we're currently working on.

MonolithFoundation commented 2 months ago

looking forward to it.