Open MonolithFoundation opened 2 months ago
Hi! Yes, the image will no longer use our fork now that tensorizer
is officially integrated in to vLLM's model loading. The updated image build is scheduled.
I'm reopening this until our build succeeds and is stable, as there's a few extra things to account for with this update that we're currently working on.
looking forward to it.
it introduce some nice new features.