Can't bypass OpenAI urls

[mahavatara]

I got modelz running (haven't gotten openmodelz running yet) but it looks like "import openai" poisons something, not sure what, and complain that "any" is not the password, as well as endpoints have changed. Inevitably I'm rediscovering the wheel here and it's already been discussed, perhaps project abandoned, but I thought I should ask as I cannot find the "truth" in reasonable time. Also, has modelz been kinda superseded by some other project?

[gaocegege]

Hi we do not have the bandwidth to maintain it. Maybe you could take a look at vLLM?