search

PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine
https://pygmalion.chat
GNU Affero General Public License v3.0
606 stars 78 forks source link

[Bug]: served-model-name is unused #399

Open mrseeker opened 1 month ago

mrseeker commented 1 month ago

Your current environment

Running latest docker container

🐛 Describe the bug

When trying to run the docker container with config "--served-model-name", the model name is not being used at all; instead, the original model name is being used when asking endpoint /models.

fullstackwebdev commented 1 month ago

... you can sneak extra params in -e "SOME=THING --served-model-name gpt5"