Models not returning all models available

[madonchik123]

When utilizing OpenAI's SDK in Python to access available models from GitHub, the functionality operates as intended; however, it only returns 25 models. Notably, there are over 30 models listed on GitHub, including Phi-3.5-vision-instruct, which do not appear in the API endpoint results.

Here's an example code:

from openai import OpenAI

# Configuration

API_KEY = 'github_pat'
ENDPOINT = "https://models.inference.ai.azure.com"

# Initialize OpenAI client

client = OpenAI(base_url=ENDPOINT, api_key=API_KEY)
available = client.models.with_raw_response.list()
models_data = json.loads(available.text)
print(models_data)

[YuenSzeHong]

Same here, any solutions? I have searched over the web, and this is only thing I found

[madonchik123]

Nope, I'm pretty sure it's problem on provider's side

[YuenSzeHong]

f*ck it, I fixed it myself for open-webui

you can get full list of models like this

I got the list from marketplace API instead

[madonchik123]

Nice one