search

InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.
MIT License
9 stars 3 forks source link

recognize model #30

Open Jerry-Kon opened 11 months ago

Jerry-Kon commented 11 months ago

User can custom the name of model path. Only using path name can not recognize which model to choose. We can recognize model , by string "_name_or_path" in config.json which is included in model files.

Jerry-Kon commented 11 months ago

image

kerthcet commented 11 months ago

Yes, we should support config.json in the future, it's recommended by the hf community.

kerthcet commented 11 months ago

/kind feature