search

CERC-AAI / Robin

Apache License 2.0
62 stars 8 forks source link

Create a end-user model class #25

Closed Alexis-BX closed 9 months ago

Alexis-BX commented 10 months ago

Create a python class that is the only thing the end user should interact with

the creation of an instance of this class should be: model = Robin('agi-collective/[model_name]')

Base LLM, VE type... can be found in the model config.json

There should be optional arguments like temperature, conversation type...

There should be a .predict('[text]', '[image_path/URL]') function

Any other standard or useful arguments are welcome!

The forward pass of training and LlavaMistralPipeline can be good inspiration.

The aim is to simplify the overly complex serve folder, remove all the redundant code in cli, pipeline..., do the same in eval, and have a simple Robin.predict([text], [image]) call

Alexis-BX commented 9 months ago

done in eval branch (see PR)