IBM / unitxt

🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
https://www.unitxt.ai
Apache License 2.0
161 stars 45 forks source link

Add multi api inference engine #1343

Closed elronbandel closed 1 week ago

elronbandel commented 2 weeks ago

With multi api inference engine you can feed into your application:

     MyClass(
           model=CrossProviderInferenceEngine("llama-3.1-405b", api="aws")
      )

Then change it by editing the model.api argument or by general settings: You can set unitxt.settings.default_provider="watsonx" or export UNITXT_DEFAULT_PROVIDER="watsonx"