Create a simple API for utilizing sigllm pipelines. In simple cases, the API should be similar to Orion API, however, there are some considerations to be made:
SigLLM currently only supports LLMs in zero-shot. In other words, there is no training process for the LLM.
Some LLMs require us to expose keys to run. While it is recommended to export them to the environment variables, maybe we can provide the option for users to pass it?
Create a simple API for utilizing sigllm pipelines. In simple cases, the API should be similar to Orion API, however, there are some considerations to be made:
Example Usage