Closed thmsmlr closed 4 months ago
AnyScale is a third-party open AI compliant LLM provider.
https://www.anyscale.com https://www.together.ai
Some of them provide extensions to support jason schemas natively in the same way we do with Lama.CPP. Although, in order to properly integrate, we need to support more modes. See #11 for context.
solved by https://github.com/thmsmlr/instructor_ex/commit/097fee43b0214d2b9c269adc5628657b6f7a9a56
thmsmlr
commented
4 months ago
AnyScale is a third-party open AI compliant LLM provider.
https://www.anyscale.com https://www.together.ai
Some of them provide extensions to support jason schemas natively in the same way we do with Lama.CPP. Although, in order to properly integrate, we need to support more modes. See #11 for context.