Closed nlevnaut closed 9 months ago
Was playing with running this against oobabooga's local mock-openai API. Fixed 2 things that were causing errors:
custom_llm_provider
completion
completion_cost
Was playing with running this against oobabooga's local mock-openai API. Fixed 2 things that were causing errors:
custom_llm_providerarg in the call tocompletion(for ooba, set it to "openai")completion_costif using a custom provider (it throws an error because the custom model isn't in the JSON file it uses to determine cost)