Closed shinglyu closed 1 year ago
Running a real LLM locally or use a paid API is costly. For quick testing and debugging, this mock driver simulates a real LLM but is much faster and cheaper to run.
This implements a LLM executor that only echos your prompt and options back.
Running a real LLM locally or use a paid API is costly. For quick testing and debugging, this mock driver simulates a real LLM but is much faster and cheaper to run.
This implements a LLM executor that only echos your prompt and options back.