cproctor / unfold_studio

text and code
6 stars 0 forks source link

Create backend interface to LLM API #128

Closed cproctor closed 1 week ago

cproctor commented 2 months ago

Whichever features we choose to implement, we will need a backend means of calling out to a LLM. Instead of hard-coding OpenAI's APIs into the project, I would like a vendor-neutral API, which for now will wrap around OpenAI, but which could be extended to other LLM APIs in the future.

Once this layer is in place, we'll write a route which the frontend can use to query the LLM. The front-end runtime will need to make dynamic calls to LLM for content during story playthrough.

cproctor commented 1 month ago

I have created an initial implementation, creating an app called text_generation instead of llm. (My thinking for the name is that we should focus on what it does rather than the technology on which it's implemented. However, this initial version is not adequate; I'll keep this issue open until it's improved.