[Feature] Add option to connect to ollama

[eduardconstantin]

Description A free alternative to generate the stories would be useful. Right now the cli uses only the OpenAI SDK.

Describe the solution you'd like The cli tool should ask the user which method to use, OpenAI or Ollama. If Ollama is selected the connection details should be added by the user, if OpenAI is selected only the Api key should be added. Another option would be to just add the connection details in the .env file and automatically select the ollama option.

[sahoobiks]

I have looked into the issue about integrating Ollama as a free alternative to the OpenAI , and I would like to work on it. My Approach:

1. I will implement a simple dropdown in the UI for users to choose between OpenAI and Ollama.
2. The API request will be modified to send the selected model to the backend.
3. I will adjust the endpoint to handle both models without affecting existing functionality. A new function for Ollama will be created to manage its API calls. This approach ensures we maintain the current app logic while providing users with more options. Could you please assign this issue to me?

[eduardconstantin]

Sounds great!

[Bisha18]

Interested could, I work upon it.

[eduardconstantin]

Interested could, I work upon it.

let's give @sahoobiks a chance first

[eduardconstantin]

@sahoobiks are you still working on this feature? I saw you closed the pr

[eduardconstantin]

@Bisha18 I think you can take it

[aaryak1369]

@eduardconstantin hi, i'd like to work on this. Basically,

• i would update the client.js file to conditionally create a client for either OpenAI or Ollama based on environment variables or user choice.
• modify conerter.js to function handle both clients.
• in selector.js add a selection option to choose either OpenAI or Ollama as the preferred service
• pass the service option from index.js

i'll get started if you give the green signal

[eduardconstantin]

Sounds great! I assigned you.

[aaryak1369]

@eduardconstantin do you have your own ollama public key?

[eduardconstantin]

@eduardconstantin do you have your own ollama public key?

you don't need an api key, you have to install ollama locally to use it

[eduardconstantin]

@aaryak1369 are you still working on this issue?