⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.
To get to a fully functional Image Generation endpoint, the following is required:
Design the API
[ ] Design a new Image Generation endpoint interface, since OpenAI does not have one we can mimic. This should be the first step, as everything else depends on this.
[ ] Define an Image Generation endpoint that follows the API directly and translates the API calls to backend calls. This may be implemented according to the already existing traits LLM and Whisper traits in edgen_core.
[ ] Implement the model endpoint according to the LLM and Whisper endpoints in edgen_server.
[ ] Implement the loading and downloading logic for the new model kind in edgen_server/src/model.rs.
[ ] Implement the new endpoint using the backend. edgen_server/src/openai_shims.rs may provide some inspiration.
[ ] Implement new server routes for the API and connect it to the endpoint (in edgen_server/src/routes.rs).
To get to a fully functional Image Generation endpoint, the following is required:
edgen_core
.edgen_server
.edgen_server/src/model.rs
.edgen_server/src/openai_shims.rs
may provide some inspiration.edgen_server/src/routes.rs
).