search

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
465 stars 150 forks source link

add https endpoints, #359 #383

Closed Jobhdez closed 7 months ago

Jobhdez commented 8 months ago

This pr is the starting point for the issue #359.

@VictorOdede can you please give me an idea if this is the right direction?

thanks.

Anuraag-CH commented 7 months ago

How about using Fastapi.

VictorOdede commented 7 months ago

@Anuraag-CH Why Fast api? What are the advantages over Flask?

Anuraag-CH commented 7 months ago

It offers asynchronous support and type checking and moreover provides automatic documentation via Swagger.

VictorOdede commented 7 months ago

@Anuraag-CH That makes sense. Although we don't really need an autodoc since we already have a stable documentation engine. Thinking we could implement fast api using Ray Serve: https://docs.ray.io/en/latest/serve/index.html