feat: add running vllm on akash blog

[rakataprime]

@anilmurty @zachhorn Can you review this PR in the draft model and give some feedback on how it looks. I think its almost ready to go. I was also wondering if we could add the combined vLLM and OpenWeb UI example as a one click deployment for the akash console. Please review the tags, categories, featured and showcase fields to ensure this is correct. I may need to update the paths for the images in the blog post. I am not sure if I have that correct for the astro markdown conversion process. We will still need to update the draft field to false to publish.

[zachhorn]

Hey @rakataprime - Post looks great! Let's work with @aktdenis to get a header graphic.

[aktdenis]

hey @rakataprime, i was thinking to design a cover graphic in this direction: https://akash.network/blog/foundation-ai-model-training-on-akash/

could you please provide some technical details? thanks!

[rakataprime]

@aktdenis so we are using vLLM to serve open source llms to replace the usage of Closed AI models such as gpt-4 and ChatGPT. We can pair vLLM with and open source llm chat UI ( OpenWeb UI) for general team use or use it as an api for Agent frameworks such as Crew and Langchain for developers. I think we can do something like Goodbye ChatGPT Hello vLLM on Akash or do maybe a diagram of how to use the ChatUI with vLLM on Akash

[anilmurty]

@rakataprime @aktdenis - re header graphic, my suggestion would be to keep it simple (since @aktdenis is pretty strapped for time and also, so that we can get this out quicker). Maybe we can just do something like we did for the Ray deployment but with the Ray logo replaced with the vLLM logo and then either leave it at that (with "vLLM for AI inference on Akash" text on the right side.

(replace the Ray Logo with this one from https://github.com/vllm-project/vllm:

I thought that maybe we could put this open web UI image to the right (in place of the software stack we had in the Ray deployment post) as an "output" of deploying vLLM on akash - but, I don't think this look great visually for the banner image

[rakataprime]

@anilmurty let me film a tutorial tonight and add that

[aktdenis]

thanks @anilmurty , what do you think of these two options;

[zachhorn]

I like the first one with the deployment screenshot personally

[anilmurty]

thanks @anilmurty , what do you think of these two options;

Love both but I agree with Zach that on going with the first one (with deploy). Thanks Denis.

[rakataprime]

@zachhorn @anilmurty I think this should be good to go. I believe I have fixed all the changes unless you also wanted a different description. Let me know what you think. I like the first banner image the most.

[rakataprime]

@zachhorn @anilmurty Those changes are now complete and this should be good to go.