Investigate code specific llm

[kenvontucky]

Investigate which code specific llms are available and how it could be integrated with the project.

[kenvontucky]

Open API o1

There are two model types available today:

• o1-preview: reasoning model designed to solve hard problems across domains.
• o1-mini: faster and cheaper reasoning model particularly good at coding, math, and science.
• https://platform.openai.com/docs/models/o1

StarCoder

• Blog post https://huggingface.co/blog/starcoder
• https://huggingface.co/bigcode/starcoderbase
  • Integration with LiteLLM https://docs.litellm.ai/docs/providers/huggingface

LLama2

https://llama.meta.com/code-llama/

Integration with LiteLLM https://docs.litellm.ai/docs/tutorials/huggingface_tutorial

• https://huggingface.co/meta-llama
  • https://huggingface.co/meta-llama/CodeLlama-70b-hf