the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
513 stars 29 forks source link

Evaluate google/gemma-2b/7b-it #163

Closed the-crypt-keeper closed 6 months ago

the-crypt-keeper commented 6 months ago

New open source instruction tune from Google.

GGUF support just merged https://github.com/ggerganov/llama.cpp/pull/5631

the-crypt-keeper commented 6 months ago

vLLM 0.3.2 adds Gemma and OLMo (what is this?) models: https://github.com/vllm-project/vllm/releases/tag/v0.3.2

the-crypt-keeper commented 6 months ago

Completed with much disappointment.