search

Lightning-AI / litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
https://lightning.ai
Apache License 2.0
10.21k stars 1.01k forks source link

1.8B H2O model #1261

Open rasbt opened 6 months ago

rasbt commented 6 months ago

A nice new 1.8B base model from H2O which would run on a single GPU. Looks like Llama 2 with Mistral tokenizer and might be an easy add: https://huggingface.co/h2oai/h2o-danube2-1.8b-base

Dev-Khant commented 5 months ago

Hi @rasbt, Can I please work on this?

rasbt commented 5 months ago

Oh sure, that would be nice!

Dev-Khant commented 5 months ago

Hi @rasbt, Could you please review this https://github.com/Lightning-AI/litgpt/pull/1282.