yxuansu / OpenAlpaca

OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA
Apache License 2.0
301 stars 35 forks source link

The final versions of OpenLLaMa 3B and 7B have been released #5

Open codesoap opened 1 year ago

codesoap commented 1 year ago

JFYI: Pretraining for the 3B and 7B models is complete:

PS: Training for a 13B model has also begun: https://huggingface.co/openlm-research/open_llama_13b_600bt

codesoap commented 1 year ago

The 13B model is now fully trained as well:

limcheekin commented 1 year ago

Hi there,

A viable alternative to this project:

Good day! :)

codesoap commented 1 year ago

@limcheekin I was not aware of those models. Thanks! I'm checking them out right now.

Though I must say, that I really liked the ### Input: option of OpenAlpaca. The open-instruct models don't seem to be trained for this.

MarkusPfundstein commented 1 year ago

hey guys! Great work! How much VRAM do we need for inference?