search

pointnetwork / point-alpaca

406 stars 29 forks source link

Retrain for 13B+ #7

Open teknium1 opened 1 year ago

teknium1 commented 1 year ago

Would it be possible for you guys to do this?

JamoDevNich commented 1 year ago

They appear to be working on 13B, as stated in the README on the repository homepage

https://github.com/pointnetwork/point-alpaca/blob/5201980895854f810e3ed99e6fbbca1401259230/README.md#L47-L49

teknium1 commented 1 year ago

They appear to be working on 13B, as stated in the README on the repository homepage

https://github.com/pointnetwork/point-alpaca/blob/5201980895854f810e3ed99e6fbbca1401259230/README.md#L47-L49

Also, maybe no need to, unless this is a scam: https://huggingface.co/Dogge/alpaca-13b/tree/main

zywang0108 commented 1 year ago

The repository is capable of performing inference on a Standford Alpaca 13B model, with an initial GPU memory usage of 25446 MiB (using a single A100 80GB).

teknium1 commented 1 year ago

They appear to be working on 13B, as stated in the README on the repository homepage https://github.com/pointnetwork/point-alpaca/blob/5201980895854f810e3ed99e6fbbca1401259230/README.md#L47-L49

Also, maybe no need to, unless this is a scam: https://huggingface.co/Dogge/alpaca-13b/tree/main

This was a scam btw