spcl / graph-of-thoughts

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
https://arxiv.org/pdf/2308.09687.pdf
Other
2.19k stars 159 forks source link

Add Llama2HF dependencies #7

Closed aleskubicek closed 1 year ago

aleskubicek commented 1 year ago

Adding Llama2 HuggingFace dependencies to allow multi-GPU inference and quantization:

Closes #6