search

spcl / graph-of-thoughts

Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
https://arxiv.org/pdf/2308.09687.pdf
Other
1.97k stars 141 forks source link

Add Llama2HF dependencies #7

Closed aleskubicek closed 9 months ago

aleskubicek commented 9 months ago

Adding Llama2 HuggingFace dependencies to allow multi-GPU inference and quantization:

Closes #6