Documentation for understanding

turboderp / exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

MIT License

3.23k stars 238 forks source link

Documentation for understanding #258

Closed JINO-ROHIT closed 3 weeks ago

JINO-ROHIT commented 6 months ago

Is there any documentation explaining the different functions and parameters? I was having a hard time following the example code.

Thanks

turboderp commented 3 weeks ago

I hope the new examples are a bit easier to follow, and I've paid special attention to docstrings as well. Sadly I don't have time to both write all the code and document it extensively.