search

yang3kc / llm_for_css

Guide on how to use LLMs for computational social science research
MIT License
21 stars 3 forks source link

Local LLMs #1

Open PCK1992 opened 1 month ago

PCK1992 commented 1 month ago

Hi Kaicheng,

Thank you, this is super helpful! Considering data privacy issues and the emergence of really powerful small models I think a tutorial for using local LLMs would be very useful. I've experimented with this software https://github.com/oobabooga/text-generation-webui and it's great as a start but I think some tutorial that incorporates batch processing etc. would be super useful for many people!

yang3kc commented 1 month ago

Thank you for sharing this resource. I will definitely look into it and try to incorporate it into my tutorial once I have some firsthand experience.

Additionally, thank you for your contribution to the community!