search

mrseanryan / gpt-summarizer

Summarize text using ChatGPT or a local LLM, with support for multiple large text files, PDF files and translation.
https://medium.com/p/15f843b1ea15
MIT License
5 stars 0 forks source link

try via transformers #5

Closed mrseanryan closed 1 month ago

mrseanryan commented 11 months ago

Use a pipeline as a high-level helper

from transformers import pipeline

pipe = pipeline("text-generation", model="TheBloke/Llama-2-13B-chat-GGML")

——-

Load model directly

from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/Llama-2-13B-chat-GGML")

ref https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML

—-

https://github.com/huggingface/transformers

mrseanryan commented 1 month ago

Probably obsolete with #8