search

jimmc414 / 1filellm

Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion
MIT License
432 stars 41 forks source link

Thank you for your contribution! #6

Closed limaolin2017 closed 6 months ago

limaolin2017 commented 6 months ago

when I run this command : python test_onefilellm.py

[nltk_data] Downloading package stopwords to [nltk_data] /Users/player/nltk_data... [nltk_data] Package stopwords is already up-to-date! Traceback (most recent call last): File "/Users/player/Downloads/1filellm-main/test_onefilellm.py", line 5, in from onefilellm import process_github_repo, process_arxiv_pdf, process_local_folder, fetch_youtube_transcript, crawl_and_extract_text File "/Users/player/Downloads/1filellm-main/onefilellm.py", line 30, in raise EnvironmentError("GITHUB_TOKEN environment variable not set.") OSError: GITHUB_TOKEN environment variable not set.

jimmc414 commented 6 months ago

Hi. You need to create a github personal token and save it to your environment. The instructions are located here:

https://github.com/jimmc414/1filellm?tab=readme-ov-file#obtaining-a-github-personal-access-token

Good luck!