jimmc414 / 1filellm

Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion
MIT License
267 stars 23 forks source link

Implement Subdirectory Output File Organization & Source-specific Names #9

Closed tribixbite closed 3 months ago

tribixbite commented 3 months ago

For doing a lot of extraction I added some custom naming for output files, with token count so you can use the files later without having to remember how big they are.... gpt-aided summary:

Reason for Changes:

jimmc414 commented 3 months ago

Thank you for contributing!

jimmc414 commented 3 months ago

I'm afraid I will need to roll back this merged pull request. It no longer copies the output to the clipboard and it adds additional prompts for the user when I would prefer it to be only one URL or path passed with the program intuitively handling it properly

tribixbite commented 3 months ago

I'll make a new one that keeps your preferences by default and lets the user set config flags to turn on/off features. I opened this before making the third commit