package-lock.json, .lockb and other things to skip

Doriandarko / RepoToTextForLLMs

Automate the analysis of GitHub repositories for LLMs with RepoToTextForLLMs. Fetch READMEs, structure, and non-binary files efficiently. Outputs include analysis prompts to aid in comprehensive repo evaluation

685 stars 89 forks source link

package-lock.json, .lockb and other things to skip #3

Closed muddylemon closed 8 months ago

muddylemon commented 8 months ago

by adding '.lockb', 'package-lock.json', '.svg' to the skip list I turned the output of a javascript heavy monolith from 4700kb to 306kb without losing any useful information. The large file was too much for gpt to swallow.

Doriandarko commented 8 months ago

Great! I am gonna add that