search

AnswerDotAI / llms-txt

The /llms.txt file, helping language models use your website
http://llmstxt.org/
Apache License 2.0
212 stars 17 forks source link

Exclude images from context? #7

Closed hamelsmu closed 2 months ago

hamelsmu commented 2 months ago

I found that when we have images in our docs the base64 text is often being included in the context (ex: when I was working on https://github.com/fastai/fastcore/pull/621). I think this might be taking up too many tokens, and maybe good to exclude them?

hamelsmu commented 2 months ago

This might help the output of https://github.com/fastai/fastcore/pull/621 be better

jph00 commented 2 months ago

lgtm