search

danielmiessler / fabric

fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
https://danielmiessler.com/p/fabric-origin-story
MIT License
22.42k stars 2.34k forks source link

[Question]: Does Fabric chunk data automatically? #739

Closed EatMoreChicken closed 3 weeks ago

EatMoreChicken commented 1 month ago

Does Fabric chunk data automatically?

After reading the documentation, I am still not clear if Fabric automatically chunks data when sending it to LLMs. For example, if the YouTube video's transcript is too long to fit into the context window, does Fabric automatically chunk the data into multiple requests?

Thank you!

bradinator commented 1 month ago

I have received error messages stating I was over the context length. If there is a way to chunk or otherwise handle longer videos, I'd like to know best practices.

EatMoreChicken commented 1 month ago

Hmm, so it sounds like it doesn't chunk the input currently. I know there are several chucking methods out there, but I don't have enough experience at the moment to know the best practice. I'm sure someone else would have some better insight into what needs to be implemented.