We want to be able to tag files that are big (within reason) We should chunk the file to send to the LLM as context
Chunking: Split the code into smaller chunks that are individually within the token limit. Each chunk can be processed separately. This is useful if you need to get insights or analysis on different parts of the code.
Context
We want to be able to tag files that are big (within reason) We should chunk the file to send to the LLM as context
Chunking: Split the code into smaller chunks that are individually within the token limit. Each chunk can be processed separately. This is useful if you need to get insights or analysis on different parts of the code.