add overlapping logic in chunking and share tips on improving context - Githubissues

Azure / azure-functions-openai-extension

An extension that adds support for Azure OpenAI/ OpenAI bindings in Azure Functions for LLM (GPT-3.5-Turbo, GPT-4, etc)

MIT License

79 stars 29 forks source link

add overlapping logic in chunking and share tips on improving context #60

Closed manvkaur closed 7 months ago

manvkaur commented 7 months ago

added overlap between chunks, default value 128 characters
added logic to cater to sentence endings and word breaks
overlap will only start from a word break.
added tips to improve context and tweaking the system prompt in README

addresses https://github.com/Azure/azure-functions-pyfx-planning/issues/271