Fix bug in computing schema context size

advanced-stack / py-llm-core

A pythonic library providing light-weighted interface with LLMs

MIT License

103 stars 8 forks source link

Fix bug in computing schema context size #11

Closed DaveDeCaprio closed 3 months ago

DaveDeCaprio commented 3 months ago

The current code is always computing schema_prompt as "". This can cause problems estimating context length, especially is there is a longer context length.

This fixes it so the correct schema is used.

paschembri commented 3 months ago

Good catch !