fix advance_parser() - Githubissues

microsoft / llguidance

Low-level Guidance Parser

MIT License

19 stars 3 forks source link

fix advance_parser() #8

Open mmoskal opened 2 months ago

mmoskal commented 2 months ago

https://github.com/microsoft/llguidance/commit/80edb0e665e3c24061914f6d87bc2cedca4c94d8 adds advance_parser() method which runs the parser forward (to computed fast-forward tokens) after sampling a token. Eventually, this should be used instead of post_process()

[ ] investigate test breakage when using advance_parser() (test_ll.py needs work, but other tests also fail)
[ ] have advance_parser() return progress data like mid_process() (since it internally calls mid_process())

mmoskal commented 2 weeks ago

this has been fixed for a while - we need to get rid of post_process or advance_parser from python api as they do the same now