Add args to enable/disable backtracking and fast-forwarding in LLInterpreter

microsoft / llguidance

Low-level Guidance Parser

MIT License

26 stars 7 forks source link

Closed JC1DA closed 3 weeks ago

JC1DA commented 3 weeks ago

Note: This is helpful to integrate llguidance into inference frameworks that do not support backtracking atm.

mmoskal commented 3 weeks ago

Looks good, but please remove the conditional_ff_tokens - they are not used and will just confuse people!

lochuynh1412 commented 3 weeks ago

@mmoskal should I leave the default value to true or set it to value of enable_ff_tokens?

JC1DA commented 3 weeks ago

@microsoft-github-policy-service agree

@microsoft-github-policy-service agree