microsoft / aici

AICI: Prompts as (Wasm) Programs
MIT License
1.87k stars 76 forks source link

Exception when no token generated #88

Open matthai opened 3 months ago

matthai commented 3 months ago

If I don't run FixedTokens() or text_gen() in the program, the program run crashes after finishing execution.

import pyaici.server as aici

async def main():
    print(f' starting main.........')

result = aici.start(main())

Does the print and crashes with: image

emrekiciman commented 3 months ago

Thanks for reporting this @matthai Running a controller without interacting with the LLM isn't a scenario that had occurred to me!