search

SylphAI-Inc / AdalFlow

AdalFlow: The library to build & auto-optimize LLM applications.
http://adalflow.sylph.ai/
MIT License
2.17k stars 195 forks source link

diagnose produces corrupted jsonl #232

Open mrdrprofuroboros opened 1 month ago

mrdrprofuroboros commented 1 month ago

Describe the bug trainer.diagnose has been run with 4 workers, the output generator_call.jsonl file contained: 3T14:07:39.053704"}{"prompt_kwargs": {"s on one of the lines

To Reproduce rather sporadic, but I assume some multithreading race condition

Expected behavior one json per line

liyin2015 commented 4 weeks ago

@mrdrprofuroboros Try to delete all files under this path, and rerun the diagnose. Often it is just invalid json format