Closed athatheo closed 9 months ago
Sometimes, if anything from the stop_seq list is None, the vllm_infer will crash
Sometimes, if anything from the stop_seq list is None, the vllm_infer will crash