Closed wheresmyhair closed 1 week ago
detokenize
decode_inference_result
MemorySafeVLLMInference test
Example sh test Note that the fetal python error comes from the killing signal. This will not affect the inference, as the results are already saved:
Changes made, tests passed.
Example sh test
Description
detokenize
todecode_inference_result
to make it clearerTests
MemorySafeVLLMInference test![image](https://github.com/OptimalScale/LMFlow/assets/79436959/d6eb3f70-18ea-4ae5-8641-898ed3e26483)
Example sh test
Note that the fetal python error comes from the killing signal. This will not affect the inference, as the results are already saved:
![image](https://github.com/OptimalScale/LMFlow/assets/79436959/b8fd34a2-2f8e-4ef8-b0ee-0545f5a7b073)