Open mymynew opened 10 months ago
API部署,一次生成有时候耗时很长。这种情况下,想终断模型生成,该调用啥接口能实现终止执行?
No response
...
- OS:ubuntu - Python:3.10 - Transformers: - PyTorch:2.0.1 - CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :true
Is there an existing issue for this?
Current Behavior
API部署,一次生成有时候耗时很长。这种情况下,想终断模型生成,该调用啥接口能实现终止执行?
Expected Behavior
No response
Steps To Reproduce
...
Environment
Anything else?
No response