Open nightwhite opened 7 months ago
If the checkpoint of each task is different, the switching time will be longer each time.
Can we load the checkpoint into VRAM in advance based on the model of the next queued task, and unload the checkpoint when completing the previous task
If the checkpoint of each task is different, the switching time will be longer each time.
Can we load the checkpoint into VRAM in advance based on the model of the next queued task, and unload the checkpoint when completing the previous task