Open maxin9966 opened 2 months ago
Does it support multi-card inference? Like tp=2
I have the same question, have you solved this problem?
Does it support multi-card inference? Like tp=2