Open ChengjieLi28 opened 1 year ago
Note that the issue tracker is NOT the place for general support. For discussions about development, questions about usage, or any general questions, contact us on https://discuss.xorbits.io/. Xinference UT test_opt 4-bit can reproduce this error.
Note that the issue tracker is NOT the place for general support. For discussions about development, questions about usage, or any general questions, contact us on https://discuss.xorbits.io/. Xinference UT test_opt 4-bit can reproduce this error.