Open catalwaysright opened 6 months ago
I have the same problems,didyou solve it ?
Could you provide more details? It is hard to locate the problem without enough context.
Which backbone do you use? If the backbone is not LLaMA, it is better to specify the target_modules for Lora config explicitly.
I met this
../aten/src/ATen/native/cuda/Indexing.cu:1292: indexSelectLargeIndex: block: [10,0,0], thread: [31,0,0] Assertion
srcIndex < srcSelectDimSizefailed
when trying out other 13b llama models. Any clue?