gemm_impl.cpp:93: blas_shape: GPU_GEMM: Batch dimension is not collapsible

ROCm / AMDMIGraphX

AMD's graph optimization engine.

MIT License

184 stars 82 forks source link

Closed shivadbhavsar closed 2 months ago

shivadbhavsar commented 3 months ago

Affected Models: Huggingface: OPTForCausalLM

shivadbhavsar commented 3 months ago

Seems to only be reproducable on MI200

bpickrel commented 2 months ago

Can't replicate any more (per Shiv).