search

ROCm / DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
https://www.deepspeed.ai/
Apache License 2.0
4 stars 3 forks source link

Are operators at deepspeed/inference/v2/kernels/ragged_ops supported on AMD devices ? #70

Open CrimsonDump opened 3 months ago

CrimsonDump commented 3 months ago

I've been trying to test some ops at deepspeed/inference/v2/kernels/ragged_ops, like RaggedLogitsGather, BlockedRotaryEmbeddings, and failed to pass unittest at tests/unit/inference/v2/kernels/ragged_ops on branch "inference".

So I'm wondering

  1. Are these ops supported now?
  2. Which branch should I test on?