Skip to content

Are operators at deepspeed/inference/v2/kernels/ragged_ops supported on AMD devices ? #70

@CrimsonDump

Description

@CrimsonDump

I've been trying to test some ops at deepspeed/inference/v2/kernels/ragged_ops, like RaggedLogitsGather, BlockedRotaryEmbeddings, and failed to pass unittest at tests/unit/inference/v2/kernels/ragged_ops on branch "inference".

So I'm wondering

  1. Are these ops supported now?
  2. Which branch should I test on?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions