[Issue]: lacking general support for gfx1201

[andysalerno]

Problem Description

Attempt to enable aiter kernels on vllm: VLLM_ROCM_USE_AITER=1

Expected result: aiter kernels are supported on R9700 and the server proceeds to launch and use the aiter kernels.

Actual result: vllm fails to start with an error related to aiter not being available for the compute type.

Note: I'm aware the issue I'm describing is in vllm, but my main point is that the AI Pro 9700 lacks support on aiter in general, when it should be a first class citizen (it has "AI Pro" in the name, after all). In reality, projects that use aiter (vllm, amd ATOM) fail to launch on the R9700.

Operating System

Opensuse Tumbleweed

CPU

AMD Ryzen 9 9900X3D

GPU

2x AMD AI Pro 9700

ROCm Version

7.13

ROCm Component

composable_kernel

Steps to Reproduce

Attempt to enable aiter kernels on vllm: VLLM_ROCM_USE_AITER=1

Expected result: aiter kernels are supported on R9700 and the server proceeds to launch and use the aiter kernels.

Actual result: vllm fails to start with an error related to aiter not being available for the compute type.

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

No response

Additional Information

No response

[carlushuang]

@andysalerno thanks for interested in aiter as vLLM backend. We are WIP to enable gfx1201 support in aiter today, will be triton first for functional support (with decent performance), while looking for HIP kernel (opus) + flyDSL for performant kernels.

ROCm/ATOM#811 => here is some initial attemp I've addressed and PR to aiter, hope can be a reference to you