Skip to content

feat(deploy): add new NVIDIA accelerators and update NFD rules #97

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
hhk7734 merged 1 commit into from
Mar 25, 2026
Merged

feat(deploy): add new NVIDIA accelerators and update NFD rules #97

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 49 additions & 5 deletions deploy/helm/moai-inference-framework/templates/nfd/moai-accelerator.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -158,16 +158,16 @@ spec:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["20b5"] }

- name: accelerator-nvidia-h100
- name: accelerator-nvidia-a100-80gb-sxm
labels:
moai.moreh.io/accelerator.vendor: nvidia
moai.moreh.io/accelerator.model: h100
moai.moreh.io/accelerator.model: a100-80gb-sxm
matchAny:
- matchFeatures:
- feature: pci.device
matchExpressions:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["2339"] }
device: { op: In, value: ["20b2"] }
Comment on lines 166 to +170
Copy link

Copilot AI Mar 25, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

By removing the previous accelerator-nvidia-h100 rule (which matched PCI device ID 2339) and not adding 2339 to any other rule, nodes reporting 10de:2339 will no longer get any moai.moreh.io/accelerator.* labels. If 2339 is still a valid H100/Hopper device ID in your target environments, consider mapping it to the correct model (e.g., add it to h100-sxm or create a dedicated rule) and document the source for the ID choice.

Copilot uses AI. Check for mistakes.

- name: accelerator-nvidia-h100-pcie
labels:
Expand All @@ -180,17 +180,39 @@ spec:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["2331"] }

- name: accelerator-nvidia-h100-80gb-hbm3
- name: accelerator-nvidia-h100-sxm
labels:
moai.moreh.io/accelerator.vendor: nvidia
moai.moreh.io/accelerator.model: h100-80gb-hbm3
moai.moreh.io/accelerator.model: h100-sxm
matchAny:
- matchFeatures:
- feature: pci.device
matchExpressions:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["2330"] }

- name: accelerator-nvidia-h200-sxm
labels:
moai.moreh.io/accelerator.vendor: nvidia
moai.moreh.io/accelerator.model: h200-sxm
matchAny:
- matchFeatures:
- feature: pci.device
matchExpressions:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["2335"] }

- name: accelerator-nvidia-h20-3e
labels:
moai.moreh.io/accelerator.vendor: nvidia
moai.moreh.io/accelerator.model: h20-3e
matchAny:
- matchFeatures:
- feature: pci.device
matchExpressions:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["232c"] }

- name: accelerator-nvidia-h800
labels:
moai.moreh.io/accelerator.vendor: nvidia
Expand All @@ -213,6 +235,28 @@ spec:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["2322"] }

- name: accelerator-nvidia-b200
labels:
moai.moreh.io/accelerator.vendor: nvidia
moai.moreh.io/accelerator.model: b200
matchAny:
- matchFeatures:
- feature: pci.device
matchExpressions:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["2901"] }

- name: accelerator-nvidia-b300
labels:
moai.moreh.io/accelerator.vendor: nvidia
moai.moreh.io/accelerator.model: b300
matchAny:
- matchFeatures:
- feature: pci.device
matchExpressions:
vendor: { op: In, value: ["10de"] }
device: { op: In, value: ["3182"] }

# the PCI info is from these websites:
# source1: https://admin.pci-ids.ucw.cz/read/PC/1e52
# source2: https://devicehunt.com/view/type/pci/vendor/1e52
Expand Down
8 changes: 6 additions & 2 deletions website/docs/reference/supported-devices.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,11 +23,15 @@ Each accelerator is identified by labels prefixed with `moai.moreh.io`. Users ca
| `moai.moreh.io/accelerator.vendor: amd`<br/>`moai.moreh.io/accelerator.model: mi250` | Half of AMD Instinct MI250 GPU |
| `moai.moreh.io/accelerator.vendor: amd`<br/>`moai.moreh.io/accelerator.model: mi210` | AMD Instinct MI210 GPU |
| `moai.moreh.io/accelerator.vendor: amd`<br/>`moai.moreh.io/accelerator.model: mi100` | AMD Instinct MI100 GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h100` | NVIDIA H100 SXM GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: b300` | NVIDIA B300 GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: b200` | NVIDIA B200 GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h200-sxm` | NVIDIA H200 SXM GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h100-pcie` | NVIDIA H100 PCIe GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h100-80gb-hbm3` | NVIDIA H100 80GB HBM3 GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h100-sxm` | NVIDIA H100 SXM GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h20-3e` | NVIDIA H20-3e GPU |
Comment on lines 29 to +31
Copy link

Copilot AI Mar 25, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since h100 / h100-80gb-hbm3 labels are being replaced with h100-sxm, this page would benefit from an explicit migration note (e.g., a short sentence/admonition near the table) so existing users know which label value to update in nodeSelector/affinity and other configs.

Copilot uses AI. Check for mistakes.
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h800` | NVIDIA H800 GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: h800-pcie` | NVIDIA H800 PCIe GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: a100-80gb-sxm` | NVIDIA A100 80GB SXM GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: a100-80gb-pcie` | NVIDIA A100 80GB PCIe GPU |
| `moai.moreh.io/accelerator.vendor: nvidia`<br/>`moai.moreh.io/accelerator.model: a100-40gb-pcie` | NVIDIA A100 40GB PCIe GPU |
| `moai.moreh.io/accelerator.vendor: tenstorrent`<br/>`moai.moreh.io/accelerator.model: blackhole` | Tenstorrent Blackhole NPU |
Expand Down
Loading