Skip to content

fix MoE installer#112

Open
odashi wants to merge 3 commits intomainfrom
v4-moe-small-phase2
Open

fix MoE installer#112
odashi wants to merge 3 commits intomainfrom
v4-moe-small-phase2

Conversation

@odashi
Copy link
Member

@odashi odashi commented Jan 14, 2026

MoE用インストーラのFlashAttentionとTransformerEngineまわりを修正しています。

  • FA ... v2とv3を両方インストール(TE内での条件分岐対策)
  • TE ... Context parallelのバグが修正されたv2.8に変更

@odashi odashi requested a review from hkiyomaru January 14, 2026 09:11
Copy link
Member

@hkiyomaru hkiyomaru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PRの趣旨と変更の内容が整合していません.phase 2 の config を追加してもらえますか?

@odashi
Copy link
Member Author

odashi commented Feb 21, 2026

なんだこれ、なんかバグってますね

@odashi odashi changed the title add moe small phase2 config fix MoE installer Feb 22, 2026
@odashi
Copy link
Member Author

odashi commented Feb 22, 2026

@hkiyomaru 別の変更が混じっているようでした。調整したのでレビューお願いします。

@hkiyomaru
Copy link
Member

良さげです

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants