Skip to content

Commit 58b94dc

Browse files
committed
Fix formatting of Hadamard matrix in NVFP4 pretraining blog for improved clarity
1 parent 5c032dc commit 58b94dc

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

public/content/pretrain-llm-with-nvfp4/pretrain-llms-with-fp4-content.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -121,8 +121,8 @@ This will have the same result as `Activations × Weights` but it will reduce is
121121

122122
The transform is a matrix-vector multiplication. For the 4-number block in the example, the calculation uses a normalized 4x4 Hadamard matrix (`H`):
123123
```
124-
[ 0.5, 0.5, 0.5, 0.5 ]
125-
H = [ 0.5, -0.5, 0.5, -0.5 ]
124+
[ 0.5, 0.5, 0.5, 0.5 ]
125+
H = [ 0.5, -0.5, 0.5, -0.5 ]
126126
[ 0.5, 0.5, -0.5, -0.5 ]
127127
[ 0.5, -0.5, -0.5, 0.5 ]
128128
```

0 commit comments

Comments
 (0)