Positional Encoding

[JeremyCJM]

Why the positional encoding is random?

[johndpope]

maybe ask @khanrc
1ac51c0#diff-6d46aff567baa42dfd4c6b8d2f5c956d3ea84b2811ca663ea67159e323344ccb

[khanrc]

It is learnable positional embedding, which is initialized randomly and learned during training. Please refer to the paper.