Skip to content

Batchnorm as a single parameter #32

@JordyDH

Description

@JordyDH

Hi,
https://www.reddit.com/r/MachineLearning/comments/450a4p/160202830_binarynet_training_deep_neural_networks/czut3dp/
In this reddit post you suggest you can calculate the bn parameter as a threshold.
T = mean + β (std + e) / γ
My question:

  1. Theano trains inv_std so do i need to do 1.0/inv_std to become std
  2. the "e" value is it the eulers value of : 2.71828

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions