This class is used to initialize weight matrix with the Lecun Normalization initialization rule.
More...
|
| LecunNormalInitialization () |
| Initialize the LecunNormalInitialization object.
|
|
template<typename eT > |
void | Initialize (arma::Mat< eT > &W, const size_t rows, const size_t cols) |
| Initialize the elements of the weight matrix with the Lecun Normal initialization rule. More...
|
|
template<typename eT > |
void | Initialize (arma::Mat< eT > &W) |
| Initialize the elements of the weight matrix with the Lecun Normal initialization rule. More...
|
|
template<typename eT > |
void | Initialize (arma::Cube< eT > &W, const size_t rows, const size_t cols, const size_t slices) |
| Initialize the elements of the specified weight 3rd order tensor with Lecun Normal initialization rule. More...
|
|
template<typename eT > |
void | Initialize (arma::Cube< eT > &W) |
| Initialize the elements of the specified weight 3rd order tensor with Lecun Normal initialization rule. More...
|
|
This class is used to initialize weight matrix with the Lecun Normalization initialization rule.
For more information, the following papers can be referred to:
@inproceedings{Klambauer2017,
itle = {Self-Normalizing Neural Networks.},
author = {Klambauer, Günter and Unterthiner, Thomas
and Mayr, Andreas and Hochreiter, Sepp},
pages = {972-981},
year = {2017}
}
@inproceedings{LeCun1998,
title = {Efficient BackProp},
author = {LeCun, Yann and Bottou, L{\'e}on and Orr, Genevieve B.
and M\"{u}ller, Klaus-Robert},
year = {1998},
pages = {9--50}
}