mlpack::ann::HeInitialization Class Reference

This class is used to initialize weight matrix with the He initialization rule given by He et. More...

#include <he_init.hpp>

Public Member Functions
	HeInitialization ()
	Initialize the HeInitialization object.
template<typename eT >
void	Initialize (arma::Mat< eT > &W, const size_t rows, const size_t cols)
	Initialize the elements of the weight matrix with the He initialization rule. More...
template<typename eT >
void	Initialize (arma::Mat< eT > &W)
	Initialize the elements of the weight matrix with the He initialization rule. More...
template<typename eT >
void	Initialize (arma::Cube< eT > &W, const size_t rows, const size_t cols, const size_t slices)
	Initialize the elements of the specified weight 3rd order tensor with He initialization rule. More...
template<typename eT >
void	Initialize (arma::Cube< eT > &W)
	Initialize the elements of the specified weight 3rd order tensor with He initialization rule. More...

Detailed Description

This class is used to initialize weight matrix with the He initialization rule given by He et.

al. for neural networks. The He initialization initializes weights of the neural network to better suit the rectified activation units.

For more information, the following paper can be referred to:

@article{Delving2015,
  title   = {Delving Deep into Rectifiers: Surpassing Human-Level Performance
             on ImageNet Classification},
  author  = {Kaiming He and Xiangyu Zhang and Shaoqing Ren and Jian Sun},
  journal = {2015 IEEE International Conference on Computer Vision (ICCV)},
  year    = {2015},
  pages   = {1026-1034}
}

Member Function Documentation

Initialize() [1/4]

template<typename eT >

void mlpack::ann::HeInitialization::Initialize ( arma::Mat< eT > &  W, const size_t  rows, const size_t  cols  )

inline

Initialize the elements of the weight matrix with the He initialization rule.

Parameters

W	Weight matrix to initialize.
rows	Number of rows.
cols	Number of columns.

Initialize() [2/4]

template<typename eT >

void mlpack::ann::HeInitialization::Initialize ( arma::Mat< eT > &  W )

inline

Initialize the elements of the weight matrix with the He initialization rule.

Parameters

W	Weight matrix to initialize.

Initialize() [3/4]

template<typename eT >

void mlpack::ann::HeInitialization::Initialize ( arma::Cube< eT > &  W, const size_t  rows, const size_t  cols, const size_t  slices  )

inline

Initialize the elements of the specified weight 3rd order tensor with He initialization rule.

Parameters

W	Weight matrix to initialize.
rows	Number of rows.
cols	Number of columns.
slices	Number of slices.

Initialize() [4/4]

template<typename eT >

void mlpack::ann::HeInitialization::Initialize ( arma::Cube< eT > &  W )

inline

Initialize the elements of the specified weight 3rd order tensor with He initialization rule.

Parameters

W	Weight matrix to initialize.

---

The documentation for this class was generated from the following file:

• src/mlpack/methods/ann/init_rules/he_init.hpp