This class is used to initialize the weight matrix with the method proposed by T.
More...
|
template<typename eT > |
| KathirvalavakumarSubavathiInitialization (const arma::Mat< eT > &data, const double s) |
| Initialize the random initialization rule with the given values. More...
|
|
template<typename eT > |
void | Initialize (arma::Mat< eT > &W, const size_t rows, const size_t cols) |
| Initialize the elements of the specified weight matrix with the Kathirvalavakumar-Subavathi method. More...
|
|
template<typename eT > |
void | Initialize (arma::Mat< eT > &W) |
| Initialize the elements of the specified weight matrix with the Kathirvalavakumar-Subavathi method. More...
|
|
template<typename eT > |
void | Initialize (arma::Cube< eT > &W, const size_t rows, const size_t cols, const size_t slices) |
| Initialize the elements of the specified weight 3rd order tensor with the Kathirvalavakumar-Subavathi method. More...
|
|
template<typename eT > |
void | Initialize (arma::Cube< eT > &W) |
| Initialize the elements of the specified weight 3rd order tensor with the Kathirvalavakumar-Subavathi method. More...
|
|
This class is used to initialize the weight matrix with the method proposed by T.
Kathirvalavakumar and S. Subavathi. The method is based on sensitivity analysis using using cauchy’s inequality. The method is defined by
\begin{eqnarray*} \overline{s} &=& f^{-1}(\overline{t}) \\ \Theta^{1}_{p} &\le& \overline{s} \sqrt{\frac{3}{I \sum_{i = 1}^{I} (x_{ip}^2)}} \\ \Theta^1 &=& min(\Theta_{p}^{1}); p=1,2,..,P \\ -\Theta^{1} \le w_{i}^{1} &\le& \Theta^{1} \end{eqnarray*}
where I is the number of inputs including the bias, p refers the pattern considered in training, f is the transfer function and \={s} is the active region in which the derivative of the activation function is greater than 4% of the maximum derivatives.