Optimizers - Part 1
Sync public mirror / sync (push) Failing after 24s

Done with SGD and Adagrad, still need to optimize them but they work.
This commit is contained in:
2026-01-01 19:23:48 +01:00
parent bd2edea8ef
commit e5f8c91be4
12 changed files with 299 additions and 133 deletions
@@ -21,6 +21,11 @@ namespace neural_networks{
utils::Vector<T> dbiases;
utils::Matrix<T> dinputs;
// Variables for optimizers
utils::Matrix<T> weight_momentums;
utils::Vector<T> bias_momentums;
utils::Matrix<T> weight_cache;
utils::Vector<T> bias_cache;
// Default Constructor
Dense_Layer() = default;