Regulaization
Sync public mirror / sync (push) Failing after 27s

Started on regulaization in  Loss.h. I need to refactor the matsum.h since I need a total sum over the matrix. Also matmul needs a elementwise matmul function, which is the next this in the ragulaization
This commit is contained in:
2026-01-03 22:10:50 +01:00
parent 32ba0518fa
commit 48f329feef
17 changed files with 881 additions and 510 deletions
@@ -209,6 +209,7 @@ examples/dense-neural-network/CMakeFiles/dense-neural-network.dir/main.cpp.o: \
/home/atlas/Documents/Git/Flux/include/./numerics/matmul.h \
/home/atlas/Documents/Git/Flux/include/./numerics/matscalar.h \
/home/atlas/Documents/Git/Flux/include/./numerics/matmax.h \
/home/atlas/Documents/Git/Flux/include/./numerics/matabs.h \
/home/atlas/Documents/Git/Flux/include/./numerics/matdiv.h \
/home/atlas/Documents/Git/Flux/include/./numerics/matvec.h \
/home/atlas/Documents/Git/Flux/include/./numerics/matadd.h \
@@ -238,7 +239,10 @@ examples/dense-neural-network/CMakeFiles/dense-neural-network.dir/main.cpp.o: \
/home/atlas/Documents/Git/Flux/include/modules/neural_networks/activation_functions/Activation_Softmax_Loss_CategoricalCrossentropy.h \
/home/atlas/Documents/Git/Flux/include/./modules/neural_networks/loss/Loss_CategoricalCrossentrophy.h \
/home/atlas/Documents/Git/Flux/include/./modules/neural_networks/loss/./Loss.h \
/home/atlas/Documents/Git/Flux/include/./numerics/vecmean.h \
/home/atlas/Documents/Git/Flux/include/numerics/vecmean.h \
/home/atlas/Documents/Git/Flux/include/numerics/matmean.h \
/home/atlas/Documents/Git/Flux/include/modules/neural_networks/optimizers/Optimizer_SGD.h \
/home/atlas/Documents/Git/Flux/include/modules/neural_networks/optimizers/Optimizer_Adagrad.h \
/usr/include/c++/13/math.h
/usr/include/c++/13/math.h \
/home/atlas/Documents/Git/Flux/include/modules/neural_networks/optimizers/Optimizer_RMSprop.h \
/home/atlas/Documents/Git/Flux/include/modules/neural_networks/optimizers/Optimizer_Adam.h