Softmax + Categorical Crossentropy
I fixed the activation+loss function, you can't select it directly, it automaticly uses it if it can. I also fixed one-hot generator. Still haven't tested the activation + loss nor any other backward function. I'll do that when I get to the optimizers which is next.
This commit is contained in:
@@ -86,7 +86,7 @@ layer_dense::layer_dense() {
|
||||
layer_dense::layer_dense(panic::types::uint_t input_size, panic::types::uint_t neurons) {
|
||||
weights.resize(input_size, neurons);
|
||||
panic::random::uniform(weights);
|
||||
panic::math::mul(weights, 0.01f, weights);
|
||||
panic::math::mul(weights, static_cast<panic::types::real_t>(0.01), weights);
|
||||
|
||||
biases.resize(neurons);
|
||||
biases.fill(0);
|
||||
|
||||
Reference in New Issue
Block a user