Mean Squared Error loss function and its gradient (derivative) for a batch of inputs [Python Code]
In this post, I show you how to implement the Mean Squared Error (MSE) Loss/Cost function as well as its derivative for Neural…
Read More
Efficient implementation of Tanh activation function and its Derivative (gradient) in Python
The mathematical definition of the Tanh activation function is and its derivative is defined as The Tanh function and its derivative for a…
Read More
Efficient implementation of Softplus activation function and its Derivative (gradient) in Python
The mathematical definition of the Softplus activation function is with the derivative defined as , which is actually the Sigmoid function. We have…
Read More
Efficient implementation of Softmax activation function and its Derivative (jacobian) in Python
The mathematical definition of the Softmax activation function is with the derivative defined as The Softmax function and its derivative for a batch…
Read More
Efficient implementation of Sigmoid activation function and its Derivative (gradient) in Python
The mathematical definition of the Sigmoid activation function is and its derivative is The Sigmoid function and its derivative for a batch of…
Read More
Efficient implementation of ReLU activation function and its Derivative (gradient) in Python
The mathematical definition of the ReLU activation function is and its derivative is defined as The ReLU function and its derivative for a…
Read More
Fourier series Coefficients and Visualization [ Python Program ]
Today I wrote a code that calculates the Fourier Coefficients. In case you don’t know what a Fourier Series is, then, basically it…
Read More
Periodic Functions [PYTHON PROGRAM]
While working on Fourier Series or some other Mathematical Problem, you might sometime have to work with Periodic Functions. Periodic Functions are those…
Read More
Value of Pi using Monte Carlo – PYTHON PROGRAM
One can estimate the value of Pi using Monte Carlo technique. The procedure is really intuitive and based on probabilities and random number…
Read More
Bisection Method – PYTHON CODE and ANIMATION
In this post you will find a simple Python program that finds the root of a function using the Bisection Method as well…
Read More