Mean Squared Error loss function and its gradient (derivative) for a batch of inputs [Python Code]
In this post, I show you how to implement the Mean Squared Error (MSE) Loss/Cost function as well as its derivative for Neural…
Read More
Author: Manas Sharma
Ph.D. researcher at Friedrich-Schiller University Jena, Germany. I'm a physicist specializing in computational material science. I write efficient codes for simulating light-matter interactions at atomic scales. I like to develop Physics, DFT, and Machine Learning related apps and software from time to time. Can code in most of the popular languages. I like to share my knowledge in Physics and applications using this Blog and a YouTube channel.
Efficient implementation of Tanh activation function and its Derivative (gradient) in Python
The mathematical definition of the Tanh activation function is and its derivative is defined as The Tanh function and its derivative for a…
Read More
Efficient implementation of Softplus activation function and its Derivative (gradient) in Python
The mathematical definition of the Softplus activation function is with the derivative defined as , which is actually the Sigmoid function. We have…
Read More
Efficient implementation of Softmax activation function and its Derivative (jacobian) in Python
The mathematical definition of the Softmax activation function is with the derivative defined as The Softmax function and its derivative for a batch…
Read More
Efficient implementation of Sigmoid activation function and its Derivative (gradient) in Python
The mathematical definition of the Sigmoid activation function is and its derivative is The Sigmoid function and its derivative for a batch of…
Read More
Efficient implementation of ReLU activation function and its Derivative (gradient) in Python
The mathematical definition of the ReLU activation function is and its derivative is defined as The ReLU function and its derivative for a…
Read More
chlorophyll 3D Visualization
Manas SharmaPh.D. researcher at Friedrich-Schiller University Jena, Germany. I’m a physicist specializing in computational material science. I write efficient codes for simulating light-matter…
Read More
benzaldehyde 3D Visualization
Manas SharmaPh.D. researcher at Friedrich-Schiller University Jena, Germany. I’m a physicist specializing in computational material science. I write efficient codes for simulating light-matter…
Read More
borane 3D Visualization
Manas SharmaPh.D. researcher at Friedrich-Schiller University Jena, Germany. I’m a physicist specializing in computational material science. I write efficient codes for simulating light-matter…
Read More
ammonia 3D Visualization
Manas SharmaPh.D. researcher at Friedrich-Schiller University Jena, Germany. I’m a physicist specializing in computational material science. I write efficient codes for simulating light-matter…
Read More