Neural Networks / Deep Learning

Currently Playing: Neural Networks Part 7: Cross Entropy Derivatives and Backpropagation

Here is a step-by-step guide that shows you how to take the derivative of the Cross Entropy function for Neural Networks and then shows you how to use that derivative for Backpropagation. NOTE: This StatQuest assumes that you are already familiar with... The main ideas behind neural networks: https://youtu.be/CqOfi41LfDw The main ideas behind backpropagation: https://youtu.be/IN2XmBhILt4 Neural networks with multiple inputs and outputs: https://youtu.be/aObJUevCVDc ArgMax and SoftMax: https://youtu.be/KpKog-L9veg Cross Entropy: https://youtu.be/6ArSys5qHAU For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 5:47 dCE_setosa with respect to b3 11:19 dCE_virginica with respect to b3 15:03 Other derivatives 16:09 Backpropagation with cross entropy #StatQuest #NeuralNetworks #CrossEntropy