This bootcamp explores the wide world of mathematical optimization, specifically for applications in machine learning, control theory, and inverse problems. This closely follows the textbook "Optimization: A Bootcamp for Machine Learning, Inverse Problems, and Control" (https://www.amazon.com/Optimization-Bootcamp-Machine-Learning-Problems/dp/1009755862)
Curated by: Steve Brunton (44 videos)
This video discusses function convexity in the context of neural network activation functions. This video was produced at the University of Washington, and we acknowledge funding support from the Boeing Company. %%% CHAPTERS %%% 00:00 Intro 01:30 Neural Network Activation Functions 03:34 Convexity of a Single Node Activation 05:24 The Gradient