Mathematics for Machine Learning

Interesting mathematics posts, articles and videos. This post is currently in progress and links are not any particular order. More links will be added in next weeks.

Expectation and Variance
https://revisionmaths.com/advanced-level-maths-revision/statistics/expectation-and-variance

Bayes’ Theorem: Conditional Probabilities
http://vassarstats.net/bayes.html

Maximum Likelihood Estimation For Regression
https://medium.com/quick-code/maximum-likelihood-estimation-for-regression-65f9c99f815d

Why we consider log likelihood instead of Likelihood in Gaussian Distribution
https://math.stackexchange.com/questions/892832/why-we-consider-log-likelihood-instead-of-likelihood-in-gaussian-distribution

Norm ✓
https://en.wikipedia.org/wiki/Norm_(mathematics)

Norm (mathematics)
http://www.wikiwand.com/en/Norm_(mathematics)

Derivation on differentiating the Euclidean norm ✓
https://math.stackexchange.com/questions/84331/does-this-derivation-on-differentiating-the-euclidean-norm-make-sense

The gradient
https://www.khanacademy.org/math/multivariable-calculus/multivariable-derivatives/partial-derivative-and-gradient-articles/a/the-gradient

Directional Derivatives and the Gradient
https://openstax.org/books/calculus-volume-3/pages/4-6-directional-derivatives-and-the-gradient

Difference between Batch Gradient Descent and Stochastic Gradient Descent
https://towardsdatascience.com/difference-between-batch-gradient-descent-and-stochastic-gradient-descent-1187f1291aa1

Finding the Gradient of a Vector Function
https://towardsdatascience.com/step-by-step-the-math-behind-neural-networks-d002440227fb

What Are L1 and L2 Loss Functions
https://afteracademy.com/blog/what-are-l1-and-l2-loss-functions

A Review of Multivariate Calculus
https://www.cis.upenn.edu/~jean/au02.pdf

How do you differentiate y=ln(1+x^2)
https://socratic.org/questions/how-do-you-differentiate-y-ln-1-x-2

How do you differentiate (x^2)(sinx)
https://socratic.org/questions/how-do-you-differentiate-x-2-sin-x

Proof of Various Derivative Properties
http://tutorial.math.lamar.edu/Classes/CalcI/DerivativeProofs.aspx

Derivatives of Hyperbolic Functions
https://www.math24.net/derivatives-hyperbolic-functions/

Calculus of Vector-Valued Functions
https://opentextbc.ca/calculusv3openstax/chapter/calculus-of-vector-valued-functions/

The Chain Rule
https://openstax.org/books/calculus-volume-3/pages/4-5-the-chain-rule

How to prove the chain rule
https://math.stackexchange.com/questions/1180686/how-to-prove-the-chain-rule

Chain rule and tree diagrams of multivariable functions
https://www.youtube.com/watch?v=kCr13iTRN7E