math for AI and machine learning

Calculus, Machine Learning, Math

Understanding the Softmax Function Derivative

This article discusses the derivative of the softmax function, providing an introductory example suitable for readers with a basic understanding of single-variable calculus. It outlines the mathematical principles necessary for computing this derivative and presents a concise expression for the softmax function’s Jacobian matrix, showcasing its application in probability distributions.

Linear Algebra

Linear Transformation vs. Change of Basis (Deep Dive)

1 Introduction Linear transformations and Change of Basis are deceptively simple concepts that tempt us to rush over them quickly. But this shortcut is the perfect way to frustration. The gaps in our understanding will backfire and cost us valuable time later. There is no free lunch; we have to take the time to build

Scroll to Top
Cookie Consent with Real Cookie Banner