Understanding the Geometry of Orthogonal and Diagonal Matrices
Why do orthogonal matrices rotate while diagonal matrices stretch?
In this deep dive into linear algebra, we prove the geometric intuition behind the Singular Value Decomposition (SVD). By examining how inner products are preserved and how basis vectors are scaled, I demonstrate why linear transformations are restricted to these specific movements.






