Mathematics for Machine Learning

Companion webpage to the book "Mathematics for Machine Learning". Copyright 2019 by Marc Peter Deisenroth, A Aldo Faisal, and Cheng Soon Ong. To be published by Cambridge University Press.

View the Project on GitHub

Please link to this site using https://mml-book.com.

Twitter: @mpd37, @AnalogAldo, @ChengSoonOng.

book cover

We wrote a book on Mathematics for Machine Learning that motivates people to learn mathematical concepts. The book is not intended to cover advanced machine learning techniques because there are already plenty of books doing this. Instead, we aim to provide the necessary mathematical skills to read those other books.

The book will be published by Cambridge University Press in early 2020.

We split the book into two parts:

We aim to keep this book fairly short, so we don’t cover everything.

We will keep PDFs of this book freely available after publication.

Table of Contents

Part I: Mathematical Foundations

  1. Introduction and Motivation
  2. Linear Algebra
  3. Analytic Geometry
  4. Matrix Decompositions
  5. Vector Calculus
  6. Probability and Distribution
  7. Continuous Optimization

Part II: Central Machine Learning Problems

  1. When Models Meet Data
  2. Linear Regression
  3. Dimensionality Reduction with Principal Component Analysis
  4. Density Estimation with Gaussian Mixture Models
  5. Classification with Support Vector Machines

Report errata and feedback.

Any issues you raise now may not make it into the printed version, but we will keep an updated PDF around (and the errata).

Downloads

PDF of the book

This version is the most up-to-date version of the book, i.e., we continue fixing typos etc.

Errata on overleaf

PDF of the printed book

This version is equivalent (modulo formatting) with the printed version of the book. GitHub issues starting from 433 are not included in this version.

Tutorials

We are working on jupyter notebook tutorials for the machine learning parts:

  1. Linear Regression
  2. Gaussian Mixture Models
  3. PCA
  4. SVM (work in progress)

Testimonies

‘This book provides great coverage of all the basic mathematical concepts for machine learning. I’m looking forward to sharing it with students, colleagues, and anyone interested in building a solid understanding of the fundamentals.’ Joelle Pineau

‘The field of machine learning has grown dramatically in recent years, with an increasingly impressive spectrum of successful applications. This comprehensive text covers the key mathematical concepts that underpin modern machine learning, with a focus on linear algebra, calculus, and probability theory. It will prove valuable both as a tutorial for newcomers to the field, and as a reference text for machine learning researchers and engineers.’ Christopher Bishop

‘The book hits the right level of detail for me. Too many of the ML books have a “don’t worry your pretty head about this detail” mentality, or go the other way and overwhelm me with detail. Your book is comprehensive and has a sense of ease and expanse, but it feels like I can get to the application part quickly enough.’ Sriram Srinivasan