Blog

e

math

Predictions for the AI Race

What the incentives and game theory suggest about how the AI race will play out

essayai

Rubik's Cube Cycles

Why repeating any sequence of moves on a Rubik's cube always returns it to its starting state

mathgroup-theory

Thoughts on Innovation

Innovation comes from combining breadth and depth of knowledge, not from genius in a vacuum

essay

Linear Universal Approximation Theorem

A linear map can approximate any function if you encode and decode in high enough dimensions

machine-learningapproximation-theorylinear-algebra

L'Hôpital's Rule

The intuition behind L'Hôpital's rule

mathcalculus

Lagrange Multipliers

Constrained optimization with Lagrange multipliers

mathcalculusoptimization

Backpropagation

Computing gradients through a neural network

machine-learningoptimizationcalculus

K-Means Clustering Convergence

K-means minimizes a function by alternating two local improvements

machine-learningoptimizationclustering

Machine Learning Isn't Magic; It's Just Optimization

At its core, machine learning is just finding the minimum of a function

machine-learningoptimization

Almost Orthogonal Vectors

Exponentially many nearly orthogonal vectors fit in n dimensions

linear-algebravectors

Dot Products

A simple operation with many connections

linear-algebravectors

Information Theory Analysis of Sorting

Why comparison sorts are limited to O(n log n): an information theory view

algorithmsinformation-theorysorting

Hello, World!

“Building a tiny x86-64 ELF that prints “Hello, World!””

low-levelelfassembly