Ray Solomonoff

Invented algorithmic probability in 1960, formalising the intuition that the simplest explanation consistent with the evidence is the most likely one. Solomonoff induction is provably the optimal way to predict a sequence — and provably uncomputable, which has not stopped it from underwriting most of what came after in machine learning theory.