Deep Learning

The Bitter Lesson Conditions

A modest proposal for revolutionising everything.

The hard truth of AI is that methods that exploit deep, hard-won human knowledge about a particular domain are outperformed by methods that cleverly exploit the increasing power of computation.

I have a modest proposal to distill this fundamental truth into a set of conditions which, when met, will revolutionise a given field.

Lineage

I do not claim this insight about the fundamental mechanism of progress in AI as original; I have been heavily influenced by Richard Sutton’s powerful essay The Bitter Lesson.

Read more: The Bitter Lesson Conditions