Plate V. The Neural Lattice, 2006–2017
The Neural Lattice

Data, GPUs and old ideas finally meet.
Deep belief nets in 2006 revived interest in many-layered networks. ImageNet supplied millions of labelled images; in 2012 AlexNet, trained on two gaming GPUs, cut the error rate so sharply that computer vision changed overnight.
Within four years neural networks were translating, generating faces that never existed and, in March 2016, playing a move at Go that professional commentators first took for a mistake.
Events
- Deep belief nets revive deep learning (2006)
- ImageNet (Jun 2009)
- Watson wins Jeopardy! (14 Feb 2011 – 16 Feb 2011)
- Siri arrives on the iPhone 4S (4 Oct 2011)
- The network that found cats (Jun 2012)
- AlexNet wins ImageNet (30 Sept 2012)
- word2vec: king − man + woman ≈ queen (Jan 2013)
- Google acquires DeepMind (26 Jan 2014)
- Generative adversarial networks (10 Jun 2014)
- OpenAI is founded (11 Dec 2015)
- AlphaGo beats Lee Sedol (9 Mar 2016 – 15 Mar 2016)
- Tay is taken offline (23 Mar 2016)