Brain Networks Laboratory (Choe Lab)

[OpenAI] AI and compute: Moore's law?

May 17, 2018

https://openai.com/blog/ai-and-compute/

AI and Compute

We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period).[1]

Since 2012, this metric has grown by more than 300,000x (a 2-year doubling period would yield only a 7x increase). Improvements in compute have been a key component of AI progress, so as long as this trend continues, it’s worth preparing for the implications of systems far outside today’s capabilities.


← Back to all articles         Quick Navigation:    Next:[ j ] – Prev:[ k ] – List:[ l ]