The Cost of AI Training is Improving at 50x the Speed of Moore’s Law
July 5th, 2020Via: Arc Invest:
The cost to train an artificial intelligence (AI) system is improving at 50x the pace of Moore’s Law. For many use cases, the cost to run an AI inference system has collapsed to almost nil. After just five years of development, deep learning – the modern incarnation of AI – seems to have reached a tipping point in both cost and performance, paving the way for widespread adoption over the next decade.
During the past ten years, the computing resources devoted to AI training models have exploded. After doubling every two years from 1960 to 2010, AI compute complexity has soared 10x every year, as shown below.