AI and Compute: How Much Longer Can Computing Power Drive Artificial Intelligence Progress? [report]

Andrew Lohn, Micah Musser
2022 unpublished
Between 2012 and 2018, the amount of computing power used by record-breaking artificial intelligence models doubled every 3.4 months. Even with money pouring into the AI field, this trendline is unsustainable. Because of cost, hardware availability and engineering difficulties, the next decade of AI can't rely exclusively on applying more and more computing power to drive further progress.
doi:10.51593/2021ca009 fatcat:fnzz6koakjg4blfkois6msxov4