Nvidia: Moore's Law is Dead

NVIDIA logoSince we have reached the limit of what is possible with one or more traditional CPUs, the computing industry needs to take the leap into parallel processing, says Bill Dally, chief scientist and senior vice president of research at NVIDIA.

Forty-five years ago this month, Intel co-founder Gordon Moore predicted that the number of transistors on an integrated circuit would double each year (later revised to every 18 months). This laid the groundwork for another prediction: that doubling the number of transistors would also double the performance of CPUs every 18 months.

This bold prediction, known as Moore?s Law, long held true. But we have reached the limit of what is possible with one or more traditional CPUs. The computing industry - and everyone who relies on it for continued improvements in productivity - needs to take the leap into parallel processing. The CPU scaling predicted by Moore?s Law is now dead, according to Nvidia's researcher.

Moore's paper also contained another prediction that has received far less attention over the years. He projected that the amount of energy consumed by each unit of computing would decrease as the number of transistors increased. This enabled computing performance to scale up while the electrical power consumed remained constant. This power scaling, in addition to transistor scaling, is needed to scale CPU performance.

"However, this power scaling has ended. And as a result, the CPU scaling predicted by Moore's Law is now dead. CPU performance no longer doubles every 18 months. And that poses a grave threat to the many industries that rely on the historic growth in computing performance," Dally added.

Dally believes that that there are specific needs that won't be met unless there is a fundamental change in our approach to computing, and identifies parallel computing as the solution. Parallel computing can resurrect Moore's Law and provide a platform for future economic growth and commercial innovation, Dally says.

In parrallel computers, many processing cores, each optimized for efficiency, not serial speed, work together on the solution of a problem.

"A fundamental advantage of parallel computers is that they efficiently turn more transistors into more performance," Dally says. "Doubling the number of processors causes many programs to go twice as fast. In contrast, doubling the number of transistors in a serial CPU results in a very modest increase in performance--at a tremendous expense in energy," he adds.

Nvidia's scientist also underlined the importance of graphics processing units, which enable continued scaling of computing performance in today's energy-constrained environment.

"Every three years we can increase the number of transistors (and cores) by a factor of four. By running each core slightly slower, and hence more efficiently, we can more than triple performance at the same total power. This approach returns us to near historical scaling of computing performance," he says.

To continue scaling computer performance, it is essential that we build parallel machines using cores optimized for energy efficiency, not serial performance.

"Building a parallel computer by connecting two to 12 conventional CPUs optimized for serial performance, an approach often called multi-core, will not work. This approach is analogous to trying to build an airplane by putting wings on a train. Conventional serial CPUs are simply too heavy (consume too much energy per instruction) to fly on parallel programs and to continue historic scaling of performance," Dallly added.

"Parallel computing is the only way to maintain the growth in computing performance that has transformed industries, economies, and human welfare throughout the world. The computing industry must seize this opportunity and avoid stagnation, by focusing software development and training on throughput computers - not on multi-core CPUs," said Dally.


Tags: CPUs, Intel, NVIDIA

Add comment

Your name:
Sign in with:
Your comment:

Enter code:

E-mail (not required)
E-mail will not be disclosed to the third party

Last news

A mobile hotspot in Australia will be capable of hitting gigabit speeds on the go
A new game could be in the works as Blizzard appears to have been hiring for a Diablo-related project
Nokia CEO Rajeev Suri will speak at MWC 2017
However what if you could go way, way back?
The Helio P15 packs an octa-core Cortex-A53 processor clocked at 2.2GHz
Samsung claims up to 27-percent higher performance or 40-percent lower power
Preliminary data for October shows another Windows 10 boom
Samsung Galaxy TabPro S - a tablet with the Windows-keyboard
The first Windows-tablet with the 12-inch display Super AMOLED
June 7, 2016 /
Keyboards for iOS
Ten iOS keyboards review
July 18, 2015 /
Samsung E1200 Mobile Phone Review
A cheap phone with a good screen
March 8, 2015 / 4
Creative Sound Blaster Z sound card review
Good sound for those who are not satisfied with the onboard solution
September 25, 2014 / 2
Samsung Galaxy Gear: Smartwatch at High Price
The first smartwatch from Samsung - almost a smartphone with a small body
December 19, 2013 /
HP Slate 7 is a 7-inch Android 4 Tablet PC with good sound
A cost-effective, 7-inch tablet PC from a renowned manufacturer
October 25, 2013 / 4

News Archive



Do you use microSD card with your phone?
or leave your own version in comments