Disclaimer: I'm not sure the appropriate SE to put this in, so if Super User is the wrong place I apologize. I realize this is a very broad and probably very complex answer, but how is it that every year/ two years CPU and in general computer engineers are able to improve the performance of said part? Today, the performance increases are more in efficiency rather than raw megahertz, I get that, but even then, how is said efficiency increased? The main thing that confuses me about it is how quickly new designs are made. I would think that efficiency-increasing ideas are hard to come by, so how is it that people have enough to release new generations as fast as they do?


1 Answer 1


The simple answer is that we don't see year-on-year improvements, so the premise isn't quite correct.

Keep in mind that the release cadence is for business reasons, not technical: there may not be significant improvement, but consumers expect a yearly release, so that's what they do.

The more complex answer is that there are many aspects to CPU performance:

  • The microarchitecture, which affects:
    • How quickly it can process specific instructions (instructions per cycle), which varies by instruction.
    • How quickly it can process sequences of instructions (things like pipelining, branch prediction, caching, etc.)
    • Which specialised instructions are supported (things like AES-NI, which hugely speeds up encryption, SIMD [SSE, AVX, etc.], which hugely speeds up large data tasks like image processing, etc.)
    • See more: https://superuser.com/a/906227/117590
  • The clock speed, which affects how many cycles you get per second. This has largely stalled but we're still trying to work out efficiency to get higher clocks without frying the CPU or requiring too much cooling.
  • The number of cores, which affects how many independent instruction streams can be processed at once. This is, again, limited by efficiency. See also: https://superuser.com/a/797486/117590

The now-old tick-tock model shows how this was handled in the past: one year, you'd see a microarchitecture improvement, then the next you'd see a "die shrink", increasing efficiency by using a smaller process size. While the die shrink was happening on the previous microarchitecture, the next-generation one could be worked on at the same time. More recently this is slowing down, because we're running out of little improvements to squeeze out on both the architectural and process size fronts.

For example, the recent Intel Coffee Lake generation had minimal improvements over Kaby Lake, which itself had minimal improvements over Skylake. The architecture itself has remained more or less the same, with some minor improvements in SIMD instructions and side improvements like in the memory controller. The headline change, if any, would be marginally higher clock speeds ... from the efficiency gains in the manufacturing process. Coffee Lake's headline change was an increase in core counts, likely largely for marketing purposes (competition with AMD).

Rarely, we also see large jumps, as with the old Intel Core and recent AMD Zen architectures. There are many design teams working on different architectures in parallel, and occasionally when the primary one's advancement stalls another architecture using different ideas can "take over" (Core replaced Netburst, Zen replaced the Excavator series).

And then outside of the desktop CPU world, we're seeing a huge push for power efficiency for battery-powered devices like laptops and tablets. That's been the headline feature of a lot of new architectures: they're not necessarily faster, but they're more efficient so your battery lasts longer.

  • But there are obviously performance improvements, or at least efficiency improvements each year, or otherwise the 7700k and the 8700k would be identical. To be fair, the difference is quite small, but there still is one, so that is the premise of my question.
    – Corsair64
    Jul 31, 2018 at 3:16
  • @Corsair64 A more apt comparison may be the Kaby Lake vs Skylake generation, which was widely decried for its (almost) lack of architectural improvements. Heck, even the Coffee Lake generation you mention is still largely Skylake IPC... they just crammed more cores on there. See the three main bullet points in the answer.
    – Bob
    Jul 31, 2018 at 3:17
  • I see now the business component of it, however I'm still curious on the microcode side of things. How is it improved every couple of years even though said code has been worked on for such a long time? (Even though said changes are relatively small)
    – Corsair64
    Jul 31, 2018 at 3:19
  • 2
    @Corsair64 Because CPUs are insanely complex beasts. There are many minor tweaks you could apply ... but many of them will also have a negative impact elsewhere. Perfection is effectively impossible. They could take the time to tweak everything do one big release every 10 years, but that's where the business aspect comes into it. (Actually, that's almost what AMD's Zen did. Tiny tweaks to Excavator while working on a complete redesign with Zen.) Also, part of it is the new instructions to keep up with changing software requirements - e.g. SIMD/SSE was largely tied to early multimedia.
    – Bob
    Jul 31, 2018 at 3:26
  • @Corsair64 AES-NI, hardware-accelerated AES, only became worthwhile once AES reached a certain level of popularity (standardisation in 2001, many years to spread, HTTPS with AES becoming more popular... years to design the instruction set and validate it in a new architecture... AES-NI introduced in 2010.). A large part of improvements, outside of pipelining and branch prediction and caching, come from very specialised instructions that just happen to be (fairly) commonly needed by modern software. We're running out of those improvements too.
    – Bob
    Jul 31, 2018 at 3:29

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .