The parallel ceiling
Ninety-five percent of the job splits across cores. How much faster can it possibly finish?
One fixed job runs on a single core, and the first slider splits it into the part that must happen in order and the part that can be handed out. Cores only ever divide the second part. Watch what the next core buys fall toward nothing while the in-order slice sits there unchanged.
Board: Concurrency and the Hardware →On a narrow screen the three panels stack. Both sliders and the tabs stay above them.
try this Leave The part that can be split up at 95%, drag Cores you throw at it upward, and watch What the next core buys.
Included with a plan
This lab is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
see also The Bitter Lesson, Attention Is All You Need, MapReduce: Simplified Data Processing on Large Clusters and Validity of the Single Processor Approach to Achieving Large Scale Computing Capabilities in Papers.