Gene Amdahl has persuasively argued that there are severe technology-independent limits on the performance gains which can be achieved by using massively parallel processing. This conclusion (popularly called Amdahl's Law ) has been supported by a number of different arguments 1, advanced in the context of vector processing and also in the context of the hypercube architecture.
/lp/association-for-computing-machinery/amdahl-s-law-and-end-of-system-design-gUHyspgWze