https://www.nvidia.com/content/gtc-2010/pdfs/2238_gtc2010.pdf
This is the 2010 NVidia presentation that really helped set the path for GPU performance. Focusing on memory bandwidth to get high FLOPS, do lots of work per-core, and manage the latency.
Accidental Factors
Needless text