Silly Question

[Nineshadow]

This is a pretty great demo :

 

Of course, it isn't as simple but it does convey a point very well. GPUs are highly parallel. That's what they do, they execute loads of instructions in parallel, most of them involving matrix arithmetic and floating point calculations, which are actually quite simple and don't depend on each other. And that's why these things are done in parallel.