A neural network processes large batches of similar matrix operations. Why can a GPU help?

1. A GPU always accelerates every serial task
2. A GPU removes the need for a host CPU
3. Many parallel arithmetic units support high-throughput computation
4. A GPU eliminates all data movement