I am currently working with neural nets and I recently made my code much faster by configuring a framework correctly to make use of a GPU. The GPU that is used is a Tesla C2075, which is part of the Nvidia Tesla series.
As enabling GPU computation gave such a huge performance boost, I was curious what the latest GPU of Nvidia is. It is called Titan Z and part of the GeForce 700 series.
However, I am a little bit confused. A "Tesla K40 Workstation Card 12GB DDR5 " currently costs 5500 Euro on Amazon, whereas the Titan Z costs 2750 Euro.
It seems to me that the Titan Z is a much better deal (see specs). I've talked with a friend about this and he thinks that "scientific GPUs" and "gaming GPUs" are different. Could somebody else please elaborate on what is different on those "scientific GPUs" and "gaming GPUs"? Do they have different instruction sets?
(How can one see what might better work for neural net training?)
The following specs are from http://www.nvidia.com/gtx-700-graphics-cards/gtx-titan-z/ and http://www.nvidia.com/object/tesla-servers.html. The first number is the Titan Z, the second one the Tesla K40
- Name: Titan Z ↔ Tesla K40
- Number and Type of GPU: ↔ 1 Kepler GK110B
- Peak double precision floating point performance: 2.66 Tflps (see link) ↔ 1.43 Tflops
- Peak single precision floating point performance: ? ↔ 4.29 Tflops
- Memory bandwidth: 672 GB/sec ↔ 288 GB/sec (ECC off)
- Memory size (GDDR5): 12 GB ↔ 12 GB
- CUDA cores: 5760 ↔ 2880