What is the difference between cuda and tensor kernels?

Question

I am completely unfamiliar with terms related to HPC computing, but I just saw that EC2 released its new instance type on AWS, which is powered by the new Nvidia Tesla V100, which has both types of “cores”: Cuda Cores (5.120) and tensor nuclei (640). What is the difference between the two?

Answer 1

Now only the Tesla V100 and Titan V have tensor kernels. Both GPUs have 5120 cuda cores, where each core can perform up to 1 single multiple pumping operation (for example, in fp32 format: x + = y * z) per GPU clock cycle (for example, the Tesla V100 PCIe frequency is 1, 38 GHz).

​​ 4x4. ​​ 1 1 . fp16 4x4 fp32 (: 4x4) ( fp32 4x4).

, fp16, fp32.

, 4x4, NVIDIA " ".

Answer 2

. GPU , . , . , , .

- ( ), . , (, Tensorflow).

Nvidia , , Tensor, CUDA.