Using multiple CUDA GPUs

Question

I am using NVIDIA Grid K2 to program CUDA. It has two GPUs, each of which has 1536 cores. Can I use both GPUs in one or more kernel calls?

Answer 1

No, It is Immpossible. Each GPU on a card with multiple GPUs, such as the Grid K2, is a separate CUDA device with its own memory. Thus, each GPU gets its own CUDA context and must be explicitly programmed. The CUDA driver or runtime will not automatically use both devices as a single virtual device to start the kernel.