How to use multiple GPUs in distributed computing server?

Hi, I'm using the MATLAB distributed computing server. I have 3 computers in a cluster, and each is quipped with the Nvidia Quadro M4000 GPU and is set to TCC mode. I want to use some or all the GPUs to do the computing. Since the GPU node cannot be displayed in the Admin Center, how could I decide which GPUs I am using in the computation? Thanks.

Answer 1

[Joss Knight]

Try gpuDeviceCount to determine how many GPUs a worker has access to, and then some manipulation of labindex to assign devices to workers. By default your cluster will have, in effect, run

spmd
    gpuDevice(mod(labindex, gpuDeviceCount)+1);
end

See http://blogs.mathworks.com/loren/2013/06/24/running-monte-carlo-simulations-on-multiple-gpus/ for more.