What is the difference between NVIDIA_VISIBLE_DEVICES=0/1.. and nvidia.com/gpu: 0/1..?

enter image description here

When I changed NVIDIA_VISIBLE_DEVICES=0 to 1, it’s basically accessing the second’s GPU’s card, but changing nvidia.com/gpu: 0 to 1 this time it’s not accessing the second’s GPU. What is the actual use case of nvidia.com/gpu numbers?

  • You write nvidia.com but the picture shows nvshare.com. Do you mean nvshare.com/gpu?

    – 

See indexing of GPU card starts with 0, i.e your first card will be indexed at 0th place. nvidea.com/gpu is typically used for resource management. This is used especial when you word with NVIDEA GPUs in a container like environment.
You can inspect the GPU information inside a container using commands like nvidia-smi to verify the GPU visibility and indices. Or if the problem persist please visit the tool’s official documentation.

Leave a Comment