2

I want to know who is using which GPUs.

For example.

After nvidia-smi

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A      6260      C   python                           1203MiB |
|    0   N/A  N/A     19842      C   python                           7735MiB |
|    1   N/A  N/A       594      C   python                           1703MiB |
|    1   N/A  N/A      6260      C   python                           1371MiB |
|    1   N/A  N/A     19842      C   python                           5343MiB |

Here I want know which conda environments are using for each PIDs.
(Because for our team, we use different conda envs)

What I want is

PID : 6260 = env1  
PID : 19842 = env2   
...

Thank you.

marc_s
  • 732,580
  • 175
  • 1,330
  • 1,459
Jake
  • 65
  • 4

1 Answers1

1

Conda environment activation is only a state of a shell session. Short of recovering that state from the parent process, the next best thing might be inspecting the process path. For example, I can check some like:

$ top
#   PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
#     1 root      20   0    2500    584    520 S   0.0   0.0   0:00.19 tini
#     8 root      20   0    6000   3740   3136 S   0.0   0.0   0:00.00 bash
#    18 root      20   0    2616    596    528 S   0.0   0.0   0:00.02 sh
#    25 root      20   0   11592   8936   5756 T   0.0   0.1   0:00.01 python
#    28 root      20   0    6000   3960   3312 S   0.0   0.0   0:00.16 bash
#    99 root      20   0    6000   2144   1516 S   0.0   0.0   0:00.00 bash
#   100 root      20   0    6000   2332   1700 S   0.0   0.0   0:00.00 bash
#   103 root      20   0   23200  19900   7352 S   0.0   0.1   0:00.10 conda
#   104 root      20   0    5868   3572   3236 S   0.0   0.0   0:00.00 bash
#   116 root      20   0   10776   7228   4744 S   0.0   0.0   0:00.00 python
# 10743 root      20   0    7860   3604   3096 R   0.0   0.0   0:00.00 top     

$ readlink -f /proc/25/exe
/opt/conda/bin/python3.9

$ readlink -f /proc/116/exe
/opt/conda/envs/foo/bin/python3.10

which are the base and foo environments, respectively.

merv
  • 67,214
  • 13
  • 180
  • 245