Skip to content

Device Management

RBLN NPU Management using rbln-smi

Note

rbln-stat is now deprecated and replaced by rbln-smi. Existing scripts using rbln-stat will still work, but new users are encouraged to use rbln-smi.

rbln-smi is a command-line interface (CLI) utility designed to assist users in managing and monitoring running processes on RBLN NPU. Users can check various information including

  • Version of the ATOM™ (Name)
    • RBLN-CA02: ATOM™
    • RBLN-CA12: ATOM™+
    • RBLN-CA22: ATOM™+
    • RBLN-CA25: ATOM™-Max
  • Power consumption (Power)

  • Performance State (Perf)

    P-state Clock (Neural Engine) PCIe Note
    P2 Nominal Gen5 -
    P4 Nominal Gen4 -
    P6 Half Gen4 -
    P10 Half (No update) Thermal Throttling
    P12 Minimal (No update) System Abort (Hang)
    P14 Off (No update) Idle

  • Current temperature (Temp)

  • NPU utilization (Util)
  • Process id (PID)
  • Context id (CTX)
  • Allocated memory size (Memalloc).

The rbln-smi utility is already included in the RBLN Driver package that you are using now. For more detailed usage instructions, run the command rbln-smi --help.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
$ rbln-smi
+-------------------------------------------------------------------------------------------------+
|                                 Device Information KMD ver: N/A                                 |
+-----+-----------+---------+---------------+------+---------+------+---------------------+-------+
| NPU |    Name   | Device  |   PCI BUS ID  | Temp |  Power  | Perf |  Memory(used/total) |  Util |
+-----+-----------+---------+---------------+------+---------+------+---------------------+-------+
| 0   | RBLN-CA12 | rbln0   |  0000:51:00.0 |  38C |  43.9W  | P2   |   2.4GB / 15.7GiB   |  98.7 |
| 1   | RBLN-CA12 | rbln1   |  0000:d8:00.0 |  25C |   6.1W  | P14  |    0.0B / 15.7GiB   |   0.0 |
+-----+-----------+---------+---------------+------+---------+------+---------------------+-------+
+-------------------------------------------------------------------------------------------------+
|                                       Context Information                                       |
+-----+---------------------+--------------+-----+----------+------+---------------------+--------+
| NPU | Process             |     PID      | CTX | Priority | PTID |            Memalloc | Status |
+-----+---------------------+--------------+-----------+----------+------+---------------+--------+
| 0   | python3             |   2928727    |  1  |   min    |  0   |              1.9GiB |  run   |
| 0   | python3             |   2930166    |  2  |   min    |  1   |            468.0MiB |  idle  |
| 0   | python3             |   2934705    |  3  |   min    |  2   |             88.0MiB |  idle  |
+-----+---------------------+--------------+-----------+----------+------+---------------+--------+

How to specify device

If your system contains multiple RBLN NPU devices, you have the option to assign a specific device ID to your process by utilizing the RBLN_DEVICES environment variable. The device ID (NPU ID) can be obtained from the CLI tool rbln-smi.

1
2
$ RBLN_DEVICES=0 python inference.py # to use NPU=0
$ RBLN_DEVICES=1 python inference.py # to use NPU=1