Device Management¶
RBLN NPU Management using rbln-smi¶
Note
rbln-stat is now deprecated and replaced by rbln-smi. Existing scripts using rbln-stat will still work, but new users are encouraged to use rbln-smi.
rbln-smi is a command-line interface (CLI) utility designed to assist users in managing and monitoring running processes on RBLN NPU. Users can check various information including
- Version of the ATOM™ (
Name)- RBLN-CA02: ATOM™
- RBLN-CA12: ATOM™+
- RBLN-CA22: ATOM™+
- RBLN-CA25: ATOM™-Max
- Power consumption (
Power) -
Performance State (
Perf)P-state Clock (Neural Engine) PCIe Note P2 Nominal Gen5 - P4 Nominal Gen4 - P6 Half Gen4 - P10 Half (No update) Thermal Throttling P12 Minimal (No update) System Abort (Hang) P14 Off (No update) Idle -
Current temperature (
Temp) - NPU utilization (
Util) - Process id (
PID) - Context id (
CTX) - Allocated memory size (
Memalloc).
The rbln-smi utility is already included in the RBLN Driver package that you are using now. For more detailed usage instructions, run the command rbln-smi --help.
How to specify device¶
If your system contains multiple RBLN NPU devices, you have the option to assign a specific device ID to your process by utilizing the RBLN_DEVICES environment variable. The device ID (NPU ID) can be obtained from the CLI tool rbln-smi.