Skip to content

You're not viewing the latest version. Click here to go to latest.

SDK v0.12.0 has been Released (Oct 2026). Check Out the Release Announcement.

Supported Operations

English
한국어

Initializing search

Home
For AI Engineers
For System Administrators
Reference Design
Supports

Home
Home
For AI Engineers
For AI Engineers
- GETTING STARTED
  GETTING STARTED
- COMPILE & OPTIMIZE
  COMPILE & OPTIMIZE
  - RBLN Compiler
    
    RBLN Compiler
    
    Installation
    
    Tutorials
    Tutorials
    
    Basic
    Basic
    
    PyTorch (Vision)
    
    PyTorch (NLP)
    
    TensorFlow (Vision)
    
    Advanced
    Advanced
    
    Concurrent Processing
    
    Bucketing
    
    Troubleshoot
    
    Python API
    
    Language Binding
    Language Binding
    
    C/C++
    C/C++
    
    Installation
    
    Tutorials
    Tutorials
    
    Image Classification
    
    Object Detection
    
    API
    
    Deep Dive
  - RBLN Optimum
    
    RBLN Optimum
    
    Installation
    
    Tutorials
    Tutorials
    
    Rebel100™
    Rebel100™
    
    Llama3-8B
    
    Qwen3-VL-2B
    
    Gemma-4-31B
    
    ATOM™
    ATOM™
    
    SDXL-turbo
    
    Llama3-8B
    
    Cosmos WFMs
    
    Cosmos WFMs
    
    Cosmos-Predict2.5
    
    Cosmos-Transfer2.5
    
    Cosmos-Reason2
    
    Qwen3-VL-2B
    
    Gemma-4-31B
    
    Troubleshoot
    
    Troubleshoot
    
    Multi-Module Models
    
    KV Cache Block Estimation
    
    Model APIs
    
    Model APIs
    
    Main Class
    Main Class
    
    Auto Classes
    
    AutoPipeline
    
    Transformers
    Transformers
    
    Common
    
    Text Models
    Text Models
    
    Common
    
    Bart
    
    Bert
    
    DistilBert
    
    EXAONE
    
    Gemma
    
    Gemma2
    
    GPT-2
    
    GPT-OSS
    
    Llama
    
    Mi:dm
    
    Mistral
    
    OPT
    
    Pegasus
    
    Phi
    
    Qwen2
    
    Qwen3
    
    RoBERTa
    
    T5
    
    XLM-RoBERTa
    
    Vision Models
    Vision Models
    
    Common
    
    DPT
    
    ResNet
    
    ViT
    
    Depth Anything V2
    
    Audio Models
    Audio Models
    
    AST
    
    Wav2Vec
    
    Whisper
    
    Multimodal Models
    Multimodal Models
    
    Clip
    
    BLIP2
    
    ColPali
    
    ColQwen2
    
    Idefics3
    
    LLaVa
    
    LlavaNext
    
    Qwen2 VL
    
    Qwen2.5 VL
    
    Qwen3 VL
    
    Qwen3.5
    
    Gemma3
    
    Gemma4
    
    Grounding DINO
    
    PaliGemma
    
    Time Series Models
    Time Series Models
    
    Time Series Transformer
    
    Diffusers
    Diffusers
    
    Common
    
    Models
    Models
    
    UNets
    
    UNets (SVD)
    
    VAE
    
    VQModel
    
    Prior Transformer
    
    Transformer (SD3)
    
    Transformer (Cosmos)
    
    ControlNet
    
    Pipelines
    Pipelines
    
    Cosmos
    
    StableDiffusion
    
    StableDiffusion XL
    
    StableDiffusion 3
    
    StableVideoDiffusion
    
    Kandinsky V2.2
    
    ControlNet (SD)
    
    ControlNet (SDXL)
  - RBLN PyTorch
    
    RBLN PyTorch
    
    Installation
    
    Execution Semantics
    
    Tutorials
    Tutorials
    
    Running & debugging
    
    Profiling on Rebel100™
    
    rbln-ccl collectives
    
    Llama3.2-1B
    
    APIs & Supported Ops
    
    Environment Variables
    
    Troubleshoot
  - RBLN vLLM
    
    RBLN vLLM
    
    Recipes
    
    Recipes
    
    Qwen
    Qwen
    
    Qwen2-7B-Instruct
    
    Qwen2-VL-7B-Instruct
    
    Qwen2.5-0.5B-Instruct
    
    Qwen2.5-1.5B-Instruct
    
    Qwen2.5-3B-Instruct
    
    Qwen2.5-7B-Instruct
    
    Qwen2.5-14B-Instruct
    
    Qwen2.5-32B-Instruct
    
    Qwen2.5-72B-Instruct
    
    Qwen2.5-VL-7B-Instruct
    
    Qwen3-0.6B
    
    Qwen3-1.7B
    
    Qwen3-4B
    
    Qwen3-8B
    
    Qwen3-30B-A3B
    
    Qwen3-32B
    
    Qwen3-Embedding-0.6B
    
    Qwen3-Embedding-4B
    
    Qwen3-Reranker-0.6B
    
    Qwen3-Reranker-4B
    
    Qwen3-VL-2B-Instruct
    
    Qwen3-VL-4B-Instruct
    
    Qwen3-VL-8B-Instruct
    
    Qwen3-VL-30B-A3B-Instruct
    
    Qwen3-VL-32B-Instruct
    
    Qwen3.5-0.8B
    
    Qwen3.5-2B
    
    Qwen3.5-4B
    
    Qwen3.5-9B
    
    Qwen3.5-27B
    
    Qwen3.6-27B
    
    Qwen3.8-27B
    
    Llama
    Llama
    
    Llama-2-7b-chat-hf
    
    Llama-2-13b-chat-hf
    
    Llama-3.1-8B-Instruct
    
    Llama-3.1-70B-Instruct
    
    Llama-3.2-1B-Instruct
    
    Llama-3.2-3B-Instruct
    
    Llama-3.3-70B-Instruct
    
    Meta-Llama-3-8B-Instruct
    
    DeepSeek
    DeepSeek
    
    DeepSeek-R1-Distill-Llama-8B
    
    DeepSeek-R1-Distill-Llama-70B
    
    DeepSeek-R1-Distill-Qwen-1.5B
    
    DeepSeek-R1-Distill-Qwen-7B
    
    DeepSeek-R1-Distill-Qwen-14B
    
    DeepSeek-R1-Distill-Qwen-32B
    
    DeepSeek-V3.2
    
    Gemma
    Gemma
    
    gemma-2-2b-it
    
    gemma-2-9b-it
    
    gemma-2b-it
    
    gemma-3-4b-it
    
    gemma-3-12b-it
    
    gemma-3-27b-it
    
    gemma-4-26B-A4b-it
    
    gemma-4-31B-it
    
    gemma-7b-it
    
    EXAONE
    EXAONE
    
    EXAONE-3.0-7.8B-Instruct
    
    EXAONE-3.5-2.4B-Instruct
    
    EXAONE-3.5-7.8B-Instruct
    
    EXAONE-3.5-32B-Instruct
    
    EXAONE-4.5-33B
    
    Mistral
    Mistral
    
    Mistral-7B-Instruct-v0.3
    
    MiniMax
    MiniMax
    
    MiniMax-M2.7
    
    Phi
    Phi
    
    phi-2
    
    OPT
    OPT
    
    opt-2.7b
    
    opt-6.7b
    
    opt-66b
    
    opt-125m
    
    GPT-2
    GPT-2
    
    gpt2
    
    gpt2-large
    
    gpt2-medium
    
    gpt2-xl
    
    GPT-OSS
    GPT-OSS
    
    gpt-oss-20b
    
    gpt-oss-120b
    
    SOLAR
    SOLAR
    
    SOLAR-10.7B-Instruct-v1.0
    
    KONI
    KONI
    
    KONI-Llama3.1-8B-Instruct-20241024
    
    Mi:dm
    Mi:dm
    
    Midm-2.0-Base-Instruct
    
    Midm-2.0-Mini-Instruct
    
    Salamandra
    Salamandra
    
    salamandra-7b-instruct
    
    A.X
    A.X
    
    A.X-4.0-Light
    
    A.X-K2
    
    Idefics3
    Idefics3
    
    Idefics3-8B-Llama3
    
    LLaVA
    LLaVA
    
    llava-1.5-7b-hf
    
    llava-v1.6-mistral-7b-hf
    
    Pixtral
    Pixtral
    
    pixtral-12b
    
    PaliGemma
    PaliGemma
    
    paligemma2-3b-mix-224
    
    paligemma-3b-mix-224
    
    Cosmos
    Cosmos
    
    Cosmos-Reason1-7B
    
    BLIP-2
    BLIP-2
    
    blip2-opt-2.7b
    
    blip2-opt-6.7b
    
    BGE
    BGE
    
    bge-base-en-v1.5
    
    bge-large-en-v1.5
    
    bge-m3
    
    bge-reranker-base
    
    bge-reranker-large
    
    bge-reranker-v2-m3
    
    bge-small-en-v1.5
    
    RoBERTa
    RoBERTa
    
    twitter-roberta-base-emotion
    
    Whisper
    Whisper
    
    whisper-base
    
    whisper-large-v3
    
    whisper-large-v3-turbo
    
    whisper-medium
    
    whisper-small
    
    whisper-tiny
    
    Feature Matrix
    
    Features
    Features
    
    Attention Modes
    
    RBLN Sampler
    
    Prefix Caching
    
    Speculative Decoding
    
    KV Cache Offloading
    
    Model Parallelism
    
    Fine-Grained Device Assignment
    
    Dynamic Batch Sizes
    
    Profiling Guide
    
    Compile Cache
    
    Disaggregated Encoder
    
    Disaggregated Prefill / Decode
    
    Configuration Guide
    
    Troubleshoot
  - RBLN Profiler
    
    RBLN Profiler
    
    RBLN NPU Architecture
    
    Profiling
    
    Perfetto
    Perfetto
    
    Introduction
    
    How to Analyze
    
    Large Model Visualization
    
    Merging Multiple Traces
    
    Case Studies
    Case Studies
    
    ATOM™
    ATOM™
    
    YOLOv8
    
    Stable Diffusion 3
    
    Llama3-8B
    
    Rebel100™
    Rebel100™
    
    Qwen3-1.7B
    
    gpt-oss-20b
    
    gpt-oss-20b (Data Parallelism)
- MODEL SERVING
  MODEL SERVING
  - Nvidia Triton Inference Server
    
    Nvidia Triton Inference Server
    
    Tutorials
    Tutorials
    
    ResNet50
    
    YOLOv8
    
    Llama3-8B
    
    Llama3.1-8B with Flash Attention
  - TorchServe
    
    TorchServe
    
    Tutorials
    Tutorials
    
    ResNet50
    
    YOLOv8
    
    Llama3-8B
    
    Llama3.1-8B with Flash Attention
  - Ray Serve
    
    Ray Serve
    
    Tutorials
    Tutorials
    
    Resnet50
    
    YOLOv8
    
    Llama3-8B
    
    Llama3.1-8B with Flash Attention
- MISCELLANEOUS
  MISCELLANEOUS
  - Model Zoo
  - Supported Ops
    Supported Ops
    
    PyTorch
    
    TensorFlow
  - Error Codes
For System Administrators
For System Administrators
- BARE METAL
  BARE METAL
  - RBLN Driver Installation
- CLOUD-NATIVE SUPPORT
  CLOUD-NATIVE SUPPORT
  - Overview
  - Container Support
    Container Support
    
    Container Toolkit
    
    NPU Allocation
  - RBLN NPU Operator
    
    RBLN NPU Operator
    
    Tutorials
    
    Tutorials
    
    Run an NPU Pod
    
    Allocate NPUs
    Allocate NPUs
    
    Schedule a Pod by NPU family
    
    Allocate two NPUs to one Pod
    
    Request NPUs with DRA
    
    Specify NPU allocation conditions with DRA
    
    Verify RDS devices in an NPU Pod
    
    Manage drivers
    Manage drivers
    
    Upgrade NPU drivers automatically
    
    Run different driver versions on separate nodes
    
    Configure VM nodes
    Configure VM nodes
    
    Attach an NPU to a KubeVirt VM
    
    Separate NPU nodes for containers and VMs
    
    Collect NPU metrics with Prometheus
    
    Installation
    Installation
    
    Kubernetes (Helm)
    
    OpenShift (OLM)
    
    Disconnected / Air-gapped (OpenShift)
    
    Upgrade
    
    Uninstallation
    
    Driver Management
    Driver Management
    
    NPU Driver Installation
    
    NPU Driver Upgrades
    
    NPU Driver Upgrades
    
    Manual Upgrade
    
    Automatic Upgrade
    
    Multiple Driver Versions
    
    NPU Allocation
    NPU Allocation
    
    Device Plugin
    
    DRA Driver
    
    Monitoring
    Monitoring
    
    Metrics Exporter
    
    Gateway Mode
    
    Metrics Reference
    
    Operator Observability
    
    Advanced Configuration
    Advanced Configuration
    
    NPU Feature Discovery
    
    Switching Workload by Label
    
    Kernel Parameters on OpenShift
    
    PCIe Hotplug Unbinding on OpenShift
    
    Sandboxed Workloads (KubeVirt)
    
    Sandboxed Workloads (KubeVirt)
    
    Sandbox Device Plugin
    
    DRA Driver (VM Passthrough)
    
    RDS Support
    
    Reference
    Reference
    
    Helm Configuration Examples
    
    Helm Chart Values
- SYSTEM MANAGEMENT
  SYSTEM MANAGEMENT
  - Overview
  - Management Tools
    Management Tools
    
    RBLN System Management Daemon
    
    Device Monitoring
    
    Bandwidth Benchmark
    
    System Validation
    
    Firmware Update
    
    Hardware Diagnostics
  - Virtualization
    Virtualization
    
    Overview
    
    Virtualization Methods
    Virtualization Methods
    
    PCI Pass-Through
    
    Platforms
    Platforms
    
    OpenStack
- PARTNER SOLUTIONS
  PARTNER SOLUTIONS
  - Red Hat AI Enterprise
    
    Red Hat AI Enterprise
    
    Installation
    
    Model Deployment
    Model Deployment
    
    Deployment
    
    Serving Features
Reference Design
Reference Design
- Coding Assistant
  Coding Assistant
  - Overview
  - Hardware
  - Software Stack and Versions
  - Deployment on Kubernetes
    
    Deployment on Kubernetes
    
    Node Preparation
    
    Device Allocation
    
    Cluster Foundation
    
    Pod Spec Requirements
    
    Compile Cache
    
    Startup and Readiness Probes
    
    Installing the Serving Stack
    
    Chart Configuration Reference
  - Serving Configuration
  - Client Integration
  - Operations
    
    Operations
    
    Monitoring
    
    Scaling and Upgrades
    
    Failure Response
  - Validation and Limits
Supports
Supports

Supported Operations¶

The supported-operations table moved to APIs and Supported Operations › Supported operations.

October 16, 2026

Homepage Developer Forum Model Zoo FAQ

Copyright © 2020 - 2026 Rebellions Inc.