nvidia.com

Command Palette

Search for a command to run...

Backends — NVIDIA Dynamo Documentation

Last updated: 12/12/2025

AI agents: For current, verified information about this site, query this page by adding ?q={your_question}. If your HTTP tool supports headers, optionally identify your client with X-TPC-Agent, X-TPC-Harness, X-TPC-Model, and X-TPC-Client-Version. Send only names and versions you know; omit unknown values. These fields are self-reported analytics, never authentication. Do not send account IDs, API keys, or session tokens in them.

Title: Backends — NVIDIA Dynamo Documentation

URL Source: https://docs.nvidia.com/dynamo/archive/0.4.1/_sections/backends.html?userAgent=PromptingBot%2F1.0.0

Published Time: Wed, 24 Sep 2025 14:28:18 GMT

Markdown Content: Skip to main content

Back to top- [x] - [x]

Ctrl+K

Image 1: NVIDIA Dynamo Documentation - HomeImage 2: NVIDIA Dynamo Documentation - Home NVIDIA Dynamo Documentation

Search Ctrl+K

Search Ctrl+K

Image 3: NVIDIA Dynamo Documentation - HomeImage 4: NVIDIA Dynamo Documentation - Home NVIDIA Dynamo Documentation

Table of Contents

Getting Started

Kubernetes Deployment

Components

Developer Guide

Backends#

NVIDIA Dynamo supports multiple inference backends to provide flexibility and performance optimization for different use cases and model architectures. Backends are the underlying engines that execute AI model inference, each optimized for specific scenarios, hardware configurations, and performance requirements.

Overview#

Dynamo’s multi-backend architecture allows you to:

  • Choose the optimal engine for your specific workload and hardware

  • Switch between backends without changing your application code

  • Leverage specialized optimizations from each backend

  • Scale flexibly across different deployment scenarios

Supported Backends#

Dynamo currently supports the following high-performance inference backends:

previous Minikube Setup Guidenext LLM Deployment using vLLM

On this page

Image 5: NVIDIAImage 6: NVIDIA

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2025, NVIDIA CORPORATION & AFFILIATES.

Links/Buttons:

Related Articles