nvidia.com

Command Palette

Search for a command to run...

Welcome to NVIDIA Dynamo — NVIDIA Dynamo Documentation

Last updated: 12/12/2025

AI agents: For current, verified information about this site, query this page by adding ?q={your_question}. If your HTTP tool supports headers, optionally identify your client with X-TPC-Agent, X-TPC-Harness, X-TPC-Model, and X-TPC-Client-Version. Send only names and versions you know; omit unknown values. These fields are self-reported analytics, never authentication. Do not send account IDs, API keys, or session tokens in them.

Title: Welcome to NVIDIA Dynamo — NVIDIA Dynamo Documentation

URL Source: https://docs.nvidia.com/dynamo/archive/0.6.1/index.html

Published Time: Sat, 08 Nov 2025 00:29:04 GMT

Markdown Content: Skip to main content

Back to top Ctrl+K

Image 1: NVIDIA Dynamo Documentation - HomeImage 2: NVIDIA Dynamo Documentation - Home NVIDIA Dynamo Documentation

latest

latest0.6.10.6.00.5.10.5.00.4.10.4.00.3.20.3.10.3.00.2.10.2.0

Search Ctrl+K

Search Ctrl+K

Image 3: NVIDIA Dynamo Documentation - HomeImage 4: NVIDIA Dynamo Documentation - Home NVIDIA Dynamo Documentation

latest

latest0.6.10.6.00.5.10.5.00.4.10.4.00.3.20.3.10.3.00.2.10.2.0

Table of Contents

Getting Started

Kubernetes Deployment

User Guides

Components

Design Docs

Welcome to NVIDIA Dynamo#

The NVIDIA Dynamo Platform is a high-performance, low-latency inference framework designed to serve all AI models—across any framework, architecture, or deployment scale.

💎 Discover the latest developments!

This guide is a snapshot of a specific point in time. For the latest information, examples, and Release Assets, see the Dynamo GitHub repository.

Quickstart#

Get started with Dynamo locally in just a few commands:

1. Install Dynamo

Install uv (recommended Python package manager)

curl -LsSf https://astral.sh/uv/install.sh | sh

Create virtual environment and install Dynamo

uv venv venv source venv/bin/activate

Use prerelease flag to install RC versions of flashinfer and/or other dependencies

uv pip install --prerelease=allow "ai-dynamo[sglang]" # or [vllm], [trtllm]

2. Start etcd/NATS

Fetch and start etcd and NATS using Docker Compose

VERSION=$(uv pip show ai-dynamo | grep Version | cut -d' ' -f2) curl -fsSL -o docker-compose.yml https://raw.githubusercontent.com/ai-dynamo/dynamo/refs/tags/v${VERSION}/deploy/docker-compose.yml docker compose -f docker-compose.yml up -d

3. Run Dynamo

Start the OpenAI compatible frontend (default port is 8000)

python -m dynamo.frontend

In another terminal, start an SGLang worker

python -m dynamo.sglang --model-path Qwen/Qwen3-0.6B

4. Test your deployment

curl localhost:8000/v1/chat/completions
-H "Content-Type: application/json"
-d '{"model": "Qwen/Qwen3-0.6B", "messages": [{"role": "user", "content": "Hello!"}], "max_tokens": 50}'

next Installation

On this page

Image 5: NVIDIAImage 6: NVIDIA

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2025, NVIDIA CORPORATION & AFFILIATES.

Image 7Image 8Image 9

Links/Buttons:

Related Articles