dynamo.nixl_connect.Device — NVIDIA Dynamo Documentation
Title: dynamo.nixl_connect.Device — NVIDIA Dynamo Documentation
URL Source: https://docs.nvidia.com/dynamo/latest/API/nixl_connect/device.html?userAgent=PromptingBot%2F1.0.0
Published Time: Tue, 14 Oct 2025 15:18:42 GMT
Markdown Content: Skip to main content
Back to top- [x] - [x]
Ctrl+K
NVIDIA Dynamo DocumentationSearch Ctrl+K
Search Ctrl+K
Table of Contents
Getting Started
Kubernetes Deployment
- Quickstart (K8s)
- Detailed Installation Guide
- Dynamo Operator
- Metrics
- Logging
- Multinode
- Minikube Setup
Components
Developer Guide
-
dynamo.nixl_...
dynamo.nixl_connect.Device#
Device class describes the device a given allocation resides in. Usually host ("cpu") or GPU ("cuda") memory.
When a system contains multiple GPU devices, specific GPU devices can be identified by including their ordinal index number. For example, to reference the second GPU in a system "cuda:1" can be used.
By default, when "cuda" is provided, it is assumed to be "cuda:0" or the first GPU enumerated by the system.
Properties#
id#
@property def id(self) -> int:
Gets the identity, or ordinal, of the device.
When the device is the HOST, this value is always 0.
When the device is a GPU, this value identifies a specific GPU.
kind#
@property def kind(self) -> DeviceKind:
Gets the DeviceKind of device the instance references.
Related Classes#
On this page
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact
Copyright © 2024-2025, NVIDIA CORPORATION & AFFILIATES.
Links/Buttons:
- Skip to main content
- document.write(
<img src="../../_static/nvidia-logo-horiz-rgb-wht-for-screen.svg" class="logo__image only-dark" alt="NVIDIA Dynamo Documentation - Home"/>); NVIDIA Dynamo Documentation - GitHub
- Installation
- Support Matrix
- Architecture
- Disaggregated Serving
- Examples
- Quickstart (K8s)
- Detailed Installation Guide
- Dynamo Operator
- Metrics
- Logging
- Multinode
- Minikube Setup
- Backends
- vLLM
- SGLang
- TensorRT-LLM
- Router
- Planner
- Pre-Deployment Profiling
- Load-based Planner
- SLA-based Planner
- KVBM
- Motivation
- KVBM Architecture
- Understanding KVBM components
- KVBM Further Reading
- LMCache Integration
- Dynamo Benchmarking Guide
- Planner Benchmark Example
- Health Checks
- Tuning Disaggregated Serving Performance
- Writing Python Workers in Dynamo
- Glossary
- #
- HOST
- GPU
- DeviceKind
- Connector
- Descriptor
- OperationStatus
- ReadOperation
- ReadableOperation
- RdmaMetadata
- WritableOperation
- WriteOperation
- Privacy Policy
- Manage My Privacy
- Do Not Sell or Share My Data
- Terms of Service
- Accessibility
- Corporate Policies
- Product Security
- Contact