sarman/dgx-spark-playbooks
1
0
Fork 0
mirror of https://github.com/NVIDIA/dgx-spark-playbooks.git synced 2026-04-22 18:13:52 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

chore: Regenerate all playbooks

Browse Source
This commit is contained in:
GitLab CI 2025-10-08 14:03:31 +00:00
parent ab2ca0fcf1
commit 332aaf1202
1 changed files with 4 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
nvidia/nim-llm/README.md
View File

@ -5,7 +5,7 @@
## Table of Contents
- [Overview](#overview)
- [Basic Idea](#basic-idea)
- [Basic idea](#basic-idea)
- [What you'll accomplish](#what-youll-accomplish)
- [What to know before starting](#what-to-know-before-starting)
- [Prerequisites](#prerequisites)
@ -17,7 +17,7 @@
## Overview
### Basic Idea
### Basic idea
NVIDIA Inference Microservices (NIMs) provide optimized containers for deploying large language
models with simplified APIs. This playbook demonstrates how to run LLM NIMs on DGX Spark devices,
@ -44,11 +44,11 @@ completions.
```bash
nvidia-smi
```
- Docker with NVIDIA Container Toolkit configured, instructions here: https://******.nvidia.com/dgx-docs/review/621/dgx-spark/latest/nvidia-container-runtime-for-docker.html
- Docker with NVIDIA Container Toolkit configured, instructions [here](https://******.nvidia.com/dgx-docs/review/621/dgx-spark/latest/nvidia-container-runtime-for-docker.html)
```bash
docker run -it --gpus=all nvcr.io/nvidia/cuda:13.0.1-devel-ubuntu24.04 nvidia-smi
```
- NGC account with API key from https://ngc.nvidia.com/setup/api-key
- NGC account with API key from [here](https://ngc.nvidia.com/setup/api-key)
```bash
echo $NGC_API_KEY | grep -E '^[a-zA-Z0-9]{86}=='
```