ZOYKUHot Board

bidual/awesome-dgx-sparkDocumentation

A curated list of tools, guides, playbooks, and resources for the NVIDIA DGX Spark (GB10 Grace Blackwell personal AI supercomputer).

Avis de repli linguistique :La documentation localisée n'est pas disponible. Affichage de la version originale officielle en anglais.
Installation rapide
git clone https://github.com/bidual/awesome-dgx-spark.git

Awesome DGX Spark Awesome

A curated list of awesome tools, guides, playbooks, and resources for the NVIDIA DGX Spark, the GB10 Grace Blackwell personal AI supercomputer.

DGX Spark is a desktop machine built on the GB10 Grace Blackwell Superchip (SM 12.1 / sm_121), with 128 GB of unified CPU+GPU memory. You can link two units over 200 Gb/s networking to run larger models. This list collects community projects for setting it up, serving models, fine-tuning, benchmarking, and day-to-day operation.

Platform essentials: aarch64 · CUDA 13.x · sm_121 · 128 GB unified memory · 200 Gb/s ConnectX-7

Contents

Official

  • NVIDIA/dgx-spark-playbooks - Step-by-step DGX Spark playbooks spanning vLLM, SGLang, llama.cpp, NVFP4 quantization, speculative decoding, cuTile kernels, NCCL, and direct or switch-connected multi-Spark clusters.
  • NVIDIA/dgx-spark-skills - Agent skill from NVIDIA's Sync team for DGX Spark and partner GB10 systems, with workflows for identification, troubleshooting, known issues, playbooks, Sync, Field Diagnostics, and support.

Setup & Configuration

  • a1exus/sparky - Self-hosted DGX Spark LLM stack, vLLM, Ollama, and a llama.cpp router serving every cached GGUF behind Traefik, with mDNS, Cloudflare Tunnel, and Tailscale ingress.
  • Albatross1382/onnxruntime-aarch64-cuda-blackwell - ONNX Runtime 1.24.4 CUDA shared libraries for sm_121 on aarch64, loaded through the Rust ort crate or dlopen.
  • aliaholes/gb10-field-notes - Dated field notes from two GB10 boxes, cudaMalloc tracking MemFree rather than MemAvailable, needrestart auto-restarting CUDA services, and a 513 MHz degraded clock that survives reboot.
  • botAGI/AGmind - One-command private RAG stack for DGX Spark, Dify with vLLM, Weaviate, RAGFlow, and Docling across 30+ containers, plus two-node clustering over 200 Gb/s QSFP.
  • christopherowen/dgx-spark-memory-saver - Patch for nvidia-uvm that packs GPU page tables on 64 KiB DGX Spark kernels, 3.03 GiB recovered versus stock 64 KiB and about 1.8 GiB per node over 4 KiB.
  • Chrizz-lab/GB10-Agentig-Coding-Framework - Agentic coding stack for DGX Spark with dual-vLLM Qwen3 and CrewAI orchestration.
  • csabakecskemeti/dgx-spark-community-playbooks - Community playbook collection for DGX Spark, covering dual-Spark RDMA inference, heterogeneous RoCE clustering, and local Claude Code.
  • Entrpi/dgx-spark-serving-mode - Three-state serving-mode script for DGX Spark that pares GNOME and maintenance timers down to multi-user.target for 10-15 GB more unified memory.
  • Fulton-Engineering-Services/dgx-spark-wheels - Wheel index for GB10 covering packages with no upstream aarch64 build: flash-attn, sageattention, flashinfer, and torch 2.13 on CUDA 13.3, each kernel-launch verified.
  • getainode/ainode - Self-hosted inference API and browser workspace for chat and fine-tuning on NVIDIA GPU nodes, default engine images for GB10, token-joined clusters with tensor-parallel launch.
  • GuigsEvt/dgx_spark_config - Source-build guide for LLVM, Triton, and PyTorch 2.9.1 against sm_121, with release wheels and ~1.5x on 8192 FP16 GEMM versus the stock cu130 build.
  • HendrikSchoettle/ragflow-dgx-spark - Build and deploy pipeline for RAGFlow v0.24.0 on DGX Spark aarch64, with a source-built onnxruntime-gpu wheel for sm_121 and multilingual OCR.
  • install-safe-press/gb10-playbooks - Chinese-language walkthrough of NVIDIA's official GB10 playbooks covering the basics and AI-agent sections, with hardware, DAC cabling, and Dell switch-config notes of its own.
  • JetBrains-Hardware/spark-setup - Remote vLLM deploy scripts for Qwen3-Coder-Next, GPT-OSS 120B, Nemotron 3 Super NVFP4, and Gemma 4, Qwen3.6-27B-FP8 with MTP holding 14.4 tok/s single stream at 200k.
  • jschmied/dgx-spark-setup-guide - End-to-end DGX Spark guide: llama-server router mode, key-only SSH, DCGM monitoring, SWE-bench evals, and vLLM appendices where MTP-3 takes Qwen3.6-35B-A3B NVFP4 from 73 to 102 tok/s single-stream.
  • m9h/neurocontainers-arm - Prebuilt causal-conv1d wheel plus four published neuroimaging containers built against NGC PyTorch CUDA 13, with locally built FreeSurfer 8.2.0 packages inside two of them.
  • martimramos/dgx-spark-ml-guide - Troubleshooting playbook for PyTorch on GB10, 16 numbered failures with an error-to-fix table, from cu128 nightly wheels to aarch64 mmcv builds and NVRTC symlinks.
  • mARTin-B78/dgx-spark_lite-llm_llama-swap_vllm_llama-cpp_ollama - Multi-engine LLM stack for DGX Spark with llama-swap idle eviction behind a LiteLLM gateway, plus a harness pairing llama-benchy with a 69-scenario tool-calling bench.
  • milo-the-machine/spark-kernel-bench - Install-and-test study of DGX Spark kernels 7.0.0-1019 and 7.0.0-1024 against 6.17 on four nodes, where 1019 without kho=off failed 12 of 12 NCCL runs.
  • natolambert/dgx-spark-setup - Training setup for CUDA 13.x on aarch64, cu130 vLLM wheels, SDPA over flash-attn, swap-off OOM guards, and profiled SFT, DPO, and LoRA batch ceilings.
  • seitzbg/onnxruntime-gpu-sm121-aarch64 - Prebuilt onnxruntime-gpu 1.27.1 aarch64 wheel, CUDA 13.x execution provider for sm_121, 7.3x over CPU on GB10.
  • Sggin1/DGX-SPARK - Dated GB10 lab notes, TurboQuant 3-bit KV cache at 240K context, dual-Spark 195 Gb/s RDMA, and sm_121a FP4 SASS evidence.
  • Th0rgal/cuda-blackwell-carry-bug - Repro for a PTXAS bug that drops the carry flag between separate inline-asm blocks on GB10 sm_121, with a Docker harness and a 128-bit reference path to compare against.
  • timothystewart6/ubuntu-gb10 - Ubuntu 24.04 setup for GB10 in place of DGX OS, Ansible roles for NVIDIA driver, CUDA 13.x, DOCA-OFED, dual-node NCCL, and a 33-check read-only verify playbook.
  • tonyd2wild/DGX-Spark-Hard-Poweroff-Fix - Diagnosis of GB10 log-less hard power-offs as an embedded-controller cut, fixed by a 2200 MHz clock cap and page-cache drops at 5% decode cost.

Inference & Serving

vLLM

  • 0xSero/deepseek-v4-flash-0731-spark-sparkinfer - DeepSeek-V4-Flash-0731 on one DGX Spark via EXL3 and SparkInfer sparse MLA, 38.1 tok/s median c1 code decode at a 262K limit, 432-byte NVFP4 KV disabled.
  • AEON-7/vllm-ultimate-dgx-spark - DGX Spark vLLM 0.29.0 image compiled for sm_121a with DSpark quantized Markov heads, DFlash 2 at 3.39x single-stream on Qwen3.8-27B, and Triton NVFP4 KV cache.
  • airawatraj/dgx-spark-nemotron-super-agent - Nemotron-3-Super-120B agentic stack on DGX Spark scoring 93 of 100 on tool-eval-bench, with spark-arena 23.7 tok/s.
  • albond/DenseSpark-Qwen3.8-27B - Qwen3.8-27B INT4 AutoRound on one DGX Spark with vLLM 0.27.1 and sm_121 kernels, MTP drafting, 49.1 tok/s at one request and 260.2 at 16.
  • albond/SingleSpark-Qwen3.8-Flash-Next - Qwen3.8-Flash-Next on one DGX Spark from a 101 GiB four-bit checkpoint with the n-gram table kept resident, 43.34 tok/s median single stream at 65,536 context.
  • Anemll/dspark-vllm-gx10 - Two-node GB10 port of DeepSeek-V4-Flash DSpark to vLLM 0.25.1 with nvfp4_ds_mla KV format and a b12x MXFP4 MoE backend, 48.5 tok/s decode at TP=2.
  • atcuality2021/vllm-gb10-gemma4 - Vendored ManthanQuant 3-bit Lloyd-Max KV-cache compression patched into vLLM's attention backends for Gemma 4 on GB10, 5.12x smaller KV at ~0.978 cosine, quantized in NumPy on the Grace CPU.
  • Avarok-Cybersecurity/dgx-vllm - vLLM image for DGX Spark, tag v22 from February 2026, NVFP4 through a software E2M1 conversion and Marlin backends, ~42 tok/s on Qwen3-Next-80B-A3B-Instruct-NVFP4, 20% over AWQ INT4.
  • bjk110/spark_vllm_docker - vLLM recipes from one DGX Spark at TP=1 to two over 200 Gb/s RoCE at TP=2, with digest-pinned DeepSeek-V4-Flash-0731 images and rollback presets.
  • blazux/qwen3.8-Flash-DGX - Qwen3.8-Flash-Next NVFP4 on one GB10 with the 48 GiB PLE table mmapped from NVMe, fixing a prefix-cache hit that restored an all-zero Mamba state and a non-deterministic sparse-attention top-k.
  • dedene/Ornith-1.5-122B-DGX-Spark - Docker Compose stack for Ornith-1.5-122B-NVFP4 on one DGX Spark under vLLM with MTP 2, 38.0 tok/s weighted decode and 2,078 prefill at 40K, with BFCL, AgentDojo, and GPQA scores.
  • EmilHaase/DGX-Spark-VLLM-Hydra-Manager - Menu launcher for several vLLM models on one DGX Spark with per-model unified-memory shares and a rollback-capable DeepDocker image as the recommended backend.
  • eugr/spark-vllm-docker - vLLM Docker for one to eight DGX Sparks, native PyTorch distributed by default with Ray opt-in, and 44 run-recipe.sh YAML recipes, Qwen3.8-Flash-Next-NVFP4 solo to GLM-5.2-NVFP4 on eight nodes.
  • gitcommit90/glm-5.3-one-spark - GLM-5.3-Flash EXL3 2.05 bpw on one DGX Spark under vLLM TP1 with DFlash2 K5, 40.1 tok/s on code and 29.9 on prose at 262K context.
  • jordanovski/overdrive - Web console and CLI for launching concurrent vLLM containers on DGX Spark, with preflight GPU-memory admission control and a SWE-bench page comparing resolution rates.
  • joshhu/meetaclawtaipei - Gemma-4-31B-IT, Qwen3.6-27B, and Nemotron-3-Nano-30B-A3B in NVFP4 as three concurrent vLLM services on one DGX Spark, started in sequence with drop_caches to avoid OOM.
  • MiaAI-Lab/Nemotron-Labs-3-Puzzle-75B-DGX-Spark - Nemotron-Labs-3-Puzzle-75B-A9B NVFP4 hybrid Mamba MoE on one DGX Spark, vLLM 0.24 launcher with aarch64 NCCL and FlashInfer cuda_ipc patches, 256K context, MTP k=3.
  • MiaAI-Lab/Ornith-1.5-35B-A3B-DGX-Spark - Ornith-1.5-35B-A3B NVFP4 with in-checkpoint MTP on one DGX Spark, 86.3 to 440 tok/s at 24 streams, plus two b12x patches for CUDA-graph capture.
  • MiaAI-Lab/Qwen3.8-Flash-Next-Single-DGX-Spark - Qwen3.8-Flash-Next NVFP4 on one DGX Spark under vLLM with the PLE table packed and memory-mapped, 48.7 tok/s prose single stream and 162.9 at eight on 512k YaRN.
  • mouwp2026/Qwen3.8-Flash-Next-128GB-GB10-68toks-for-single-stream - Qwen3.8-Flash-Next on one GB10 with the 51B PLE table product-quantized to 1.5 GB and a 4-bit reduced-vocabulary MTP head at K=6, 49.3 to 68.6 tok/s single stream.
  • mrexodia/Kolibri-1-vLLM-DGX-Spark - Kolibri-1 FP8 on one DGX Spark under vLLM 0.29 with Aleph Alpha's inference plugin, 262,144-token context, 42.0 tok/s generation and 97% prefix-cache hits in a pi coding-agent run.
  • omnia-projetcs/spark-dgx - Interactive vLLM Docker launcher for DGX Spark, 22 preset model configs from single-node NVFP4 to TP=4 Ray clusters, 10 with measured TTFT and concurrency tables.
  • prestonlogan/Flint-vLLM-Single-DGX-Spark - Flint 39.8B-A2.5B MoE as NVFP4 GGUF on one DGX Spark under vLLM with vendored PR #62938 and an sm_121 gate patch to stock Marlin layers, 85 tok/s single stream.
  • prestonlogan/qwen3.8-flash-next-fp4-local-spark - NVIDIA's Qwen3.8-Flash-Next-FP4-Local on one DGX Spark with a vLLM decode plugin of Triton GEMV kernels, greedy prose from 36.7 tok/s on the card recipe to 55.0-55.6.
  • pst2154/dory-vllm-spark - vLLM overlay for NVIDIA Nemotron-Labs Dory1.0-4B NVFP4 on GB10 with per-request loop counts and n-gram draft caps, 116 tok/s single stream at one loop, prompt-dependent.
  • salient-data/qwen38-next-dgx-recipe - NVIDIA's Qwen3.8-Flash-Next NVFP4 on one DGX Spark from a pinned vLLM nightly plus 14 patches, 71.3 tok/s median single stream on tonyd2wild's 40-prompt harness, GSM8K 99/100.
  • Sapid-Labs/vllm-spark-arena - Crowd-optimization arena for vLLM on sm_121, scoring sitecustomize.py patches over a pinned wheel as paired ratios, gated on byte-identical output and a held-out timed speedup.
  • sayyidfareed/qwen3.8-flash-next-dgx-spark-1m - Qwen3.8-Flash-Next NVFP4 at a validated 989,801-token request on one ASUS GX10, clean PLE pages released by MADV_DONTNEED watermark, 5/5 needles at 26.7 tok/s single stream.
  • sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK - Nemotron 3.5 Super VL 120B-A12B NVFP4 on one DGX Spark under vLLM with a 7-token LiLiCorr drafter, 48 tok/s greedy at one user and 189 aggregate at 32.
  • sojufx/Qwen3.6-35B-NVFP4-DGX-Spark-Recipe - Unsloth Qwen3.6-35B-A3B-NVFP4 on one DGX Spark under vLLM 0.27.2 with RedHatAI DSpark K=8, 92.8-110.9 tok/s single stream and 309.8-368.9 aggregate at eight sessions.
  • spark-arena/sparkrun - One-command launcher for vLLM, SGLang, and llama.cpp on one or more DGX Sparks, where --tp 2 means two hosts over auto-detected RDMA, plus git-based recipe registries.
  • stefanoferi/codendum - Self-hosted OpenCode backend on one DGX Spark with vLLM, Qwen3-Coder-30B-A3B-FP8 and a per-user-key nginx proxy, 40 simulated students at 110-150 tok/s aggregate.
  • sudoingX/dgx-spark-ling - Official Ling-3.0-flash INT4 on one DGX Spark under vLLM with its MTP layer, 38.7 tok/s against 35.2 for the community GGUF, but 7.9 against 33.6 at 45K context.
  • sxuff/nanbeige-4.3-33b-gb10 - Nanbeige4.3-33B NVFP4 on one DGX Spark under vLLM 0.32 with a Nanbeige4.1-3B draft at k=4, 20.6 tok/s single agent and 213 total across 8 on short prompts.
  • timothystewart6/vllm-gb10 - Prebuilt GHCR vLLM image for GB10 (sm_121a) with NCCL and FlashInfer built from source, pinned by SHA, digest or version, and latest promoted only after a four-model verification gate.
  • tonyd2wild/Qwen3.8-Flash-Next-NVFP4-DGX-Spark - NVIDIA's own Qwen3.8-Flash-Next NVFP4 checkpoint byte for byte on one DGX Spark, the 47.68 GiB PLE table left on NVMe and gathered 16 rows per token, 43.9 tok/s median.
  • vcruz305/DSV4.1-Flash-1017-EXL3-Spark-recipe - DeepSeek-V4.1-Flash-1017 SAGE EXL3 1.62 bpw on one DGX Spark under vLLM with 1,418 cold experts read through an ATS alias file, 35.6-36.3 tok/s single stream, needle found at 518K.
  • vcruz305/MiniMax-M3.1-Flash-EXL3-Spark-recipe - MiniMax-M3.1-Flash SAGE EXL3 2.15 bpw on one DGX Spark under vLLM with the vllm-exl3 plugin and q4 KV, 48K context, 24.37 prose and 28.97 code tok/s single stream.
  • yuanlin2004/chisel-spark-recipes - Qwen3.8-27B sparkrun recipes for one DGX Spark, NVFP4 with DFlash2 plus a lossless GDN state-replay vLLM plugin, 65.1 tok/s single-user decode, 99.3-101.2% of BF16 on four tasks.
  • yuyuyUuuuuuuuuuuu/vllm-hybrid-kv-nvme-spill - vLLM KV connector for GLM-5.3-Flash on two GB10 that restores hybrid MLA and Mamba state from NVMe, 91% fewer re-read tokens after a restart in a replay rig.

llama.cpp

  • 0xBakeer/qwen38-flash-next-spark - Qwen3.8-Flash-Next on one DGX Spark with the 51B lookup table on SSD, in two profiles that differ by 2x: 88 tok/s rewriting a file against 32 on prose.
  • croll83/llama.cpp-dgx - Deprecated llama.cpp fork for DGX Spark, kept for its TurboQuant TQ3_0 KV cache and weight kernels, which upstream does not expose.
  • dedene/Nanbeige4.3-33B-DGX-Spark - Nanbeige4.3-33B Q6_K on one DGX Spark under stock llama.cpp with a vocab-padded Nanbeige4.1-3B drafter, 7.3 to 12.6 tok/s single request and 26.5 on tool calls.
  • dedene/Recursive-Flint-DGX-Spark - Docker Compose stack for Recursive Flint NVFP4 GGUF on one DGX Spark under stock llama.cpp b11804, 91.9 tok/s weighted decode and 2,490 prefill at 27K, with agent benchmark scores.
  • gitcommit90/angelslim-hy3-iq1m-mtp-dgx-spark - AngelSlim Hy3 IQ1_M GGUF with MTP drafting on one DGX Spark through patched llama.cpp, 100K context, 18-19 tok/s on prose and 26-30 on code and JSON.
  • gitcommit90/step37-flash-iq4xs-dgx-spark - Step-3.7-Flash IQ4_XS GGUF on one DGX Spark under StepFun's llama.cpp branch with q4_0 KV, decode from 27.24 tok/s empty to 9.92 at a filled 262,144 context.
  • marknx/flash-next-gguf-tools - Qwen3.8-Flash-Next GGUF split across one DGX Spark and an RTX 5090 over 10 GbE, 140 tok/s aggregate at eight streams that OOM-kill the single box, plus converter fixes.
  • Sapid-Labs/llamacpp-spark-arena - Crowd-optimization arena for llama.cpp CUDA kernels on sm_121, with a thermal gate, alternating baseline and candidate runs, and referee-verified held-out speedup.
  • shamily/gemma4-llama-dgx-spark - Dockerized llama.cpp for all four Gemma 4 models on GB10, benchmarked at 69.9 tok/s tg128 for the 26B-A4B MoE against 11.0 for the dense 31B.
  • sxuff/nemotron-3.5-bolt-gb10 - Nemotron 3.5 Bolt 74B-A9B 24GB IQ2 GGUF on one DGX Spark under llama.cpp with a 7-draft LiLiCorr drafter, 80.4 tok/s greedy against 38.3 without.
  • sxuff/ornith-1.5-122b-gb10 - Ornith-1.5-122B Q6_K GGUF on one DGX Spark under llama.cpp with its built-in MTP head, 29.2 to 30.8 tok/s on code and math but 21.3 on prose.
  • sxuff/ternary-bonsai-2-27b-gx10 - Ternary-Bonsai-2-27B on one DGX Spark under the PrismML llama.cpp fork, PTQ1_0 (1.75 bpw) at 34.21 tok/s tg128 in 5.53 GiB, build pinned to commit 1a07bfa.
  • Weschera/GLM-5.3-Flash-Unsloth-1x-DGX-Spark - GLM-5.3-Flash UD-IQ3_XXS GGUF on one DGX Spark under Unsloth's llama.cpp fork, MTP n=2 at 20.8 tok/s against 15.5 without, 64K context.

SGLang

  • 0xBakeer/ling3-flash-spark - Ling-3.0-flash MXFP4 on one DGX Spark pairing the Humming MoE backend and an online FP8 LM head with DSpark drafting, with the cookbook and notebook configs selectable for comparison.
  • 0xWhiteMage/qwen3.8-27b-kearuga-sglang-dgx-spark-dflash2 - Qwen3.8-27B Kearuga target with a distilled DFlash 2 drafter on SGLang for one DGX Spark, 35.33 tok/s at C1 and 108.90 at C4, +14.5% and +10.8% over stock.
  • anubhavgupta/Qwen3.6-35b-SGLang-DGX-Spark - Unsloth Qwen3.6-35B-A3B-NVFP4 on one DGX Spark under SGLang with DFlash2 block 8, 120.1 tok/s mean single stream, plain decoding ahead above 10-13 streams.
  • BTankut/dgx-spark-sglang-moe-configs - Tuned Triton MoE configs for GB10's 101,376-byte shared memory limit, where SGLang defaults need 147,456 and EAGLE crashes, GLM-4.7-FP8 at 20-27 tok/s on four nodes.
  • dedene/Clover-35B-A3B-DGX-Spark - Clover-35B-A3B-Preview block-diffusion MoE on one DGX Spark via an unmerged SGLang PR with kernels enabled for sm_121, 84 tok/s code and 33 prose single request.
  • hasso5703/alzeo - One-command GB10 installer that pins nine SGLang and vLLM lanes in one 128 GB pool, Qwen3.8-27B NVFP4 at 71.4 tok/s greedy median via DFlash2, plus image and video lanes.
  • InquiringMinds-AI/longcat-next-multimodal - LongCat-Next 75B-A3B any-to-any multimodal through one SGLang process on a single GB10, image generation and voice-clone TTS on OpenAI endpoints at w8a8_int8 after 4-bit collapsed both.
  • mark-ramsey-ri/sglang-dgx-spark - 1-to-N DGX Spark launch scripts on the v0.5.10 cu130 image, tensor parallel sized to node count, verified on one and two nodes over RDMA, 3+ switched fabric untested.
  • MiaAI-Lab/Nemotron3.5-Lightning-DGX-Spark-RTX-5090-6000-PRO - Nemotron 3.5 Lightning 30B-A3B NVFP4 with its DSpark draft model on one DGX Spark via SGLang, 4.93M-token KV pool, 48 max concurrent, up to 1M per request.
  • MiaAI-Lab/Qwen3.8-27B-SGLang-DGX-Spark - Qwen3.8-27B NVFP4 on one DGX Spark with EAGLE/MTP, DSpark and DFlash2 as measured swap-in modes, GDN in bf16 and the scheduler pinned to the X5 cores.
  • pangoleen/qwen3.8-27b-dgx-spark-dflash2 - Qwen3.8-27B NVFP4 on one DGX Spark with a DFlash2 draft budget of 16, 64-78 tok/s single stream on code against ~30 on chat, 387 aggregate at 32 streams.
  • robbiemu/dgx-spark-inference - SGLang services on one DGX Spark under systemd with per-role memory budgets, refusing a launch that will not fit, on a digest-pinned v0.5.14-cu130 runtime.
  • scottgl9/sglang-spark-gb10-optimizations - SGLang fork that routes NVFP4 through Marlin FP4 where CUTLASS returns zeros on sm_121, Qwen3.5-122B-A10B at 43-45 tok/s with ~90% MTP acceptance.
  • ubehera/sglang-spark - SGLang patch stack for DGX Spark with an sm_121a-only sgl-kernel 0.4.4 wheel, model-agnostic TP=2 launch recipes at NEXTN k=3, and a systemd watcher that stops wedged nodes.
  • Weschera/Qwen3.8-27B-NVFP4-DFlash2-DGX-Spark - Qwen3.8-27B NVFP4 with DFlash2 on one DGX Spark, digest-pinned, where a boot-time fp8_gemm autotune race decides between 42 and 33 tok/s for the process lifetime.

Other Engines

  • 0xBakeer/deepseek-v41-flash-spark - DeepSeek-V4.1-Flash on one DGX Spark in a plain-PyTorch engine with routing-ranked expert keep-sets, 24.3-36.6 tok/s by workload at 44% keep, above the reliable 39% default.
  • 0xBakeer/TandemLLM - Inference engine for one DGX Spark serving seven models, StairCut draft-tree sizing Qwen3.8-27B NVFP4 to 49.89 tok/s single request, lookup store off, against 13.69 plain greedy.
  • aien-dev/CUDApp - GPU toolchain and runtime for GB10 with its own reverse-engineered sm_121 instruction encoder and an ioctl client to NVIDIA's open kernel module, no CUDA toolkit or libcuda, research stage.
  • allenh1/sparkflash - Rust and CUDA inference server for DeepSeek-V4.1-Flash at TP4 on four DGX Spark with sm_121a kernels, 131.8 tok/s greedy code single stream, 80 sampled, 6,400 tok/s prefill at ~32K.
  • antirez/ds4 - DwarfStar C inference engine for DeepSeek, GLM and Qwen3.8 Flash Next with a make cuda-spark target, DeepSeek V4 Flash Q2 prefill above 820 t/s through 65K, decode 18.1 to 13.8.
  • Arminova/DeepSeek-V4-Flash-Single-DGX-Spark-TensorFold - DeepSeek-V4-Flash-0731 REAP EXL3 on one DGX Spark through a DeepSeek-V4 family patched into TensorFold's Zig engine, 50.7 tok/s code and 32.2 behind a 247K prompt.
  • ashhart/TensorFold - Zig LLM server for Apple Silicon and NVIDIA GPUs where accepted drafts must equal plain decoding, GLM-5.3-Flash XSFP4 at a 524,288-token window on two GB10, 1,048,576 on three.
  • Avarok-Cybersecurity/atlas - Pure Rust and CUDA inference engine in one 75 MB binary with GB10 as verified target, ahead of vLLM 0.27.1 at C=1, 2, 64, and 128 on Qwen3.8-27B NVFP4.
  • Baekpica/ds4-dfm-rs - Rust-host continuation of ds4 with DGX Spark as release reference and recorded gates per model artifact, Qwen3.8 Flash Next Q5 at 1,323 prefill and 28.93 decode tok/s with MTP 2.
  • blake-snc/sm121-kernels - Hand-written PTX kernel library for sm_121 in 259 files, covering flash attention, GEMM, Gated DeltaNet, and MoE, driver-only via cudarc with FP8 attention at ~108 TFLOPS.
  • BobClawblaw/unlimited-ocr-2-gb10 - Baidu's Unlimited-OCR-2 bf16 on one GB10 via a TensorFold CUDA port for sm_121, 131,072-token window, ~116 tok/s page decode, text matching the publisher's reference outside box coordinates.
  • calico88x/DGX-Model-Manager - Control plane for managing Ollama, SGLang, vLLM, llama.cpp, LocalAI, and ComfyUI on DGX Spark, with roles, API tokens, and Hugging Face cache inventory.
  • cuylerstuwe/glm-53-flash-rust - Rust inference service for GLM-5.3-Flash on four GB10 with EXL3 4 bpw experts and FP8 or BF16 non-expert weights, 63.0 tok/s prose and 116.0 code on RigMark.
  • dedene/DeepSeek-V4.1-Flash-1017-DGX-Spark - DeepSeek-V4.1-Flash-1017 as a ~1.6-bit VQ GGUF on one DGX Spark under ds4-dfm-rs, 39.4 tok/s weighted decode, with BFCL and AgentDojo scores.
  • dolf3131/dgx-spark-llm-serving - Qwen3.8-Flash-Next on one DGX Spark as EXL3 4.05 bpw under TensorFold, 62.9 tok/s English single stream, five 262K-context slots with NVMe spill, older vLLM NVFP4 lane kept.
  • edisonchan/Qwen3.8-Flash-Next-NVFP4-Windows-ARM64 - Windows 11 port of MiaAI-Lab's Qwen3.8-Flash-Next NVFP4 TensorFold recipe for GB10, an MSVC build without Docker, model load cut from 257 s to 71 s.
  • eelgaev/Legion - Rust inference engine for MoE models on DGX Spark running GGUF and NVFP4 safetensors as shipped, Qwen3.8-Flash-Next NVFP4 at 172.1 tok/s for 16 users against vLLM 0.33.0's 150.3.
  • fly9i/spark-engine - From-scratch Rust and CUDA engine serving GLM-5.3-Flash on two DGX Spark, DeepSeek-V4.1-Flash on three, and Qwen3.8-Flash-Next on one, 52.9 tok/s GLM prose at c1.
  • fortil/slotstream-spark - CUDA port of slotstream for Qwen3.8-Flash-Next on one DGX Spark, routed experts streamed from NVMe into a shrinkable unified-memory pool, 29.37 tok/s median decode.
  • HawkBearPig/dgpp - C++/CUDA inference engine for one, two, or four DGX Spark with tensor parallelism over RoCE, GLM-5.3-Flash NVFP4/FP8 C1 decode at 31-37 tok/s on two and 59-65 on four.
  • jdaln/dgx-spark-inference-stack - Docker serving stack for a single DGX Spark with on-demand model loading, automatic idle shutdown, and a unified API gateway.
  • kindlingai/gr8 - From-scratch CUDA engine for full GLM-5.3 on three, four, or six DGX Spark with no vLLM, PyTorch, or NCCL at serve time, 51.7 tok/s code at TP=4.
  • kshetrajna12/sparkstation - Headless control plane for DGX Spark model fleets with profile-driven placement over vLLM and SGLang, unified-memory admission control, and LiteLLM gateway sync.
  • lrozewicz/vLLM-Moet-GB10 - vLLM-Moet fork for one GB10 running GLM-5.3-Flash at ~42 tok/s on code with DFlash2 and DeepSeek-V4-Flash-0731 at ~21, via 2-bit expert planes plus an FP4 delta tier.
  • mark-ramsey-ri/trt-dgx-spark - TensorRT-LLM serving for 1 to N DGX Spark with the aarch64 nvcr 1.2.1 container and TP set by node count, verified on 1 and 2 nodes.
  • MiaAI-Lab/exllamav3 - ExLlamaV3 fork that builds on aarch64 GB10, with NVFP4 and FP8 paged-attention KV at about 3.5x the context per GB of fp16, plus DFlash2, DSpark, and MTP drafting.
  • MiaAI-Lab/Nemotron-3.5-Bolt-TensorFold-DGX-Spark - Nemotron-3.5-Bolt-74B-A9B-24GB on one DGX Spark through a hand-written CUDA lane backend in TensorFold with LiLiCorr drafts, 73.7 tok/s prose and 137.3 code greedy at one stream.
  • MiaAI-Lab/Ornith-1.5-122B-TensorFold - Ornith-1.5-122B EXL3 4 bpw on one DGX Spark under TensorFold's Zig engine plus 27 EXL3 patches, 52.6 tok/s prose and 83.3 code single stream with DFlash2.
  • MiaAI-Lab/Qwen3.8-Flash-Next-Single-DGX-Spark-TensorFold - NVIDIA's Qwen3.8-Flash-Next-FP4-Local on one DGX Spark under TensorFold's Zig engine at 262,144 tokens, 46-55 tok/s prose and 67.9 code single stream, INT4-AutoRound cut optional.
  • plotarmordev/Nemotron-3.5-Super-VL-Single-DGX-Spark-TensorFold - Nemotron-3.5-Super-VL-120B-A12B-NVFP4 on one DGX Spark under TensorFold 1.1.0 plus two patches, 53.91 tok/s code decode against 44.84 on stock 1.0.12 with identical replies.
  • r0b0tlab/glm53-flash-exl3-exllamav3-gb10 - ExLlamaV3 and TabbyAPI runtime for GLM-5.3-Flash EXL3 2.25 bpw with DFlash2 on one GB10, a fail-closed memory guard, and 259,993-token retrieval at 262,144 context.
  • r0b0tlab/minicpm-v47-exl3-exllamav3-gb10 - MiniCPM-V-4.7-35B-A3B EXL3 6.08 bpw on one GB10 under an ExLlamaV3 fork, 60 tok/s greedy plain and 161 with DSpark drafting, slower than plain at 128K.
  • rdaum/eider - Rust and CUDA inference server for sm_121 NVFP4 with no tensor runtime, Qwen3.8-Flash-Next with its 51B PLE table paged from NVMe at ~300 tok/s uncached prefill, ~13 MTP decode.
  • rdoiron/mimo-mods-for-dgx-spark - Ten vLLM runtime patches for MiMo-V2.5 on sm_121a, with a CUTLASS block-FP8 bypass and a backported tool-call corruption fix (PR #42969).
  • sf-stav/veloGB10 - Rust and CUDA inference engine built only for GB10 with bitwise-lossless MTP, Qwen3.8-Flash-Next EXL3 at 137 tok/s on one machine and 221 on four, pure-code decode.
  • sixteen-miles-labs/sparklab - GB10-only inference runtime for one DGX Spark with NVMe-backed MoE expert banks, GLM-5.3 753B at 1.29 decode tok/s and DeepSeek V4.1 Flash 552B at 1.05, both experimental.
  • sxuff/qwen38-flash-next-flare - NVIDIA's Qwen3.8-Flash-Next-FP4-Local on one DGX Spark under a patched Flare build with eight-agent speculation and oldest-first prefix eviction, 83.0 tok/s total at eight agents.
  • Th0rgal/dgx-spark-router - Stdlib-only OpenAI-compatible router swapping one chat model at a time across vLLM NVFP4, llama.cpp GGUF, and SparkLab NVMe expert streaming, plus always-on vLLM ASR.
  • xangel82/DS4-GB10-GX10-DSpark-CUDA - DS4 fork for DeepSeek-V4-Flash on one GB10, frozen September 2026, lossless DSpark and HybridLC at 24-26 t/s on tool calls against the original 13, 900-953 t/s prefill.

Fine-tuning

  • albond/DGX_Spark_Unsloth_Lossless_Speedup - Training wizard for GB10 whose GatedDeltaNet fast path via flash-linear-attention and causal-conv1d gives 7.67x LoRA and 8.35x full FT over stock Unsloth on Qwen3.5-2B, loss bit-identical within BF16.
  • alicankiraz1/DGX-Spark-Asus-Ascent-Nvidia-GB10-SFT-Finetuner - Interactive no-code CLI for LoRA, QLoRA, or full SFT on DGX Spark, with dataset-format conversion, adapter merge, and Hub upload.
  • belambert/miles-dgx-spark - Non-Docker Miles install for one DGX Spark with Transformer Engine patched from FA4 to FA2, GRPO lifting Qwen3.5-2B on MATH-500 from 0.336 to 0.790 in 60 rollouts.
  • DJLougen/axoFast - Axolotl QLoRA recipe for GB10 with the sm_121a ptxas fix, flash-attn2, and Liger, 1.83x over naive and 82-86% of Unsloth's throughput in less memory.
  • haven-jeon/unsloth-vllm-gb10 - Unsloth training and vLLM inference Docker image for DGX Spark GB10 with source-built xformers and Triton.
  • JanneckGit/slm-agentic-training-pipeline - LoRA SFT then GRPO/verl for a Qwen3-4B tool agent on one GB10, verifier-gated synthetic trajectories over 48 task templates, with sm_121 flags where FA2 fails the actor forward.
  • kreuzhofer/dgx-spark-unsloth-qwen3.5-training - BF16 LoRA on Qwen3.5-35B-A3B without quantization, eager per-shard CUDA loads and page-cache eviction that cut peak unified memory from 134 GB to 72 GB.
  • NvMayMay/nvfp4-lora-spark - LoRA trained on the served NVFP4 weights of a 100B+ MoE on one GB10, with a serve-time logprob check that catches no-op adapters.
  • priyanlc/nemotron-finetuning - Nemotron 3.5 Lightning 30B-A3B LoRA on one DGX Spark in NVIDIA's AutoModel 26.08 container in about 24 minutes at 62 GiB, HellaSwag acc_norm 0.644 to 0.671.
  • PromtEngineer/smoldataenvs-grpo-spark - GRPO of Qwen3.5-4B on SmolDataEnvs data-analysis tasks on two DGX Spark with a strict-checker reward, 51.8% to 58.4% on a 394-task held-out exam.
  • ubehera/finetune - Unsloth LoRA fine-tune run on GB10 with five idempotent in-venv hotfixes and a committed perplexity table, 30.3 base to 14.3 after five epochs.
  • vaishaks/smallayallm - Malayalam LoRA fine-tune of Gemma 4 12B on one DGX Spark, run in the vLLM image after the pip torch wheel's bf16 GEMM measured 3.6 against 28.7 TFLOPS.
  • waybarrios/dgx-spark-finetune-llm - Work-in-progress LoRA pipeline on DGX Spark, Transformer Engine NVFP4 or MXFP8 training, modelopt NVFP4 export, and TensorRT-LLM serving, with SmolLM3-3B as default.

Quantization & NVFP4

GB10's Blackwell architecture supports NVFP4 (4-bit floating point) in hardware. It runs faster than INT4 at similar quality.

Models & Benchmarks

  • albond/DGX_Spark_Qwen3.5-122B-A10B-AR-INT4 - Qwen3.5-122B-A10B on DGX Spark, tuned from 28.3 to 52 tok/s (+82%) with a hybrid INT4+FP8 checkpoint and an INT8 LM head.
  • Avarok-Cybersecurity/atlas-recipes - Recipe corpus for Atlas on GB10, run by the atlasctl launcher that replaces sparkrun, with per-model KV dtype and MTP width.
  • Blackwellboy/laguna-s21-lab - Laguna S 2.1 NVFP4 testing lab on one DGX Spark, 20-cell tuning sweep with its losing cells, 12-hour soak of 3,096 turns, and 450-turn thinking-gate study.
  • colonel-otto/3x-dgx-spark-mesh-deepseek-v4-0731-flash - DeepSeek-V4-Flash at TP=3 on three DGX Spark, decode 6.7 to 20.2% faster than two nodes at n=30 on the retired Anemll engine, 84.7 tok/s c1 on eugr's b12x image.
  • DanTup/spark-evals - Harbor-run leaderboard of evo eval, aider polyglot, and swe-rebench scores under Codex and Terminus-2 agents for four model configurations that fit on one DGX Spark.
  • DG1001/local-agentic-coding-128gb - Coding-agent benchmark of 14 local models on one ASUS Ascent GX10 under three harnesses, 86 hidden tests, with Nemotron scoring 47 to 85 across 13 runs.
  • elsung/dgx-spark-deepseek-v4-flash - DeepSeek-V4-Flash official FP8 across two DGX Spark under vLLM TP=2 over a 200 Gb/s QSFP56 RoCE cable, 41 tok/s single stream and ~350 aggregate at c=32.
  • Entrpi/ds4-on-spark - DGX Spark fork of antirez/ds4 at 2.4-3.3x upstream prefill and 1.33-1.47x decode, 59 tok/s over 12 concurrent requests, and 2.26M tokens of active context at shipped defaults.
  • Entrpi/qwen3.5-122B-A10B-on-spark - Qwen3.5-122B-A10B on a single DGX Spark via DFlash block-diffusion spec-decode, 81 tok/s on agent traffic.
  • evanwtf/local-llm - Coding-agent benchmark of model, engine and harness stacks on two DGX Spark, ranked on correctness then wall time, DeepSeek-V4.1-Flash-1017 EXL3 on vLLM passing 369 of 380 hidden tests.
  • GaelicThunder/colibri-gb10-attention-cliff - Fixed-size kernel guard at 8192 context tokens in colibri on GB10, silent CPU fallback at 0.45 versus 0.86 tok/s, plus per-branch counters and a sweep harness.
  • GaelicThunder/DeepSeek-V4-Flash-Vision-One-DGX-Spark - DeepSeek-V4-Flash-Vision-Exp in EXL3 on one DGX Spark at 245,760 context, 37.6 tok/s on code with images in the same process, keeping 90% of the original token probability.
  • GaelicThunder/gb10-uma-inference-notes - Five measured GB10 unified-memory properties that hold across models and engines, including host-to-device copies as pure waste worth 63% once removed.
  • GaelicThunder/moe-offload-findings - Nine findings on MoE decode with experts streamed from NVMe, mostly negative: batching does not amortize expert reads and prefetching cannot beat a static pin.
  • gitcommit90/qwen38-27b-dgx-spark - Qwen3.8-27B NVFP4 on one GB10 with Inco DFlash 2 speculative decoding, 44.46 tok/s versus DSpark 31.95 at k=7, plus a BF16 lm_head guard fix.
  • harshilmathur/sparklab - Closed-loop agent benchmark harness with usage-field token counts and raw CSVs for DeepSeek Flash on two DGX Spark, plus a bisected 6.17.0-1031 kernel regression.
  • hebo1221/motif3-dgx-spark - Motif-3 315B as mixed IQ2_XXS on one DGX Spark, 83.56 GiB at 16.49 tok/s, published with the author's verdict that the quant misses BF16 quality retention.
  • jeremy-newhouse/dgx-spark-nemotron-super-bench - Single-stream decode benchmark of Nemotron-3-Super-120B-A12B-NVFP4 on one GB10, ~26-27 tok/s realistic with MTP vs ~33.6 microbench.
  • jiayuqi7813/DeepSeek-V4-Flash-0731-CRACK-2x-DGX-Spark - Rank-1 Householder refusal edit of DeepSeek-V4-Flash-0731 in native FP8 UE8M0 blocks on two DGX Spark, compliance 3.53 to 90.59% with HumanEval 148 against 150.
  • javierbits/dgx-spark-bench - Closed-loop concurrency sweeps on DGX Spark for agentic multi-session loads, pinned lmswitch recipes, per-session and aggregate tok/s on a GitHub Pages dashboard.
  • k3net/docai-evals - Evidence repository for 19 Hungarian document-AI and GB10 serving experiments, where Marlin beats the publisher-recommended MoE backend by up to 3.3x and NVFP4 roughly doubles counterparty-role errors.
  • Kleybrink/dgx-spark-bench - Ollama benchmark harness for DGX Spark with LLM-as-a-judge over 21 prompts in 9 categories, where thinking lifts Nemotron 3 Nano 30B from 44% to 98%.
  • marksunner/dgx-spark-single-stack - Single-box agent stack on DGX Spark, Hermes runtime and Honcho memory on CPU beside vLLM serving Qwen3.5-122B hybrid INT4+FP8 with MTP at 41-47 tok/s.
  • marksunner/dgx-spark-step37-flash - StepFun's Step 3.7 Flash (198B MoE) on a single DGX Spark with llama.cpp at ~27 tok/s and 96K context on a q8_0 KV cache, reduced from 128K for CUDA-graph stability.
  • Memoriant/dgx-spark-kv-cache-benchmark - KV cache quantization on GB10 llama.cpp with Nemotron-3-Nano-30B-A3B, q4_0 37% slower decode at 110K, TurboQuant turbo3 22.9% at 32K, prefill untouched.
  • mneha05/gb10-attn - Context-split FlashDecoding paged-attention decode kernel at 82-85% of GB10's 273 GB/s on large working sets, fp16 gpt2 geometry, after correcting a 2x roofline and an L2-cached benchmark.
  • msuiche/weightless - Serve-time refusal steering with GGUF layer-projection vectors instead of redistributed weights, validated on Qwen3.8-27B on one DGX Spark and GLM-5.3-Flash on four.
  • Mtang33/5090-vs-gb10 - Raw data and scripts for an RTX 5090 versus DGX Spark comparison with wall-socket energy, gpt-oss:120b at 0.76 against 1.84 Wh per 1K tokens over a one-hour soak.
  • nabe2030/dense-27b-31b-dgx-spark - Dense Qwen 3.5/3.6-27B and Gemma 4-31B on llama.cpp b8922, Q4_K_M at 10-12 tok/s versus 3.8-4.5 BF16, JCommonsenseQA cost 0.2-0.6 points.
  • nabe2030/gemma4-vs-qwen35-dgx-spark - Gemma 4 26B-A4B F16 versus Qwen 3.5/3.6-35B-A3B MXFP4 on llama.cpp, 26.5 against 58 tok/s decode, an F16-only thinking-mode bug, and a 0.35 point JCommonsenseQA spread.
  • OscarActual/gb10-llm-benchmark - Ollama benchmarks for GB10 across 11 LLMs and 10 embedders: decode tok/s, TTFT, and Czech RAG recall.
  • pendakwahteknologi/gx10-benchmarks - Benchmark roster for the ASUS Ascent GX10 (GB10) with nine published runs across inference, training, efficiency, and generation, each carrying timestamped CSV and log artifacts.
  • r0b0tlab/deepseek-v4-flash-nvfp4-gb10-benchmark - DeepSeek-V4-Flash FP8 on two DGX Spark at TP=2 with MTP over RoCE, 38.4 tok/s c1 and 144.6 aggregate at c16 on driver 580.142, down about 3.5x on 580.159.03.
  • r0b0tlab/diffusiongemma-26b-nvfp4-sm121-vllm - DiffusionGemma 26B-A4B NVFP4 under vLLM on GB10 with the FlashInfer CUTLASS FP4 MoE path, 146.3 tok/s at c1 and 242.9 at c16, no Marlin fallback.
  • r0b0tlab/laguna-s-2.1-nvfp4-sm121-vllm - Laguna S 2.1 NVFP4 on GB10 under vLLM 0.25.1, DFlash K=7 at 22.2 tok/s c1 with thinking off on revision 0761412, plus an 8,620-case scorecard for the earlier 216d1f1.
  • r0b0tlab/nex-n2-mini-nvfp4 - NVFP4 vLLM container for Nex-N2-mini (Qwen3.5-MoE-35B) on GB10, 185 tok/s aggregate at concurrency 8.
  • r0b0tlab/step37-flash-nvfp4-sm121-vllm-docker - vLLM container for StepFun's Step 3.7 Flash NVFP4 (198B MoE VLM) on dual GB10 TP=2, with verified native-CUTLASS sm_121 execution at 16.49 tok/s.
  • ramsred/llm-engine-benchmark - 120K-token comparison of vLLM, SGLang, and TensorRT-LLM on GB10 under one client, plus a TensorRT-LLM prefill-budget study where 8192 to 2048 cuts cold-C4 P95 TTFT 26.9% at 2.1% output-throughput cost.
  • rothgar/qb2-vs-spark - Wall-power benchmark harness for a Tenstorrent QuietBox 2 against one and two DGX Spark, single-node gpt-oss-120b at 146.47 tok/s and 1.105 tokens per joule over 16 users.
  • styles01/sparkrun-recipes - Source-pinned SparkRun recipes and runbooks for exclusive GB10 lanes, led by DeepSeek-V4.1-Flash-1017 EXL3 at TP2 on two DGX Spark, 47.5-54.1 tok/s single-stream decode.
  • ThinkCode/glm53-flash-2x-gb10-bench - GLM-5.3-Flash NVFP4 against EXL3 on two GB10, with NVFP4 ahead cold at every concurrency and EXL3 ahead 1.6x at warm C4 on prefix-cache reuse NVFP4 never gets.
  • VincentMarquez/glm52-gb10-colibri - GLM-5.2 744B on one DGX Spark at full top-8 via a colibri engine branch, 11.1 tok/s on a synthetic prompt with PLD, 5-7 on real chat.
  • weiying23/nvGB10_GEMM - BF16 GEMM written from scratch for GB10 in 12 versions, 1.26 to 88.9 TFLOPS at 4096x4096x4096 or 102% of cuBLAS, with its falsified hypotheses recorded.
  • Weschera/spark-bench - LLM benchmark for DGX Spark across 80 scenarios in 13 domains, with 12 multi-turn agentic workflows, 4 machine-graded long-generation builds, and a TrueScore weighting speed at 5%.

Multi-node

You can connect two DGX Spark units directly over 200 Gb/s QSFP for double the memory and compute.

  • 0xdfi/GLM-5.2-1M-4x-DGX-Spark - Profile index for unpruned GLM-5.2 744B on 4x DGX Spark with NVFP4 DS-MLA KV, O14 Fast at 250K total KV, 819 tok/s prefill, 42.3 peak decode.
  • 0xdfi/GLM-5.2-R9-Adaptive-MTP-FULL-CUDA-4x-DGX-Spark - GLM-5.2 on four DGX Spark nodes with FULL CUDA graphs for every adaptive MTP depth K2/K4/K5, 83.4 tok/s at C4 measured before the 420K retune, 520K balanced profile.
  • 0xSero/glm-5.3-flash-sglang-sm121 - GLM-5.3-Flash NVFP4 under SGLang on two or four DGX Spark, 22.69 tok/s single stream and 82.37 at eight on TP=4, digest-pinned with an acceptance checklist.
  • 0xSero/Step-5-Preview-Four-Sparks - StepFun Step-5-Preview EXL3 on four DGX Spark at vLLM TP4 over RoCE, 1,365-1,565 tok/s warm 8k prefill and ~25-30 tok/s per-stream decode at 262,144 context.
  • adapt-ai-systems/qwen3.8-flash-next-tp2-dgx-spark - Qwen3.8-Flash-Next NVFP4 on two DGX Spark at TP2 with expert parallel, b12x one-shot RoCE all-reduce, and MTP k=4, 75-77 tok/s single request on mixed code and prose.
  • Aileuxe/mac-spark-playbook - Qwen3.8-Flash-Next prefilled on a DGX Spark and decoded on a Mac Studio M3 Ultra over RDMA, ahead of single-box TensorFold only on code prompts past about 32k tokens.
  • ajensenwaud/Kolibri-1-2x-DGX-Spark-TensorFold - Kolibri-1 on two DGX Spark under TensorFold with 17 patches over PR #328, 83.7 tok/s single-stream decode at FP8 against 47.1 on one Spark.
  • ajensenwaud/MiMo-V2.6-2x-DGX-Spark-TensorFold - MiMo-V2.6-Flash-RL in its own EXL3 3.0 bpw pack on two DGX Spark with a MiMo family added to TensorFold, DFlash coding at 77.6 tok/s single stream against 45.4 plain.
  • ajensenwaud/muspark-2dgx - Muse Spark Open 816B as a 1.8 bpw EXL3 pack on two DGX Spark through a Muse family for TensorFold, 30.1 tok/s single stream against 7.4 on llama.cpp.
  • ALEX8642/onprem-llm-stack - Two-node GB10 platform at TP=2 behind LiteLLM, with an eval harness gating engine changes and a NaN-logits canary watchdog, Qwen3.8-Flash-Next-NVFP4 at 71.9 tok/s median decode on Atlas.
  • Alexbob0/glm53-flash-vllm-upstream-sm121 - GLM-5.3-Flash EXL3 on two DGX Spark under stock vLLM nightly through Python overlays only, 59.3 tok/s code, head-rank weight load cut from 274 s to 48 s.
  • ArgentAIOS/dgx-spark-cluster - Two-node DGX Spark guide with DMA-BUF NCCL settings for GB10 where nvidia-peermem GPU Direct fails, 93.5% DDP scaling on a 200 Gb/s RoCEv2 link.
  • bertholomus/beam-1.0-2x-dgx-spark - Reflection Beam-1.0-501B-A23B as a 3-bit EXL3 pack on two DGX Spark under a TensorFold fork with DFlash2, 45.5 tok/s code single stream against 33.4 for its vLLM lane.
  • bertholomus/deepseek-v4.1-tensorfold-tp2-2xgb10 - DeepSeek-V4.1-Flash-1017 EXL3 2.5 bpw on two DGX Spark under a TensorFold TP2 Zig engine with DSpark drafting, 1M context, 106.5 tok/s greedy code decode, 248.6 aggregate at 32 streams.
  • bertholomus/deepseek-v4.1-tensorfold-tp4-4xgb10 - DeepSeek-V4.1-Flash-1017 EXL3 4.0 bpw at TP4 on four DGX Spark in a TensorFold Zig-engine fork, 135.8 tok/s greedy code single stream, 1M-token requests with images.
  • bertholomus/ling-3.1-tensorfold-tp2-2xgb10 - Ling-3.1-flash-1019 EXL3 3.03 bpw on two DGX Spark through a bailing_v3 family written for TensorFold, 262,144-token window, MTP drafts at 35.1-39.3 tok/s greedy against 22.5-24.1 serial.
  • Bespoke-Legal-Intelligence/Beam-1.0-501B-A23B-NVFP4-TP3-3x-DGX-Spark - Beam-1.0-501B-A23B NVFP4 on three DGX Spark at TP=3 via a zero-padded checkpoint, about 18 tok/s single stream and 131 of 133 Beam Verifier checks.
  • bird/GLM-spark - GLM-5.2 across four DGX Spark nodes, 1M context at 24.7 tok/s on unpruned Int4-Int8Mix weights, TP4 plus DCP4 KV sharding and lossless speculative decoding.
  • BobClawblaw/minimax-m31-flash-nvfp4-2x-dgx-sparks - MiniMax-M3.1-Flash on two DGX Spark under TensorFold's native CUDA engine, 15 MoE layers kept NVFP4 and 42 refit to 3 bits, 41.1 tok/s code single stream.
  • botAGI/dspark-0731-gb10 - DeepSeek-V4-Flash-0731 on two DGX Spark under vLLM 0.25.2, flashinfer_b12x MoE backend worth 9-12% step rate to 256K, 28 tok/s single stream at 1,042,600 tokens.
  • bumandpunk/DeepSeek-V4.1-Flash-1017-2x-DGX-Spark - TensorFold additions for DeepSeek-V4.1-Flash-1017 EXL3 2.9 bpw on two DGX Spark reusing context code as verified proposals, 32.1-57.6% faster decode on three full-file edits than Mia's native build.
  • bumasoft/Qwen3.8-Flash-Next-TP3-DGX-Spark-VLLM - Qwen3.8-Flash-Next FP8 across three DGX Spark at tensor-parallel 3, checkpoint padded in place at 60.9 tok/s, where padding key heads alone silently breaks the 1:3 GDN pairing.
  • calvarado2004/deepseek-v41-1017-nvfp4-nvidia-flare - DeepSeek-V4.1-Flash-1017 MXFP4 at TP4 on four DGX Spark under NVIDIA Flare in a switchless QSFP ring, 109.9 tok/s code single stream on driver 615.
  • chadhurley25075-png/pd-bridge - DeepSeek-V4-Flash prefilled on two DGX Spark, decoded on a Mac Studio over plain 10 GbE with no shared cache format, 3.7x vs the Mac alone on a 241K cold prompt.
  • ChimeraWerks/DeepSeek-V4.1-Flash-1017-3x-DGX-Spark-TP3-TensorFold-abliterated - Abliterated DeepSeek-V4.1-Flash-1017 3.84 bpw EXL3 on three DGX Spark under TensorFold TP3 with owned-row prefill, 3,833 tok/s cold at 32K and mean KL 0.0784 to the official logits.
  • chishiki37/dgx-spark-fabric - Switched MikroTik CRS812 fabric replacing the direct DAC between two DGX Spark nodes, fixing broken RoCE for 26-33% more decode, with 100 and 200 Gb/s breakouts measured identical.
  • christopherowen/dgx-spark-networking - Switchless RoCE collectives library for DGX Spark rings, one-shot BF16 all-reduce at 16.9 µs against NCCL's 90.6 to 92.4 µs for 10 KiB on four nodes.
  • christopherowen/spark-ds41f - vLLM deployment of DeepSeek-V4.1-Flash-1017 on switchless three- or four-node DGX Spark fabrics with TileLang sm_121 kernels, TP4 1M at 78.3 tok/s one stream and 198.4 aggregate at eight.
  • ciprianveg/gb10-vllm - Model-agnostic sm_121 vLLM platform, KIMI-K3 v5 at TP16 plus DCP8 with RoCEnante collectives on 16 GB10, 29.81 tok/s at C1 and 87.12 aggregate at C8, GLM-5.3 on GLM-5.2's v19 image.
  • CosmicRaisins/glm-5.2-gb10 - Unpruned GLM-5.2 Int4-Int8Mix on four GB10 nodes with DCP KV sharding, 320K context at 598 t/s prefill or 640K at 430, decode flat near 22 t/s.
  • CosmicRaisins/minimax-m3-awq-gb10 - MiniMax-M3-AWQ-INT4 vLLM serve recipe for 4x GB10, FP8 KV cache, EAGLE3 spec-decode, and indexer-corruption fix.
  • digchick/dgx-spark-200g-link-fix - Troubleshooting playbook for the 200G ConnectX-7 link failing to train between two Sparks (CX7 hotplug power-saving), with the fix and NCCL/RoCE verification.
  • drowzeys/keys-1M-CTX-Inkling-Small-NVFP4-Dspark-NVFP4-KV-Cache-SGlang-SM121-optimized-on-Two-DGX-Sparks - NVFP4 KV cache in the SGLang triton backend for Inkling-Small on two DGX Spark, 3.12x pool for 1M context, 23.9 tok/s on a pooled open-ended mix.
  • drowzeys/keys-MiMo-V2.6-Pro-MOPD-C3-Jarrelscy-ARVQ-4-DGX-Sparks-1M-Context - MiMo-V2.6-Pro-MOPD in Jarrelscy's ARVQ and NVFP4 hybrid on four DGX Spark at TP4 and 1M context, single-stream 32.2 tok/s on code and 24.2 on prose with MTP k=2.
  • drowzeys/Keys-Setup-Autonomous-Self-Improving-Local-Inference-Stack - Mixture-of-Agents stack for four DGX Spark nodes with a DeepSeek-V4-Flash router and an NVFP4 Two-Tower consolidated onto one node at 29 tok/s.
  • drowzeys/keys-TensorFold-GLM-5.3-TP4-4x-DGX-Spark - GLM-5.3 753B at EXL3 2.75 bpw on four DGX Spark under TensorFold TP4 with MTP 2, 40.2 tok/s prose with thinking on, needle found at 905,182 tokens.
  • Enntity/sparkglm - GLM-5.3-Flash on two or four DGX Spark under the Atlas engine with DFlash2 and prefix caching, Spark-mode medians 37.5 tok/s prose at TP2 and 58.3 on a TP4 ring.
  • epappas/gx10-cluster - Ansible provisioning for a GB10 cluster over ConnectX-7 with diagnostic tools, a recipe catalogue, and measured-or-forum-read labels on hardware claims, 22.7 GB/s two-node NCCL busbw.
  • fiore-labo/ExpertAtlas-GLM5.3 - Full GLM-5.3 755B on four or eight DGX Spark in a Zig TensorFold derivative, experts at 2 to 5 bits by usage, 47.5 tok/s at C1 after 128K on eight.
  • FujitsuPolycom/sparkring - One-command vLLM installer for two to eight switchless DGX Sparks over SIRCL RDMA collectives, DeepSeek-V4.1-Flash ring of eight decoding 74 tok/s at one stream and 259 at eight (32K context).
  • grosa787/connect-dual-spark-for-unsloth-studio - Two-Spark Unsloth Studio installer over llama.cpp RPC, where DirectIO, an RPC hash bypass, and RDMA load DeepSeek V4 Flash Vision Q8 in 112.3 s against 5 min 35.6 s.
  • HeNryous/mimo-v25-dflash-dgx-spark - MiMo-V2.5 (309B MoE, NVFP4 plus a required MXFP8 o_proj overlay) on two DGX Spark nodes, DFlash drafting ~54 tok/s on structured content, 1.67M-token fp8 KV pool at 500K.
  • hisxo/DeepSeek-V4.1-Flash-2x-DGX-Spark - TensorFold Zig patches for DeepSeek-V4.1-Flash EXL3 on two DGX Spark with an image-keyed prompt cache and NVMe KV spill, cached agent-turn TTFT 31.6 to 1.88 s.
  • idonati/spark-vllm-docker-festr2 - vLLM patches for festr2 MiMo-V2.5-Pro NVFP4/MXFP8 on an 8-node sm_121 cluster, fused-QKV fix for Q mis-slotted as K/V on 7 of 8 ranks, 114 tok/s aggregate at 20 concurrent.
  • JacobWillson13/dgx-spark-cluster - vLLM scaling study on two DGX Spark with correctness gates, TP2 beating PP2 2.01x on Llama 3.3 70B and NVFP4 costing 13.7 GSM8K points on Qwen3.8 27B.
  • jakejharris/jspark3 - GLM-5.3-Flash on three DGX Sparks with a TensorFold fork and DFlash2 drafting, RigMark estimates at reasoning effort low of 91.3 tok/s code, 51.6 prose, 2,124 tok/s cold 64K prefill.
  • jayleaton/glm53-tensorfold-spark - GLM-5.3-Flash abliterated EXL3 4-bit on two DGX Spark under TensorFold plus 77 patches, RigMark 57.5 tok/s at C1 and 95.1 at C4.
  • jlacroix82/muse-spark-open-2x-dgx-spark - Muse-Spark-Open-816B-A42B as a 194.6 GiB UD-IQ1_M GGUF across two DGX Spark over llama.cpp RPC on RoCEv2, 6.76-7.01 tok/s decode at 32K context.
  • jnardiello/GLM-5.3-Flash-FP8-4-DGX-Spark-Switchless - GLM-5.3-Flash FP8 under vLLM at TP4 on four GB10 in a switchless ConnectX-7 ring, 65.55 tok/s code decode and perplexity +0.1% against vendor FP8.
  • joesinvestments/DeepSeek-V4-Flash-0731-TP4-4x-DGX-Spark - DeepSeek-V4-Flash-0731 at TP=4 on four DGX Spark under vLLM 0.25.2 with DSpark k=7, 123.13 tok/s single stream at 2K tokens, 57.9 at ~150K agentic prompts.
  • joesinvestments/glm52-spark-kit - GLM-5.2 on four DGX Spark as source overlays over stock vLLM, fused nvfp4_ds_mla KV writer at 51 times the torch reference, sparse indexer unblocked above DCP 1.
  • joeynyc/Hy3-295B-NVFP4-2x-DGX-Spark - Tencent Hunyuan 3 295B MoE in NVFP4 at TP2 on two DGX Spark, 26 tok/s single stream at 262K with TurboQuant k8v4 KV, MTP measured 20% slower.
  • joeynyc/MiniMax-H3-2x-DGX-Spark - Cross-host diffusion executor for one MiniMax H3 video across two DGX Spark nodes, Ulysses sequence parallelism over RoCEv2, 68.8 s against 155.0 s single-box.
  • josephdrose/joe-spark-patches - Out-of-tree vLLM patches for DeepSeek on four DGX Spark, Engram kept on NVMe because cpu_offload frees nothing on GB10, plus a DSpark proposer that survives concurrent requests.
  • josephdrose/nccl-spark-switchless - NCCL 2.30.7 patches for a switchless 4-node GB10 RoCE ring, tree-skip plus 2-hop relay over the uncabled diagonals, MiniMax-M3 229B NVFP4 at ~24 tok/s.
  • karolpalys/glm52-triple-spark-tuning - Tuning log and negative results for GLM-5.2 753B on three DGX Spark nodes, with the measurement methodology and the evidence that killed each rejected change.
  • kindlingai/glm-5.3-flash-gx10 - GLM-5.3-Flash NVFP4 on two, three, four or six GB10 under vLLM with mentat in place of Ray, 117.3 tok/s code decode at TP=4 with DFlash2.
  • kindlingai/glm-5.3-full-exl3-tp6 - Full GLM-5.3 EXL3 3.25 bpw on six DGX Spark at TP6 by re-fragmenting experts without requantizing, 33.8 tok/s prose at MTP k=2, 958 tok/s prefill at 32K.
  • kindlingai/nemotron-3.5-super-vl-dgx-spark - Nemotron 3.5 Super VL 120B-A12B on one or two DGX Spark under vLLM without Ray, TP2 prose at 44-46 tok/s with 4 LiLiCorr draft tokens against 26-28 with 7.
  • kingjones30/GLM-5.3-Flash-2x-DGX-Spark - GLM-5.3-Flash NVFP4 on two DGX Spark, NoPE latent padded to the rope width sm_121 kernels expect, 24.7 tok/s on code under MTP-5 on the stock image.
  • knapcio/DeepSeek-V4.1-Flash-4x-DGX-Spark-TP4 - DeepSeek-V4.1-Flash-1017 TP4 on four DGX Spark under SGLang with RoCEnante all-reduce, 88.4 tok/s c1 over 73 speedbench prompts, 207.6 aggregate at c16, GPU capped at 2200 MHz.
  • knapcio/GLM-5.3-Flash-4x-DGX-Spark-TP4 - GLM-5.3-Flash NVFP4 at TP4 on four DGX Spark with 8-bit dense layers and DFlash2, 90.3 tok/s prose single stream, 3,470 tok/s cold prefill at 32k.
  • knapcio/GLM-5.3-gr8-6x-DGX-Spark-TP6 - Full GLM-5.3 at TP6 on six DGX Spark with forty flag-gated patches over gr8 and MTP drafting, 50.0 tok/s prose and 73.3 code at c1, clocks capped at 2200 MHz.
  • knapcio/MiniMax-H3-2x-DGX-Spark-TP2 - MiniMax H3-Base under vLLM-Omni on two DGX Spark with text-encoder TP2 and Ulysses SP2, 15 s 1344x768 clips beyond one node's memory, 5 s in 643.0 s against 1399.0.
  • knapcio/MiniMax-M3.1-Flash-4x-DGX-Spark-TP4 - MiniMax-M3.1-Flash at TP4 on four DGX Spark under SGLang patched for sm_121 with DFlash2 and RoCEnante all-reduce, 46.5 tok/s prose at c1 on sparkDash.
  • koldfrontier/dgx-spark-ops - Recipes and fabric notes for two- to four-node GB10 clusters, switchless-ring cost at 4.64 ms of a 63 ms decode step, re-plugged ConnectX-7 at 14 Gb/s until reboot.
  • LakyFx/deepseek-v41-flash-exl3-tp3-tp4-spark - DeepSeek-V4.1-Flash-1017 EXL3 at about 3.51 bpw under TensorFold, separate TP3 and TP4 recipes for three or four DGX Spark, 114.5 tok/s greedy code at C1 on TP4.
  • leo-dcfa/minimax-m31-flash-4x-spark - MiniMax-M3.1-Flash official weights on four DGX Spark at vLLM TP4 over a switchless CX7 ring with Marlin experts, DSpark decode 41.9 prose to 67.6 structured tok/s single stream.
  • lepetitprince716-prog/step-5-preview-exl3-vllm-dgx-spark - Step-5-Preview 604B as 2.4 bpw EXL3 on two DGX Spark under vLLM TP2, decode patches and a vendored TensorFold experts kernel taking single stream from 24.9 to 41.1 tok/s.
  • Libertai/glm53-flash-vllm-gb10 - GLM-5.3-Flash under vLLM on two DGX Spark at 24.2 tok/s through a hand-written sparse-MLA kernel, with degenerate output traced to an uninitialized MoE activation scale.
  • luxingcom/aicad-nccl-optimization - Chinese-language NCCL 2.30.7 ring-only patch set and size-split LL/Simple protocol tuner for a switchless four-Spark vLLM TP4 ring, 368 KB all-reduce from 923 to 173 µs.
  • magicbear/DeepSeek-V4.1-Flash-SGLang-DGX-Spark - DeepSeek-V4.1-Flash under SGLang on four against eight DGX Spark, c1 code decode 57.9 against 67.0 tok/s, 1.63-1.76x prefill at eight, while its own vLLM cross-check reaches 75.5 on four.
  • makiisthenes/dgx-spark-multinode-vllm-ray - Two-node DGX Spark walkthrough on NGC vLLM 26.04, with a Dockerfile restoring the Ray CLI the image dropped and QSFP route and 200 Gb/s link checks.
  • maliubiao/dgx-spark-2-deepseek-flash-0731 - Bilingual manual for DeepSeek-V4-Flash-0731 and Vision-Exp on two DGX Spark, with LMCache v0.5.3 built on aarch64 for NVMe cold KV backup, 1 GiB L1, 500K context.
  • marksunner/glm52-dgx-spark-deadlock-evidence - Evidence pack for a FlashInfer sparse-MLA mbarrier livelock that wedged GLM-5.2 TP=4 on four DGX Spark, with a cuda-gdb receipt and a Triton workaround clean over 560+ sessions.
  • MiaAI-Lab/DeepSeek-v4-Flash-DSpark-2x-DGX-Spark - Two-node vLLM TP=2 recipe for DeepSeek-V4-Flash-Vision-Exp with native image input, DSpark speculative decode and nvfp4_ds_mla KV at a 1M-token ceiling.
  • MiaAI-Lab/DeepSeek-V4.1-Flash-1017-4x-DGX-Sparks-TensorFold - DeepSeek-V4.1-Flash-1017 in DeepSeek's own FP8 and MXFP4 weights at TP4 on four switchless DGX Spark under TensorFold, 65.8 tok/s sampled prose and 117.4 greedy code at one request.
  • MiaAI-Lab/DeepSeek-v4.1-Flash-DGX-Sparks - DeepSeek-V4.1-Flash under SGLang on three or four DGX Spark with NVMe-resident Engram tables, TP4 prose c1 87.7 tok/s on a switch, 1M-context needle passed at 1,011,084 tokens.
  • MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks - DeepSeek-V4.1-Flash at 2.9 bpw EXL3 on two DGX Spark with vLLM TP2 and file-backed Engram, 31.6 tok/s single stream with DSpark k=3, 600K context.
  • MiaAI-Lab/GLM-5.2-NVFP4-AQLM-Triple-DGX-Sparks - GLM-5.2 NVFP4 plus AQLM 2-bit hybrid on three DGX Spark at TP3, 21 tok/s structured at 348K vision context with top-4 routing, 25-26 on fp8 KV at 235K.
  • MiaAI-Lab/GLM-5.3-EXL3-3x-DGX-Sparks-TensorFold - GLM-5.3 EXL3 2.75 bpw on three DGX Spark under TensorFold, a 499,712-token window by context parallelism, 41.7 tok/s code, a 94K prompt resumed from NVMe in 3.0 s.
  • MiaAI-Lab/GLM-5.3-Flash-DGX-Sparks-1104 - GLM-5.3-Flash EXL3 4 bpw on two DGX Spark under TensorFold's native Zig/CUDA server at TP=2, 105 patches, 1,048,576-token window at 8 streams, 47.8 tok/s prose c1 thinking on.
  • MiaAI-Lab/GLM-5.3-Flash-NVFP4-Dual-DGX-Spark - GLM-5.3-Flash NVFP4 on two DGX Spark over Ray TP=2 with image and video input, MTP at four draft tokens, FP8 KV cache and 262K context.
  • MiaAI-Lab/Inkling-Small-NVFP4-Dual-DGX-Sparks - Inkling-Small-NVFP4 across two DGX Spark on SGLang at a 1,142,712-token KV pool, 33.9 tok/s single stream, page size 1 required for the triton DSpark verify path.
  • MiaAI-Lab/MiMo-V2.6-Flash-2x-DGX-Sparks - MiMo-V2.6-Flash MXFP4 under SGLang on two DGX Spark, DFlash at 69.8 tok/s on code and EAGLE MTP at 35.0 on prose, single stream.
  • MiaAI-Lab/Qwen3.8-Flash-Dual-DGX-Sparks-TensorFold - Qwen3.8-Flash-Next NVFP4 on two DGX Spark under TensorFold's Zig engine at TP2 with FP8 KV, 1,048,576-token window, 67.4 tok/s prose at c1 and 390.1 at c16.
  • MiaAI-Lab/Qwen3.8-Flash-Next-Dual-DGX-Sparks - Qwen3.8-Flash-Next NVFP4 on two DGX Spark under vLLM TP2 with expert parallel and MTP-3, 56.8 tok/s prose at one stream and 225 aggregate at eight with 47k draft vocabulary.
  • MIKAZE3/dsv41-fp4kv-sm121 - SGLang patches switching DeepSeek-V4.1-Flash to its FP8 plus FP4 KV layouts on four DGX Spark via flashinfer 0.7.1, capacity 6.56M to 12.77M tokens for 2.0% more step time.
  • nabe2030/dgx-spark-2node-rpc - GLM-5.2 GGUF at 228.5 GB split across two DGX Spark nodes over llama.cpp RPC, CX7 measured as two ~100 Gb/s PCIe Gen5 x4 paths, RDMA vs TCP A/B.
  • nacyot/vllm-ds4f-gb10 - vLLM fork for DeepSeek-V4.1-Flash on four GB10 at TP=4 with disk KV offload, a 493K-token session restored from SSD in 7.8 s against a 392 s cold prefill.
  • neko-legends/spark-bench - Four DGX Spark as one TP4 cluster over ten dated lanes, the live one DeepSeek-V4.1-Flash 1017 EXL3 2.9-bit on a TensorFold 1.1.2 rebase at 313 tok/s aggregate over 8 streams.
  • ondigo-winder/deepseek-v4_1-1017-4-gb10 - DeepSeek-V4.1-Flash-1017 NVFP4 at TP4 on four GB10 in a switchless QSFP ring under patched vLLM with MXFP4 Engram read from NVMe, 67.5 tok/s code single stream and 311.7 at 16.
  • ondigo-winder/SWITCHLESS-NCCL-RING-4-GB10 - NCCL 2.30.7 patch for a switchless four-node GB10 ring using both PCIe halves of each QSFP cable, 193.1 Gb/s all-reduce bus bandwidth against 111.6.
  • openzeka/meta-models-Muse-Spark-Open-816B-A42B-NVFP4-8xDgx-Spark - Muse-Spark-Open-816B-A42B-NVFP4 at TP8 on eight DGX Spark with DFlash2 k=4 and five vLLM MoE patches for sm_121, 88-97 tok/s aggregate at 8 concurrent.
  • OsakaTX/qwen3.8-flash-next-vllm-dgx-spark - Qwen3.8-Flash-Next NVFP4 on two DGX Spark under vLLM TP2 with MTP n=3, 41-44 tok/s c1 and 162 aggregate at eight, RDMA passthrough worth 40-45%.
  • othexmr/GLM-5.3-Flash-NVFP4-2x-4x-DGX-Sparks-RiNGSiDE - GLM-5.3-Flash NVFP4 with DFlash2 on four or two DGX Spark in a switchless ring over both ConnectX-7 ports, 105.3 tok/s code and 61.7 prose single stream at TP4.
  • paul-loerch/deepseek-v4.1-flash-1017-uncensored-fp8-8x-dgx-spark - DeepSeek-V4.1-Flash-1017 with a refusal-removal overlay under vLLM TP8 on eight DGX Spark via 29 runtime patches, ~140 tok/s one coding agent and ~900 total at 128 users.
  • paulshearer/deepseek-asymmetrical-attention - Asymmetrical TP3 attention patches for DeepSeek V4.1 Flash on three DGX Spark under SGLang, 24/24/16 real heads per rank in place of 32 padded, 9.07% faster non-speculative single-request decode.
  • pfn/spark-vllm-compose - Head and worker Docker Compose files that run vLLM across DGX Spark nodes with native --nnodes/--node-rank instead of Ray, shipped services for Qwen3.5-397B-A17B-int4 and MiniMax-M2.7.
  • pocharlies-org/qwen38-dgx-spark-audit - Qwen3.8-Flash-Next on two DGX Spark with BF16 Mamba state halving ursu's prefix-cache block, cached 64K first answer 2.23 to 1.67 s, cold prefill 16% slower.
  • PrblyElect/DeepSeek-V4-Flash-Vision-TP3-3x-DGX-Spark - DeepSeek-V4-Flash-Vision-Exp at TP=3 on three DGX Spark with the vision tower live and sequence-parallel prefill, ~99 tok/s code-class single stream, recall word-exact to ~950K tokens.
  • r0b0tlab/DeepSeek-V4-Flash-DSpark-v026-SM121 - Dual-GB10 DeepSeek-V4-Flash-0731 on vLLM 0.26 with a digest-pinned GHCR image and runtime gate, NIAH PASS at 1M, BFCL multi_turn_base 0.755, ~79 tok/s c1 decode.
  • r0b0tlab/qwen38-flash-next-w4a16-sm121-sglang - Qwen3.8-Flash-Next self-quantized to NVFP4 W4A16 on two GB10 under SGLang TP=2 with NEXTN MTP, 63.84 tok/s at c1 and 132.64 at c4 on 1,024-token prompts.
  • rajsinghtechbot/dgx-spark-vllm-k8s - Kubernetes cookbook for DeepSeek-V4-Flash on dual DGX Spark, with Multus/Spiderpool RDMA over RoCEv2, UMA-aware container memory limits, and Prometheus monitoring.
  • raullenchai/twinspark - Self-healing two-node vLLM cluster for DeepSeek-V4-Flash-0731 on DGX Spark at 74.8 tok/s, needle sweep cutting long-context failures from 8/25 to 2/25 by trading nvfp4_ds_mla KV for fp8_ds_mla.
  • Reederey87/dgx-spark-2x-deepseek-v4-flash - DeepSeek-V4-Flash-0731 on two DGX Spark from a full-source vLLM main build, four gated one-file upstream fix layers promoted on Welch non-inferiority, 3,027,217-token KV pool.
  • Reederey87/glm53-flash-exl3-2x-dgx-spark - GLM-5.3-Flash EXL3 on two DGX Spark at 1M context, 110k replay prefix-cache hits lifted from 0 to 97-98% by 3,584-token batches plus a drafter-prune patch.
  • rhys101/DeepSeek-V4.1-Flash-vLLM-DGX-Spark-8 - DeepSeek-V4.1-Flash under SGLang TP8/EP4 on eight DGX Spark with resident Engram, 131.72 tok/s code single request, eight 997,100-token prompts retrieved together.
  • RustRunner/DGX-Llama-Cluster - Three DGX Spark nodes as a switchless ConnectX-7 RDMA star running llama.cpp RPC, 384 GB pooled unified memory for 400B+ models in 4-bit, NFS model share.
  • sfxnz/DeepSeek-V4-Flash-Vision-Exp-vLLM-2x-DGX-Spark - DeepSeek-V4-Flash-Vision-Exp on two DGX Spark at TP=2, ViT loaded as a vLLM plugin that preserves DSpark-6 draft acceptance, 26.2 tok/s prose single stream at 1M context.
  • strusty/GLM-5.3-Flash-NVFP4-3x-DGX-Sparks-kindling-DGXOS - GLM-5.3-Flash NVFP4 at TP=3 on three DGX Spark in a switchless triangle on stock DGX OS, 3,054,135-token KV pool, about 3,500 tok/s cold prefill at 64k.
  • sudoingX/dgx-spark-deepseek-v41 - DeepSeek-V4.1-Flash-1017 on two DGX Spark as per-expert mixed-K EXL3 at 2.70 bpw under upstream vLLM with its own decode kernels, 100.7 tok/s code single stream, KLD 0.0243.
  • thomwebb/deepseek-v41-flash-spark-hybrid - Rank-0 grammar overlay for JSON Schema, regex and EBNF constrained decoding on a TensorFold DeepSeek-V4.1-Flash-1017 recipe across two DGX Spark, ordinary decode within 0.6% of the original.
  • tomsti/guides - GB10 cluster guide for DGX Spark over ConnectX-7 RoCE, covering NCCL rail pinning, the duplicate-MAC workaround, and MikroTik 400G switching.
  • tonyd2wild/DeepSeek-v4-Flash-Vision-Exp-DSpark-1M-NVFP4-KV-2x-DGX-Spark - DeepSeek-V4-Flash-Vision-Exp ported into vLLM on two or four DGX Spark at 1M context, 53 tok/s real-prompt decode single stream and a 2.79M-token NVFP4 KV pool at TP2.
  • tonyd2wild/DeepSeek-V4.1-Flash-TP2-and-TP4-DGX-Sparks - DeepSeek-V4.1-Flash-1017 lanes on two or four DGX Spark, TensorFold EXL3 against patched vLLM on one prompt set, 89.8 versus 48.5 tok/s C1 aggregate at TP4.
  • tonyd2wild/DS4-H3-Video-Gen-Factory - DeepSeek-V4-Flash at 1M context beside two MiniMax H3 video renders on two DGX Spark, 35% of idle throughput kept, and a load order set by H3's 50 GB footprint.
  • tonyd2wild/GLM-5.2-655K-MTP-4x-DGX-Spark---25-32tok-s - GLM-5.2 744B unpruned (QuantTrio Int4-Int8Mix) at 655,360-token context across four DGX Spark nodes via decode-context-parallelism, 23.0 tok/s single and 47.9 aggregate at 4 concurrent, MTP k=3.
  • tonyd2wild/GLM-5.2-QuantTrio-200K-4x-DGX-Spark--36tok-s - Speed-shape recipe for unpruned GLM-5.2 at 200K context on four DGX Spark nodes, 36 tok/s peak, 75 aggregate at 6 concurrent, 63% of each step overhead.
  • tonyd2wild/GLM-5.3-Flash-NVFP4-DFlash2-2x-DGX-Spark - GLM-5.3-Flash NVFP4 on two DGX Spark with knapcio's TP4 stack ported to TP2 and DFlash2, single-stream code decode 68.9 tok/s against 44.7 for the previous recipe at 262K context.
  • tonyd2wild/GLM-5.3-Flash-TensorFold-DGX-Spark - GLM-5.3-Flash EXL3 4-bit under TensorFold at TP4 on four DGX Spark, 127 tok/s code single stream against 121 for vLLM NVFP4 on the same harness, 500K window.
  • tonyd2wild/GLM-5.3-Int4-Int8Mix-TP4-4x-DGX-Spark - GLM-5.3 743B Int4-Int8Mix at TP4 on four DGX Spark, DFlash2 at 53.32 tok/s structured output (1.98x MTP-4, level on prose), NVFP4 KV pool of 293,447 tokens at 270K.
  • tonyd2wild/MiMo-V2.5-TP2-1M-NVFP4-KV-2xDGX-Spark - MiMo-V2.5 Omni at tensor-parallel 2 on two DGX Spark, NVFP4 4-bit KV cache for a 2.17M-token pool at 1M context, thinking-OFF eval 97.8 against 90.6.
  • tonyd2wild/MiMo-V2.5-TP3-NVFP4-KV-3xDGX-Spark - MiMo V2.5 Omni (310B MoE, text/image/video/audio) at tensor-parallel 3 across three DGX Sparks, with 4-bit NVFP4 KV cache for a ~10.6M-token KV pool at 1M context.
  • tonyd2wild/MiMo-V2.6-Flash-DGX-Spark-Recipe - MiMo-V2.6-Flash-RL on two DGX Spark under vLLM TP2 with DFlash and fp8 KV, 53.3 tok/s single stream under a 300K limit, after four patches to the stock image.
  • tonyd2wild/MiniMax-M3-2x-DGX-Spark-36-tok-s - Reproduction of a3refaat's MiniMax-M3 428B unpruned stack on two DGX Spark, W4A16 GPTQ with NVFP4 KV and EAGLE-3 at 36.6 tok/s single-stream JSON and 31.8 code, 196K context.
  • tonyd2wild/Minimax-M3-NVFP-3x-DGX-Sparks-TP-3 - MiniMax-M3 NVFP4 428B-A23B at tensor-parallel 3 across three DGX Sparks, 10.5 tok/s at 200K context over a switchless 200 Gb/s RoCE mesh.
  • tonyd2wild/MiniMax-M3.1-Flash-EXL3-TP2-2x-DGX-Spark - MiniMax-M3.1-Flash EXL3 2.15 bpw at TP2 on two DGX Spark with two vllm-exl3 patches for TP above 1, 300K context, 30.4 tok/s code and 19.8 prose single stream.
  • tonyd2wild/nfs-model-weights - NFS recipe for sharing one checkpoint across N DGX Spark nodes, taking a 4-node model library from 6.8 TB to 1.7 TB with no per-node copies.
  • tonyliu312/GLM-5.3-Flash-1M-Context-4x-DGX-Spark - GLM-5.3-Flash at 1,048,576-token context on four DGX Spark, 2.67x decode from dropping --enforce-eager and 1M concurrency from 1.35x to 4.20x by raising --kv-cache-memory, which silently overrides --gpu-memory-utilization.
  • tpurtell/ds41rt - Rust engine for DeepSeek V4.1 Flash with one RTX PRO 6000 coordinator and four DGX Spark expert workers, 146.12 tok/s C1 code with dSpark, 7,824 tok/s prefill.
  • tpurtell/glm-5.2-4x-spark-1x-rtx6k-96gb - Rust attention-FFN disaggregation engine for GLM-5.2 on one RTX PRO 6000 coordinator and four DGX Spark expert nodes, 26.6 NVFP4 and 28.5 EXL3 K3 tok/s weighted decode, 1,807 prefill.
  • tpurtell/sparknest - Distributed filesystem for a DGX Spark RDMA cluster with Hugging Face-aware placement and Raft metadata, a 35 GiB model replicated host to host in 9 s at 100G per rail.
  • tsarihan/glm-5.3-flash-fp4-local-1m-2x-dgx-spark-playbook - NVIDIA's GLM-5.3-Flash-FP4-Local at 1,048,576-token context on two DGX Spark under the b12x vLLM fork, a repeated 990K-token prefix back in 7.7 s against 587.5 s cold via aligned recurrent checkpoints.
  • tsarihan/qwen3.8-flash-next-nvfp4-2x-dgx-spark-playbook - Qwen3.8-Flash-Next NVFP4 against FP8 on the same two DGX Spark, 3.67x the KV pool and 66% more decode at 245K, needles 5/5 on both lanes.
  • Tutanka01/MiniChonk-DGX - Mistral Large 4 1T-A52B on two GB10 under llama.cpp RPC, routed experts cut from 128 to 112 per layer without requantizing, 233 to 206 GB, 9.2-11.5 tok/s with DSpark.
  • urbanspr1nter/dgx-spark-bare-metal - Four-node DGX Spark Ray and vLLM cluster on a Mikrotik switch, with an 8-node guide on 400 Gb/s breakout cables, plus GLM-5.2 NVFP4, Kimi K2.7 Code and DeepSeek-V4-Flash launchers.
  • ursuciprian/GLM-5.3-Flash-2x-DGX-Spark - GLM-5.3-Flash NVFP4 under SGLang on two DGX Spark with dense layers cast to FP8 at load and adaptive DFlash2, 63-65 tok/s code and 49-52 prose.
  • ursuciprian/qwen3.8-flash-next-dgx-spark-tp-2 - Qwen3.8-Flash-Next NVFP4 sparkrun recipe at TP=2 on two DGX Spark under vLLM with b12x kernels and MTP x4, 86.3 tok/s c1 at defaults, though DP=2 finishes agent replays 29-37% sooner.
  • vcruz305/kimi-k3-neuron-tp3-dgxspark-recipe - Kimi-K3 Neuron IQ1_S GGUF at TP3 on three DGX Spark through a SparkInfer patch series, 12.5 tok/s on repeat-heavy drafted output against a 6.49 matched baseline.
  • vroomfondel/dgxarley - Ansible playbooks for a K3s cluster of four DGX Spark nodes and an x86 control plane, SGLang over SR-IOV RoCE at 9.78 GB/s NCCL bus bandwidth.
  • Weschera/Ling-3.0-flash-VL-2x-DGX-Sparks - Ling-3.0-flash-VL FP8 on two DGX Spark under SGLang TP2 at 131,072 tokens, 26.0 tok/s single-stream on prose and 18.5 on code, with no MTP head.
  • www-ai-rs/gb10-deepseek-v4-flash - Two-node GB10 operator tooling and executed-code test harness for DeepSeek-V4-Flash 304B at 1M context, GPU rail power sampled at 2 Hz.
  • xin-osaka-u/Balanced-SGLang-Qwen3.8-Flash-Next-NVFP4-Dual-DGX-Spark - Qwen3.8-Flash-Next NVFP4 on two DGX Spark under SGLang TP=2 with nothing requantized and BF16 KV, GSM8K 97.35%, 112 tok/s on short Chinese JSON and 37 on prose.
  • yuichi-suzuki-highdrama/minimax-h3-multi-dgx-spark - ComfyUI nodes that split MiniMax H3 across two or four GB10 over a switchless ring with relay all-to-all and Triton INT8 GEMM, 10 s R2V in 363.2 s on four.
  • yunwei37/dgx-spark-4-ring-no-switch - Serving profiles and results log for four DGX Spark on a switchless ConnectX ring, DeepSeek-V4.1-Flash-1017 SGLang TP4 passing 1,039,058-token retrieval at 67.49 tok/s C1 geomean.
  • ZD-AI-Lab/Triple-GB10 - Three-node GB10 QSFP ring with three /30 subnets and forwarding routes, pooling about 300 GB for Ray and vLLM pipeline-parallel across 3 Sparks.
  • zorost/sparkduet - Model-swap layer for two DGX Spark, four checkpoints on disk behind one OpenAI port, DeepSeek-V4-Flash c1 from 72.2 tok/s on math to 33.6 on prose by DSpark draft acceptance.

Image & Media Generation

  • AEON-7/comfyui-aeon-spark - ComfyUI Docker for DGX Spark with SageAttention v3 compiled for sm_121a, CUDA 13, NVFP4, and Flux 2 / LTX 2.3 pre-bundled.
  • alexhegit/h3-spark.c - CUDA port of antirez/h3.c for MiniMax-H3 on GB10, 15.6 s warm for a 512x512 22-frame clip at layers 45 and reuse 2.
  • barkeslim-ops/ComfyUI-H3-Int8RowChunk - ComfyUI node that runs INT8 TensorWise Linear layers in 2,048-row chunks on GB10, bit-identical MiniMax H3 output in 674.6 s against 751.5 s.
  • bjarkebolding/spark-comfyui - Single-script containerized ComfyUI for DGX Spark, sm_121 SageAttention and sha256-verified workflow recipes, with a 2100 MHz clock cap for overcurrent reboots.
  • CoconutMacaroon/blender-arm64 - Blender build for GB10 aarch64 with CUDA, OptiX, and Vulkan, shipping a prebuilt DGX Spark binary release.
  • Deen-Media/dgx-monarch - ComfyUI nodes that split image and video renders across two DGX Spark, MiniMax H3 INT8 1280x720 241 frames in 23m07s against 42m03s on one.
  • dr-vij/ComfyUI-DGX-Spark-Docker-opinionated - ComfyUI Docker for DGX Spark with self-built aarch64 wheels for decord NVDEC, flash-attn and onnxruntime-gpu, plus a SAM3 blacklist for WanVAE hangs.
  • dr-vij/Hunyuan3D-2.1-DGX-Spark-Docker - Hunyuan3D-2.1 3D generation on DGX Spark via Docker Compose, building custom_rasterizer and DifferentiableRenderer CUDA components on-box.
  • dr-vij/Trellis2-DGX-Spark-Docker - Dockerized TRELLIS.2 3D generation for DGX Spark, with nvdiffrast, CuMesh, FlexGEMM, and torchvision built from source for sm_121 on CUDA 12.9.
  • drowzeys/keys-SM121-Optimized-MiniMax-H3-Nvidia-Sol-Engine-Kijai-SolAttn_Triton-Single-DGX-Spark - MiniMax H3 in ComfyUI on one DGX Spark with flex_attention forced to Triton where sm_121 miscompiles it, plus Sol-Engine FirstBlockCache and batched VAE ports at 1.54x end to end.
  • g0blinResearch/lyra2-dgx-spark - Docker build of NVIDIA's Lyra 2.0 for DGX Spark with a browser-served GUI, a 322-frame run in 29.5 minutes byte-identical to the native install.
  • Hitheshkaranth/LTX-2.5_Video_DGX_Spark_Setup - LTX-2.5 NVFP4 text and image-to-video with audio on DGX Spark via a three-line sm_121a kernel patch, 768x512 4 s clip in 61 s.
  • jeet0733/Rapid-H3 - ComfyUI node pack for MiniMax-H3 on one DGX Spark with INT8 sm_121 kernels and a 0.7x draft plus refine, 114 s per 768x1344 141-frame clip against 590-630 s stock.
  • joeynyc/cosmos-locateanything-dgx - Two-stage DGX Spark pipeline: Cosmos 3 video generation, then NVIDIA LocateAnything object grounding.
  • joeynyc/MiniMax-H3-DGX-Spark - MiniMax H3 FL2VA video generation on one DGX Spark via vLLM-Omni and online FP8, sm_121 loader and AdaLN patch, 111 s warm request or 80 s with Cache-DiT.
  • kabilankb/cosmos3-nano-gb10 - Cosmos3-Nano 16B video and image generation on a single GB10 instead of NVIDIA's recommended 8x H100, 480p 57-frame clips in about 3 minutes.
  • LectinDK/DGX-Spark-ComfyUI-Forge - ComfyUI Docker for DGX Spark, xformers CUTLASS off on sm_121, and a --disable-pinned-memory fix that holds DynamicVRAM at a 73-78 GB peak against 88.
  • luix93/DGX-Spark-ComfyUI - ComfyUI Docker Compose for DGX Spark with SageAttention 2 built against sm_121, NVFP4 via comfy_kitchen, and a copy=False patch for the unified-memory double-VRAM bug.
  • madeye/comfyui-minimax-h3-dgx-spark - MiniMax-H3 video and audio in ComfyUI on GB10 sm_121 with 4-to-8-step turbo LoRAs, where fp8_scaled runs 21% faster than the recommended int8_convrot at 11.50 against 14.26 s/it.
  • mmartial/ComfyUI-Nvidia-Docker - Multi-platform ComfyUI Docker (x86_64, Blackwell, DGX Spark) with published aarch64 DGX images and userscripts that build SageAttention 2 and comfy_kitchen from source.
  • mvalancy/blender-nvidia-gb10 - Blender 5.0.1 source build for GB10 with Cycles CUDA 13 GPU rendering, via four inherited aarch64 patches and four CUDA-13 patches for OIDN, libglu, Wayland, and libdrm.
  • phaserblast/ComfyUI-DGXSparkSafetensorsLoader - Zero-copy model loader for ComfyUI on DGX Spark using the fastsafetensors library.
  • slogonomo/lf-studio - Web studio and patch for NVIDIA Research's Sol-H3-Spark video and audio pipeline on one DGX Spark, first 5 s clip 99 s after launch against 282 s.
  • StefanMenne/gb10-assets - Self-hosted asset server for GB10 with REST, MCP, and Claude Code clients over FLUX.2 klein, LTX-2.5 NVFP4, Pixal3D, and an aarch64 source-built Blender.

Audio & Speech

  • 0mao0/dgx-spark-ming-tts - Ming-3.0-tts-tiny on one DGX Spark under vLLM 0.32 with a pinned vLLM-Omni overlay, 44.1 kHz streaming with 0.53 s warm first audio and 10 concurrent streams.
  • AEON-7/qwen3-asr-server - OpenAI /v1/audio/transcriptions server for Qwen3-ASR-0.6B on DGX Spark, vLLM-native with a pinned flashinfer and a soundfile decode path that avoids the PyAV fallback.
  • Aevonix/drama3-gb10-recipe - Fish Audio Drama 3 on one GB10 under SGLang-Omni with an sm_121 kernel-gate override and online FP8 patches, decode 23.9 to 38.85 tok/s, long-form RTF 0.94 to 0.58.
  • briancaffey/nemotron-asr-server - OpenAI-compatible speech-to-text server for nemotron-3.5-asr-streaming-0.6b on DGX Spark, native NeMo instead of the aarch64-broken Riva path, WebSocket streaming.
  • drowzeys/keys-ghost-machine-audio-visual-agent - Phone-browser voice and camera agent on DGX Spark with Nemotron 3.5 Bolt, Drama 3 and Cosmos3-Edge on TensorFold plus Parakeet, 0.47-0.55 s median voice to voice.
  • jayleaton/localrouter - Full-duplex voice assistant for one DGX Spark in a Zig daemon over MCP and OpenAI API, 0.9 s median voice turn, Qwen-Image 2.1 Turbo 1024x1024 in 6.3 s warm.
  • jethac/personaplex-gb10 - PersonaPlex-7B on GB10 at 46.5 ms per 80 ms audio frame against 101.7 stock, via w8a16 GEMV and depformer early exit, zero misses over a 30-minute soak.
  • jxlarrea/homeassistant-voice-recipes - Local Wyoming voice pipeline for Home Assistant, aarch64 ONNX Parakeet ASR, ECAPA-TDNN speaker extraction, and Gemma-4-26B-A4B with MTP on llama.cpp built for sm_121.
  • kedarpotdar-nv/spark-realtime-chatbot - On-device assistant for voice and video calls on one GB10, ~320 ms and ~850 ms end to end, using Qwen3-VL, Kokoro, and DeepFace.
  • Logos-Flux/spark-voice-pipeline - WebSocket voice assistant for DGX Spark, sentence-level streaming across whisper.cpp, Ollama, and VibeVoice-Realtime-0.5B, 766 ms to first audio.
  • luka-loehr/qwen3-tts-native - Rust and CUDA runtime for Qwen3-TTS-12Hz-1.7B-VoiceDesign on sm_121, single-stream p95 first audio 94-96 ms against SGLang's 2.69 s, SGLang ahead on aggregate throughput.
  • mARTin-B78/dgx-spark-faster-qwen3-tts - Faster-Qwen3-TTS on DGX Spark as an OpenAI-compatible API with CUDA-graph acceleration, four backends including chunk-streaming, and per-voice seeds for cloned voices.
  • Mekopa/whisperx-blackwell - Prebuilt WhisperX image with an sm_121 to sm_90 capability spoof and torchaudio jiterator patch, GPU pyannote diarization, 24 min audio in 62 s.
  • ncannings/fastconformer-trt - FP8 TensorRT engine for NeMo FastConformer ASR, parakeet-ultra at 4,903x real time and 1.814% test-clean WER on DGX Spark, against 999x and 1.803% for stock NeMo.
  • pipecat-ai/nemotron-voicechat-dgx-spark - Full-duplex speech-to-speech NemotronLabs VoiceChat 11B on one DGX Spark, GPTQ W8 Nano and W8A32 EarTTS at ~66 ms against the 80 ms frame budget.
  • Pizzaman213/fish-s2pro-gb10 - GB10-tuned Fish Audio S2-Pro TTS reaching 31.3 tok/s from 1.2 via bit-exact int8 kernels, speculative decode, and quality-gated NVFP4 weights.
  • WillIsback/whisperx-gb10 - WhisperX transcription and pyannote diarization REST API for GB10 (aarch64, sm_121), with an async job queue, SRT/VTT/TXT export, and prebuilt Docker Hub/GHCR images on NGC PyTorch 25.05.

Science & HPC

Beyond LLMs, GB10's unified memory and aarch64 stack run scientific compute: protein folding, biomolecular prediction, and RAN simulation.

  • adrian-greenneuron/openfold3-DGX-Spark - Dockerized OpenFold3 for DGX Spark with evoformer_attn kernels prebuilt, DeepSpeed patched from compute_121 to compute_120, ubiquitin prediction in 55 s.
  • Baremetal-Bioinformatics/nomics - Rust and CUDA reimplementation of nf-core/sarek 3.10.0 germline on one DGX Spark, an HG002 30x genome in 1 h against 11 h 24 min with identical VCF records.
  • chaoticcuriosity-io/g1-humanoid-rl - Unitree G1 humanoid RL on DGX Spark with mjlab, walking policy trained in about 46 min at 2048 envs and an 11 h cartwheel run at 4096 envs.
  • chaoticcuriosity-io/regolith - Synthetic-data lunar segmentation on DGX Spark with Isaac Sim 6.0 Replicator and SegFormer, where realistic ground cut real-photo rock over-prediction from 72.6% to 35.7%.
  • eetmie/spark-projects - Robotics playbooks for GB10 including openpi pi0.5 vision-language-action inference at 94.7 ms on TensorRT FP8 and NVFP4, 2.12x PyTorch BF16 at cosine 0.997.
  • MadhanJ05/gb10-quickstart - Four scripts taking a Dell Pro Max GB10 to Tailscale SSH and NVIDIA ALCHEMI, MACE with cuEquivariance at 18,874 atom-steps/s against 2,257 for plain e3nn.
  • mkorayemai-web/vesuvius-band-sweep - Herculaneum scroll pipeline on one GB10 with aarch64 image builds, 960 fitted papyrus windings released, and a negative ink screen it limits to strong ink.
  • pilsu-choi/dgx-spark-physical-ai - Isaac Sim 6.1, Isaac Lab 3.0.0-EA, and Cosmos3-Nano on a GB10 ThinkStation PGX with raw run logs, a 720x1280 189-frame clip in 32 min 43 s.
  • rcbarke/ai-ran-dgx-spark - Bring-up notes for NVIDIA Aerial and Sionna on DGX Spark, with Sionna PHY and SYS working, cuMAC retargeted to run, and Sionna-RT and the 7.2x fronthaul blocked.
  • sanjyotshenoy/boltz-gb10-spark - Boltz-2 fork for DGX Spark whose installer adds CUDA 13 cuEquivariance kernels and Triton 3.6 nightly to clear the sm_121a ptxas error.
  • seematsu/pai-final-assignment - LabUtopia ACT imitation learning reproduced on one DGX Spark with Isaac Sim 5.1.0 on aarch64, a gripper-squeeze fix lifting Heater Beaker from 0/3 to 46/50.
  • solidsf-inc/sfFFT - Fused single-launch FFT convolution kernel for GB10 on fp16 tensor cores, 3.8-6.1x over a cuFFT pipeline at L=128-8192 with an error-budget plan selector.

Remote Access & Desktop

  • a-funk/GameSpark - Steam benchmark runner, per-layer FEX profiler, and per-game tuning for DGX Spark, Cyberpunk 2077 at 1080p High from 49.0 fps to 69.2 with system FEX 2610 and native Vulkan.
  • AtomicGaryBusey/DGXSparkGaming - Steam gaming compatibility log for DGX Spark under FEX-Emu, Box64, and Proton, with DLSS 4 frame generation working, DLSS 5 ruled out per frame, and every correction published.
  • pqant/mac-dgx10-direct-link - Upgrade-safe USB-C CDC-NCM link between a Mac and a GB10 box, DKMS Apple-quirk module plus IRQ, RPS, and NTB tuning from 0.73 to 7.8 Gb/s.
  • seanGSISG/dgx-spark-sunshine-setup - One-command Sunshine installer for headless DGX Spark, NVIDIA CustomEDID virtual display with no dummy plug, 4K60 or 1440p120 within the GB10 pixel clock limit.

Tools & Monitoring

  • Adithya-Rajendran/gb10-hardening - Host hardening for GB10 whose memory guard reads MemAvailable minus KReclaimable, killing an 82 GB over-commit mid-ramp with the box recovered in 4 s on a GX10.
  • agjs/gb10-clock-cap - Clock-cap harness for GB10 inference hosts, where 2200 MHz ran 12 °C cooler at 36% less GPU-rail power for 1.0% decode and 3.9% prefill cost, single-stream at TP=2.
  • amer8/pulsebar - Unofficial macOS menu bar monitor that streams GPU and memory telemetry from the DGX Spark dashboard.
  • antheas/spark_hwmon - Linux hwmon kernel driver exposing GB10 system power telemetry (per-rail power, energy counters, temperatures) and PL1/PL2 power-cap controls via sysfs.
  • ateska/dgx-spark-prometheus - Single-binary Go Prometheus exporter with systemd unit and Grafana dashboard for DGX Spark, GB10 and NIC metrics on port 9835.
  • chappa-ai-llc/spark-smi - System-monitor TUI for DGX Spark with unified-memory and Grace P/E-core awareness, a cluster fleet view, an MT2910 fabric bandwidth test, and mixed sm_121 plus sm_86 support.
  • christopherowen/dgx-spark-fan-control - Kernel driver and CLI for RPM floors above NVIDIA's fan curve on DGX Spark, 13500 RPM floor measured at 9000 RPM in 6.3 s, with DKMS and Secure Boot signing.
  • DanTup/dgx_dashboard - Monitoring dashboard for DGX Spark bound to 0.0.0.0, with GB/GiB-correct memory stats, GPU power draw, and Docker container controls.
  • djmad/Spark_Energy_Management - Thermal and power controller for a ThinkStation PGX (GB10) with per-cluster CPU PID loops, a 100 MHz/s GPU clock ramp, and a thermal twin fitted to 1.2 K RMS.
  • dorangao/dgx-spark-toolkit - Two-node DGX Spark cluster scripts and manifests: RoCE and NCCL checks on the 200 Gb/s fabric, RDMA pods, MetalLB, pipeline-parallel vLLM Nemotron-3 Nano 30B.
  • drowzeys/vllm-gb10-spin-wait-fix - One-command patcher and English write-up for the vLLM spin-wait that heats GB10, 24 °C lower average SoC temperature on TP=2 multi-rank serves and no change at TP=1.
  • engineering87/sparkfit - Zero-dependency memory planner for DGX Spark: 128 GB budget split, quantization advisor, and decode roofline on 273 GB/s.
  • hectorTSH/dgx-spark-memory-dashboard - Live unified-memory occupancy map for DGX Spark as 1 GiB tiles, hot models against on-disk candidates ranked by free memory, and multi-Spark tabs.
  • hoesing/spark-gpu-throttle-check - Throttle test for DGX Spark that loads the GB10 with cuBLAS matmuls and flags clocks staying below a 1400 MHz threshold, a suspected USB-PD power-delivery fault.
  • ivanusto/gb10-ops - Host guards for GB10 that terminate the offending GPU process below 3 GiB MemAvailable and abort jobs after 240 s at 88 C, thresholds calibrated on one two-node box.
  • jasonacox/dgx-spark - Project hub for GB10 whose nanochat scripts pretrained a chat model from scratch in 9 days for about $8 of power, plus two-Spark InfiniBand training.
  • jeffrymahbuubi/dgx-spark-stress-test - Burn-in suite for GB10 unit qualification, 6-24 hour llama.cpp 70B plus SDXL load at ~96% utilization, ~85 GB resident, with 10s temperature and power CSVs.
  • jeremyeder/dgx-agentskills - Claude Code integration for DGX Spark: local model serving, GPU monitoring, and VM management.
  • joeynyc/spark-doctor - Read-only DGX Spark diagnostic CLI: 14 W power cap, unified-memory pressure, thermal risk, CUDA 13 / sm_121 wheel mismatches, Docker runtime, and recipe checks for tensor-parallel size and memory budget.
  • knapcio/spark-tools - Python simulators and checkers for GB10 serving, a decode-cycle model within 3.71% on six validation runs, EXL3 and EXLR8 decoder conformance, and RoCE preflight.
  • lcasarin-maker/blackbox - Forensic capture for GB10 hangs with Xid, PCIe AER, xHCI and PSI checks, plus an unofficial dmem patch charging cudaMalloc to the cgroup, pinned and managed memory excluded.
  • lynx-lee/lynx-ollama - Ollama manager with a Go web console whose optimize command reads GB10 unified memory to set 131K context, 8-way parallel, and q8_0 KV cache.
  • mcampa/sparkrun-ui - Web UI for sparkrun with launch wizard, chat, benchmark charts, and live per-host GPU bars, run via npx or a published aarch64 container.
  • mchenetz/sparkd - Localhost dashboard for a DGX Spark fleet, with HF browsing, Claude-generated vLLM recipes, and single-box or Ray-cluster launch.
  • metaspartan/sparktop - Agentless TUI and web dashboard for multi-node DGX Spark that reads RDMA vport counters, where /proc/net/dev showed 5.6 MB against 325 GB moved, plus silent low-clock alerts.
  • MiaAI-Lab/sparkDash - Web dashboard for a DGX Spark fleet with an LLM probe for eleven engines including vLLM, SGLang, ds4, and EXL3, per-port RoCE/RDMA counters, and a seeded quality bench.
  • parallelArchitect/sparkview - Terminal GPU monitor with GB10-aware unified-memory reporting, memory-pressure (PSI) and power-rail readouts, and an anomaly auto-logger.
  • r0b0tlab/hermes-concurrent-agents - Supervised Hermes Agent worker pool for one Linux host, with pre-claim admission, exact process ownership, and optional GB10 memory-pressure presets.
  • securitysonar/spark-hashcat - Hashcat REST API service for GB10 aarch64, with an NVRTC CUDA build path that bypasses OpenCL.
  • skymaze/Fireworks - Web control plane for a DGX Spark fleet, ARP-probed RoCE rail configuration with rollback, and model direct-pull to workers over the four rails.
  • slogonomo/spark-switchboard - On-demand front door for LLM, ComfyUI, and video apps on one DGX Spark that starts each on first request and stops idle ones by measured unified memory.
  • stevibe/SparklingKit - Local-first workspace for OCR, transcription, grounding, and image jobs, routed to six co-resident models on one DGX Spark from Qwen3.6-35B-A3B NVFP4 to LocateAnything-3B.
  • tenhkspark/dgx-spark-fan-tuning - Fan curve patch for christopherowen's controller on four DGX Spark, with the 0-RPM trap that clamps GPU clocks to 611 MHz and October 2026 firmware that breaks fan control.
  • TheAwaken1/Spark-Studio - Launch and tuning dashboard for vLLM, SGLang, llama.cpp, and sparkrun recipes on DGX Spark that hands a broken recipe to Claude Code or Codex to patch and relaunch.
  • tiong6/spark-center - Localhost control panel for GB10 machines with an apt update picker that simulates before installing, .deb rollback, fwupd firmware checks, and a 611 MHz stuck-clock alert.
  • volfco/dgx-spark-more-diag - Root-cause toolkit for GB10 power-offs under GPU load with 50 Hz SPBM power-register telemetry, whose one-unit RMA case traced 2400 MHz cuts to a thermal interface fixed by repaste.
  • vybe/sparky - Vue 3 web UI for DGX Spark with Ollama chat, a Claude Code agent tab, ComfyUI SDXL and Flux generation, and Docker/systemd control.
  • wentbackward/nv-monitor - Terminal monitor and Prometheus exporter for DGX Spark in one zero-dependency C binary, with HugePages-correct unified memory and Grace big.LITTLE core labels.
  • Z841973620/dgx-spark-fan-override - Kernel module overriding DGX Spark fan speed through the EC's FF-A eSPI mailbox, with the stock firmware's two temperature curves and 1,260-13,500 RPM ranges documented.

Operating Systems & Containers

  • graham33/nixos-dgx-spark - Nix flake with a NixOS module for NVIDIA's DGX Spark kernel, bootable USB image, and 15 playbook devshells for TRT-LLM, NVFP4, and NCCL over QSFP.
  • kindlingai/kindling-spark-os - Read-only OS image for GB10 booted beside DGX OS with auto-revert and a 2 GiB display carveout lent to CUDA, GLM-5.3 TP=4 KV pool 365,440 to 404,608 tokens.
  • kyuz0/gb10-toolboxes - Prebuilt aarch64 CUDA 13.x containers for GB10 sm_121 with llama.cpp, antirez/ds4 and vLLM, rebuilt on four-hour upstream polls.
  • maxspevack/spark-rocky - Rocky Linux 10.2 Live-USB for DGX Spark on the CIQ 6.18 kernel, shipping 4k pages because 64k faults on every driver branch but the 580, measured 10.4% slower.
  • RageLtd/arch-dgx-spark-iso - Arch Linux installer ISO builder for DGX Spark, with the linux-dgx-spark kernel and archinstall config.

Community & Resource Collections

  • AEON-7/AEON-7 - Index of AEON-7's releases, mainly DGX Spark NVFP4 model packs, prebuilt vLLM images, and a voice-AI stack, plus Apple Silicon MLX builds.
  • odnodn/dgx-spark - Curated collection of NVIDIA DGX Spark resources and self-hosted AI projects.

Contributing

Contributions are welcome. Read the contribution guidelines before opening a pull request.

Miroir archivé depuis le dépôt GitHub officiel · Voir sur GitHub
Date du snapshot : 2026-11-11