REFERENCE CONFIGURATION · UPDATED 10 NOVEMBER 2026

8× RTX PRO 6000 server: reference configuration and price

Eight NVIDIA RTX PRO 6000 Blackwell Server Edition GPUs give 768GB of GPU memory in a single 4U server. Below are two reference builds on our NX-G8 Dual SP5 platform with dual AMD EPYC 9004-series processors, with every component and its indicative price from our online configurator, followed by what to plan for power, cooling and software.

At a glance

768GB GPU memory

8 × 96GB GDDR7 with ECC. Each GPU can be split into up to four isolated instances with Multi-Instance GPU.

Dual AMD EPYC 9004

Socket SP5 platform with DDR5 ECC registered memory in up to 24 slots.

Up to 4.8kW for the GPUs

Each RTX PRO 6000 Server Edition draws up to 600W (configurable) and relies on the server’s airflow.

From $121,384 indicative

Including eight GPUs, processors, memory, storage, networking and a 3-year commercial hardware warranty.

Two reference builds for an 8× RTX PRO 6000 server

Indicative prices in US dollars from our configurator on 10 November 2026. VAT, delivery and availability are confirmed in your written quote, and component prices — especially for GPUs and memory — can change.

Component Balanced build Price Entry build Price
Platform NX-G8 Dual SP5 $8,162.00 NX-G8 Dual SP5 $8,162.00
GPUs 8× RTX PRO 6000 Blackwell Server Edition 96GB $95,200.00 8× RTX PRO 6000 Blackwell Server Edition 96GB $95,200.00
Processors 2× AMD EPYC 9354, 32 cores, 3.3 GHz, 256MB L3 $3,612.00 2× AMD EPYC 9124, 16 cores, 3.0 GHz, 64MB L3 $1,960.00
Memory 24× 32GB DDR5-4800 ECC RDIMM (768GB) $26,400.00 12× 32GB DDR5-4800 ECC RDIMM (384GB) $13,200.00
Data storage 7.68TB U.2 NVMe (Samsung PM9A3) $3,750.00 3.84TB U.2 NVMe (Samsung PM9A3) $2,050.00
System storage 2× 1.92TB M.2 NVMe (Samsung PM9A3) $2,700.00 2× 1TB M.2 NVMe (Samsung 990 PRO) $580.00
Network 2-port 100GbE (QSFP28) $578.20 2-port 25GbE (SFP28) $212.40
Operating system Ubuntu Server 24.04 LTS installation $20.00 Ubuntu Server 24.04 LTS installation $20.00
Rails, power cables Included $0.00 Included $0.00
Warranty 3-year commercial hardware warranty Included 3-year commercial hardware warranty Included
Indicative total $140,422.20 $121,384.40

A 5-year commercial hardware warranty upgrade can be selected in the configurator; its scope and price are confirmed in the quote.

Why these components

  • Memory equal to GPU memory. The balanced build has 768GB of system memory, the same as the GPUs, which makes loading large models and feeding data pipelines easier. Its 24 modules populate all 12 DDR5 channels of each EPYC 9004 processor for full memory bandwidth.
  • Eight CPU cores per GPU. Two 32-core EPYC 9354 processors leave headroom for data preparation, tokenisation and serving software. The entry build’s two 16-core EPYC 9124 processors suit inference where models are loaded once and the GPUs do the work.
  • Local NVMe. Model weights for 768GB of GPU memory are large; fast local storage shortens load times and holds datasets and checkpoints.
  • Networking for the workload. 100GbE suits fast data transfer or several servers working together; 25GbE is enough for a single inference server serving users.

What 768GB of GPU memory is good for

  • Serving several large models at once, for example multiple 70B-class models in 8-bit, each on its own GPU or pair of GPUs.
  • Very large models across all eight GPUs. Models with several hundred billion parameters can fit in 8-bit or 4-bit form using tensor or pipeline parallelism. The RTX PRO 6000 has no NVLink, so GPUs communicate over PCIe; this works well for inference but is slower than NVLink-connected systems for training a single large model.
  • Multi-team or multi-tenant use. With Multi-Instance GPU, each card can be divided into up to four isolated instances — up to 32 in one server.
  • Fine-tuning, rendering and simulation, where Blackwell’s FP4 and FP8 support, RT cores and video engines are useful.

Power, cooling and where it runs

The eight GPUs alone can draw up to 4.8kW, so the complete server needs more than 5kW at full load. Plan a rack position, power circuits and cooling for that load. The passive GPUs depend on strong front-to-back airflow, and the server is loud — a data centre or colocation facility is the right place for it. We confirm the power budget and power supply configuration in the quote and can arrange colocation in Bulgaria.

Alternatives

  • More memory bandwidth: eight H200 NVL GPUs give 1,128GB of HBM3e and NVLink between GPUs, at about $235,920 for the GPUs alone at indicative prices. See RTX PRO 6000 vs H200 NVL.
  • Lower budget: fewer RTX PRO 6000 GPUs now, with room to add more later in the same platform, or RTX 5090 32GB cards for models that fit in 32GB per GPU.
  • Single-socket or PCIe 4.0 platforms: our other 4U servers cost less but run PCIe 5.0 GPUs at PCIe 4.0 speed.

Get this server from NodeX

NodeX NX-G8 Dual SP5, the platform of the 8× RTX PRO 6000 server
NX-G8 Dual SP5: up to 8 GPUs with dual AMD EPYC SP5 processors and DDR5 ECC memory.

Start from one of the builds above in the configurator, change any component, and send the configuration as an enquiry. We check compatibility, power and cooling and reply with a written quotation that states the final price, lead time and warranty. Submitting an enquiry does not place an order.

Frequently asked questions

Are these prices final?

No. They are indicative prices from our configurator. The written quotation confirms the final price, VAT, delivery and availability. GPU and memory prices in particular change over time.

Can I use the RTX PRO 6000 Workstation Edition instead?

The Server Edition is designed for passive cooling in servers like this one. The Workstation Edition has its own fans for desktop workstations. Ask us if you have a specific reason to consider it.

Can this server be used for GPU rental on Vast.ai?

Yes, it can be set up for rental platforms, but income depends on demand and is not guaranteed. Read our Vast.ai hosting guide before deciding.

Which warranty is included?

A 3-year commercial hardware warranty is included, with an optional 5-year upgrade. The scope is confirmed in the quote, and your statutory rights are unaffected. See our Warranty Policy.

Sources

Specifications and platform details on this page come from the published sources below. Prices come from our configurator on the date shown at the top of the page.