Kentino AI Node H100 — 8× NVIDIA H100 SXM5, 640 GB HBM3

Kentino AI Node H100 640 GB HBM3, NVSwitch-Pooled 8x H100 SXM5 | 15,832 INT8 TOPS 640 GB HBM3 pool 3.35 TB/s per-GPU bandwidth 900 GB/s any-to-any NVLink fp8 native The Hopper reference node - the best-understood 8-GPU platform in production. An 8U node carrying eight NVIDIA H100 SXM5 80 GB modules on a single NVLink/NVSwitch baseboard: 640 GB of HBM3 at 3.35 TB/s per GPU, full any-to-any 900 GB/s GPU-to-GPU bandwidth, dual Intel Xeon Gold 6538Y+, 2 TB DDR5 ECC RDIMM and U.2 NVMe storage. The H100 is the most widely benchmarked 8-GPU platform in existence, which matters more than it sounds: if you have an existing training recipe, a vendor SLA or a procurement process built around H100 numbers, this is the node that matches them without re-validation. Hardware Component Detail GPUs 8x NVIDIA H100 SXM5 80 GB HBM3 (Hopper, 700 W per module) VRAM pool 640 GB HBM3, NVSwitch-pooled Memory bandwidth 3.35 TB/s per GPU GPU interconnect NVLink 4 via NVSwitch, 900 GB/s any-to-any Compute 7,912 TFLOPS bf16 dense | 15,832 TFLOPS fp8 dense | 15,832 INT8 TOPS CPUs 2x Intel Xeon Gold 6538Y+, 32C/64T each (64C/128T). Platinum 8558 (96C/192T) available as an upgrade System memory 2 TB DDR5 ECC RDIMM (16x 128 GB) Storage 2x 1.92 TB U.2 NVMe boot + 2x 3.84 TB U.2 NVMe data Networking 2x NVIDIA ConnectX-7. Up to 8x on request Chassis 8U rack-mount, front-to-back airflow, 24/7 rated Power 6x 3000 W (3+3) redundant Titanium What it runs 640 GB covers the whole current open-weight landscape at fp8 or Q4. Estimates are for this 8-GPU configuration with tensor parallelism. Component Detail Llama 3.3 70B / Qwen3-72B fp8. ~90-130 tok/s single stream, 5,000+ tok/s batched DeepSeek-V3.2 / R1 671B Q4 comfortably; fp8 needs weight streaming at this pool size Qwen3-235B-A22B MoE fp8 native with context headroom Qwen3-Coder-480B-A35B Q4 agentic coding, full 8-GPU tensor parallel Full fine-tune 70B 8-way tensor parallel Mixed multi-tenant several 70B-class models resident simultaneously Throughput figures are estimates derived from published vendor specifications and community benchmarks for this GPU generation, not measurements taken on this exact configuration. We will give you measured numbers for your model and context length before you commit. Power and cooling Roughly 6.7 kW sustained - identical envelope to the H200 node. Dedicated 32 A three-phase feed per node, rack budget around one node per 10 kW, contained cold aisle below 24 C with genuine front-to-back airflow for 24/7 operation. Export control - read this before ordering The H100 is an Advanced Computing Item (ECCN 3A090.a). Shipment requires a completed KYC form and an End User Certificate naming the end user, the installation address and the intended use. Budget several weeks for clearance on top of hardware lead time. If the end user cannot be named, this hardware cannot be supplied. We do not charge you for any of this. Screening, the paperwork and the filing are part of the price - there is no compliance fee and no surcharge. What it costs you is time, not money. No clearance, no shipment. There is no version of this where the hardware leaves our hands before the check is complete. We will tell you where your file stands at each step rather than leaving you to guess, and we will tell you early and plainly if it looks like it will not clear. What you get from Kentino Kentino supplies, configures and supports this node as a complete deployment: rack and power design against your site's actual feed, front-to-back airflow sizing for 24/7 operation, OS and driver stack (Ubuntu with pinned NVIDIA driver, CUDA, container toolkit), the inference or training stack of your choice, burn-in with a written report, EU-based logistics and warranty. We also handle the export paperwork with you rather than mailing you a form and hoping. That part takes longer than the hardware and is where most first-time buyers of this class of machine get stuck. Price shown is EUR excluding VAT, EXW Prague (Incoterms 2020). Collection, freight, insurance and any destination import duties are for the buyer’s account. Lead time on request. Before you order this, ask us to quote the H200 node alongside it - at current channel pricing the 8x H200 baseboard often lands at or below the H100 board while carrying 1,128 GB instead of 640 GB. We would rather tell you that up front than sell you the wrong node. Restricted territories. We do not sell or ship to territories subject to European Union, United States or United Nations sanctions or embargoes, and we cannot supply any person or entity named on an applicable restricted-party list. We screen the buyer and the end user against those lists immediately before every dispatch.