From e78edf14d7e8378d4aeffd89fcfc77011054c523 Mon Sep 17 00:00:00 2001 From: Mo King Date: Thu, 12 Feb 2026 13:00:49 -0500 Subject: [PATCH] Update GPU/CPU types --- README.md | 12 ++++-- references/cpu-types.mdx | 26 ++++++++++-- references/gpu-types.mdx | 92 ++++++++++++++++++++-------------------- 3 files changed, 79 insertions(+), 51 deletions(-) diff --git a/README.md b/README.md index c6f17e19..740dcb59 100644 --- a/README.md +++ b/README.md @@ -38,7 +38,7 @@ vale path/to/*.md Install `blacken-docs`. ```bash -python -m pip install blacken-docs +python3 -m pip install blacken-docs ``` Run the formatter. @@ -54,6 +54,12 @@ git ls-files -z -- '*.md' | xargs -0 blacken-docs ## Update CPU and GPUs ```bash -python helpers/gpu-types.py -python helpers/cpu-types.py +# Set up virtual environment +python3 -m venv helpers/venv +source helpers/venv/bin/activate +pip install -r helpers/requirements.txt + +# Run scripts +python3 helpers/gpu_types.py +python3 helpers/sls_cpu_types.py ``` diff --git a/references/cpu-types.mdx b/references/cpu-types.mdx index 15d8e015..9bf44ff9 100644 --- a/references/cpu-types.mdx +++ b/references/cpu-types.mdx @@ -1,11 +1,10 @@ --- -title: "Serverless CPU types" -sidebarTitle: "CPU types" +title: Serverless CPU types --- The following list contains all CPU types available on Runpod. -{/* Table last generated: 2025-08-23 */} +{/* Table last generated: 2026-02-12 */} | Display Name | Cores | Threads Per Core | |-------------------------------------------------|---------|--------------------| @@ -29,7 +28,9 @@ The following list contains all CPU types available on Runpod. | 13th Gen Intel(R) Core(TM) i9-13900K | 24 | 1 | | 13th Gen Intel(R) Core(TM) i9-13900KF | 24 | 1 | | AMD Eng Sample: 100-000000053-04_32/20_N | 48 | 1 | +| AMD Eng Sample: 100-000000314-04_30/16_N | 64 | 2 | | AMD Eng Sample: 100-000000897-03 | 32 | 2 | +| AMD Eng Sample: 100-000001245-08 | 128 | 2 | | AMD EPYC 4564P 16-Core Processor | 16 | 2 | | AMD EPYC 7251 8-Core Processor | 8 | 2 | | AMD EPYC 7252 8-Core Processor | 8 | 2 | @@ -62,6 +63,7 @@ The following list contains all CPU types available on Runpod. | AMD EPYC 7551 32-Core Processor | 32 | 2 | | AMD EPYC 7551P 32-Core Processor | 32 | 2 | | AMD EPYC 7552 48-Core Processor | 48 | 2 | +| AMD EPYC 7573X 32-Core Processor | 32 | 2 | | AMD EPYC 75F3 32-Core Processor | 32 | 2 | | AMD EPYC 7601 32-Core Processor | 32 | 2 | | AMD EPYC 7642 48-Core Processor | 48 | 2 | @@ -83,6 +85,7 @@ The following list contains all CPU types available on Runpod. | AMD EPYC 7H12 64-Core Processor | 64 | 2 | | AMD EPYC 7J13 64-Core Processor | 64 | 2 | | AMD EPYC 7K62 48-Core Processor | 48 | 2 | +| AMD EPYC 7R13 Processor | 48 | 2 | | AMD EPYC 7R32 48-Core Processor | 48 | 2 | | AMD EPYC 7T83 64-Core Processor | 127 | 1 | | AMD EPYC 7V13 64-Core Processor | 24 | 1 | @@ -91,6 +94,7 @@ The following list contains all CPU types available on Runpod. | AMD EPYC 9274F 24-Core Processor | 24 | 2 | | AMD EPYC 9334 32-Core Processor | 32 | 2 | | AMD EPYC 9335 32-Core Processor | 32 | 2 | +| AMD EPYC 9354 32-Core Emb Processor | 32 | 2 | | AMD EPYC 9354 32-Core Processor | 32 | 2 | | AMD EPYC 9354P | 64 | 1 | | AMD EPYC 9354P 32-Core Processor | 32 | 2 | @@ -99,15 +103,23 @@ The following list contains all CPU types available on Runpod. | AMD EPYC 9374F 32-Core Processor | 32 | 1 | | AMD EPYC 9454 48-Core Processor | 48 | 2 | | AMD EPYC 9454P 48-Core Emb Processor | 48 | 2 | +| AMD EPYC 9455 48-Core Processor | 48 | 2 | | AMD EPYC 9455P 48-Core Processor | 48 | 2 | | AMD EPYC 9474F 48-Core Processor | 48 | 2 | | AMD EPYC 9534 64-Core Processor | 64 | 2 | +| AMD EPYC 9535 64-Core Processor | 64 | 2 | | AMD EPYC 9554 64-Core Emb Processor | 64 | 1 | | AMD EPYC 9554 64-Core Processor | 126 | 1 | | AMD EPYC 9555 64-Core Processor | 56 | 2 | +| AMD EPYC 9575F 64-Core Processor | 64 | 2 | | AMD EPYC 9654 96-Core Emb Processor | 96 | 1 | | AMD EPYC 9654 96-Core Processor | 96 | 2 | +| AMD EPYC 9655 96-Core Processor | 56 | 2 | +| AMD EPYC 9655P 96-Core Processor | 96 | 2 | | AMD EPYC 9754 128-Core Processor | 128 | 2 | +| AMD EPYC 9755 128-Core Processor | 128 | 2 | +| AMD EPYC 9B14 96-Core Processor | 96 | 1 | +| AMD EPYC 9J14 96-Core Processor | 96 | 2 | | AMD EPYC Processor | 1 | 1 | | AMD EPYC Processor (with IBPB) | 16 | 1 | | AMD EPYC-Rome Processor | 16 | 1 | @@ -127,6 +139,7 @@ The following list contains all CPU types available on Runpod. | AMD Ryzen 5 PRO 2600 Six-Core Processor | 6 | 2 | | AMD Ryzen 7 1700 Eight-Core Processor | 8 | 2 | | AMD Ryzen 7 1700X Eight-Core Processor | 8 | 2 | +| AMD Ryzen 7 3700X 8-Core Processor | 16 | 1 | | AMD Ryzen 7 5700G with Radeon Graphics | 8 | 2 | | AMD Ryzen 7 5700X 8-Core Processor | 8 | 2 | | AMD Ryzen 7 5800X 8-Core Processor | 8 | 2 | @@ -138,6 +151,7 @@ The following list contains all CPU types available on Runpod. | AMD Ryzen 9 7900 12-Core Processor | 12 | 2 | | AMD Ryzen 9 7950X 16-Core Processor | 16 | 2 | | AMD Ryzen 9 7950X3D 16-Core Processor | 16 | 2 | +| AMD Ryzen 9 9900X 12-Core Processor | 12 | 2 | | AMD Ryzen 9 9950X 16-Core Processor | 16 | 2 | | AMD Ryzen Threadripper 1900X 8-Core Processor | 8 | 2 | | AMD Ryzen Threadripper 1920X 12-Core Processor | 12 | 2 | @@ -148,6 +162,7 @@ The following list contains all CPU types available on Runpod. | AMD Ryzen Threadripper 2990WX 32-Core Processor | 32 | 2 | | AMD Ryzen Threadripper 3960X 24-Core Processor | 24 | 2 | | AMD Ryzen Threadripper 7960X 24-Cores | 24 | 2 | +| AMD Ryzen Threadripper 9960X 24-Cores | 24 | 2 | | Ryzen Threadripper PRO 3955WX | 16 | 2 | | AMD Ryzen Threadripper PRO 3975WX 32-Cores | 32 | 2 | | AMD Ryzen Threadripper PRO 3995WX 64-Cores | 64 | 2 | @@ -197,8 +212,11 @@ The following list contains all CPU types available on Runpod. | Intel(R) Core(TM) Ultra 5 245K | 1 | 1 | | Intel(R) Pentium(R) CPU G3260 @ 3.30GHz | 2 | 1 | | Intel(R) Pentium(R) CPU G4560 @ 3.50GHz | 2 | 2 | +| Intel(R) Xeon(R) 6732P | 32 | 2 | | Intel(R) Xeon(R) 6747P | 48 | 2 | | Intel(R) Xeon(R) 6767P | 64 | 2 | +| Intel(R) Xeon(R) 6787P | 86 | 1 | +| Intel(R) Xeon(R) 6952P | 96 | 2 | | Intel(R) Xeon(R) 6960P | 72 | 2 | | Intel(R) Xeon(R) Bronze 3204 CPU @ 1.90GHz | 6 | 1 | | Intel(R) Xeon(R) CPU X5660 @ 2.80GHz | 6 | 2 | @@ -261,6 +279,7 @@ The following list contains all CPU types available on Runpod. | Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz | 24 | 2 | | Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz | 28 | 2 | | Intel(R) Xeon(R) Gold 6448Y | 32 | 2 | +| INTEL(R) XEON(R) GOLD 6530 | 32 | 2 | | INTEL(R) XEON(R) GOLD 6548Y+ | 32 | 2 | | Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz | 24 | 2 | | Intel(R) Xeon(R) Platinum 8168 CPU @ 2.70GHz | 24 | 2 | @@ -282,6 +301,7 @@ The following list contains all CPU types available on Runpod. | INTEL(R) XEON(R) PLATINUM 8558 | 48 | 2 | | INTEL(R) XEON(R) PLATINUM 8568Y+ | 48 | 2 | | INTEL(R) XEON(R) PLATINUM 8570 | 56 | 2 | +| INTEL(R) XEON(R) PLATINUM 8592V | 64 | 2 | | Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz | 10 | 2 | | Intel(R) Xeon(R) Silver 4210 CPU @ 2.20GHz | 10 | 2 | | Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 24 | 1 | diff --git a/references/gpu-types.mdx b/references/gpu-types.mdx index 52311c20..eb62b735 100644 --- a/references/gpu-types.mdx +++ b/references/gpu-types.mdx @@ -8,50 +8,53 @@ For information on pricing, see [GPU pricing](https://www.runpod.io/gpu-instance ## GPU types This table lists all GPU types available on Runpod: -{/* Table last generated: 2025-08-23 */} +{/* Table last generated: 2026-02-12 */} -| GPU ID | Display Name | Memory (GB) | -|---------------------------------------------------|--------------------------|---------------| -| AMD Instinct MI300X OAM | MI300X | 192 | -| NVIDIA A100 80GB PCIe | A100 PCIe | 80 | -| NVIDIA A100-SXM4-80GB | A100 SXM | 80 | -| NVIDIA A30 | A30 | 24 | -| NVIDIA A40 | A40 | 48 | -| NVIDIA B200 | B200 | 180 | -| NVIDIA GeForce RTX 3070 | RTX 3070 | 8 | -| NVIDIA GeForce RTX 3080 | RTX 3080 | 10 | -| NVIDIA GeForce RTX 3080 Ti | RTX 3080 Ti | 12 | -| NVIDIA GeForce RTX 3090 | RTX 3090 | 24 | -| NVIDIA GeForce RTX 3090 Ti | RTX 3090 Ti | 24 | -| NVIDIA GeForce RTX 4070 Ti | RTX 4070 Ti | 12 | -| NVIDIA GeForce RTX 4080 | RTX 4080 | 16 | -| NVIDIA GeForce RTX 4080 SUPER | RTX 4080 SUPER | 16 | -| NVIDIA GeForce RTX 4090 | RTX 4090 | 24 | -| NVIDIA GeForce RTX 5080 | RTX 5080 | 16 | -| NVIDIA GeForce RTX 5090 | RTX 5090 | 32 | -| NVIDIA H100 80GB HBM3 | H100 SXM | 80 | -| NVIDIA H100 NVL | H100 NVL | 94 | -| NVIDIA H100 PCIe | H100 PCIe | 80 | -| NVIDIA H200 | H200 SXM | 141 | -| NVIDIA L4 | L4 | 24 | -| NVIDIA L40 | L40 | 48 | -| NVIDIA L40S | L40S | 48 | -| NVIDIA RTX 2000 Ada Generation | RTX 2000 Ada | 16 | -| NVIDIA RTX 4000 Ada Generation | RTX 4000 Ada | 20 | -| NVIDIA RTX 4000 SFF Ada Generation | RTX 4000 Ada SFF | 20 | -| NVIDIA RTX 5000 Ada Generation | RTX 5000 Ada | 32 | -| NVIDIA RTX 6000 Ada Generation | RTX 6000 Ada | 48 | -| NVIDIA RTX A2000 | RTX A2000 | 6 | -| NVIDIA RTX A4000 | RTX A4000 | 16 | -| NVIDIA RTX A4500 | RTX A4500 | 20 | -| NVIDIA RTX A5000 | RTX A5000 | 24 | -| NVIDIA RTX A6000 | RTX A6000 | 48 | -| NVIDIA RTX PRO 6000 Blackwell Server Edition | RTX PRO 6000 Server | 96 | -| NVIDIA RTX PRO 6000 Blackwell Workstation Edition | RTX PRO 6000 Workstation | 96 | -| Tesla V100-FHHL-16GB | V100 FHHL | 16 | -| Tesla V100-PCIE-16GB | Tesla V100 | 16 | -| Tesla V100-SXM2-16GB | V100 SXM2 | 16 | -| Tesla V100-SXM2-32GB | V100 SXM2 32GB | 32 | +| GPU ID | Display Name | Memory (GB) | +|---------------------------------------------------------|-------------------|---------------| +| AMD Instinct MI300X OAM | MI300X | 192 | +| NVIDIA A100 80GB PCIe | A100 PCIe | 80 | +| NVIDIA A100-SXM4-80GB | A100 SXM | 80 | +| NVIDIA A30 | A30 | 24 | +| NVIDIA A40 | A40 | 48 | +| NVIDIA B200 | B200 | 180 | +| NVIDIA B300 SXM6 AC | B300 | 288 | +| NVIDIA GeForce RTX 3070 | RTX 3070 | 8 | +| NVIDIA GeForce RTX 3080 | RTX 3080 | 10 | +| NVIDIA GeForce RTX 3080 Ti | RTX 3080 Ti | 12 | +| NVIDIA GeForce RTX 3090 | RTX 3090 | 24 | +| NVIDIA GeForce RTX 3090 Ti | RTX 3090 Ti | 24 | +| NVIDIA GeForce RTX 4070 Ti | RTX 4070 Ti | 12 | +| NVIDIA GeForce RTX 4080 | RTX 4080 | 16 | +| NVIDIA GeForce RTX 4080 SUPER | RTX 4080 SUPER | 16 | +| NVIDIA GeForce RTX 4090 | RTX 4090 | 24 | +| NVIDIA GeForce RTX 5080 | RTX 5080 | 16 | +| NVIDIA GeForce RTX 5090 | RTX 5090 | 32 | +| NVIDIA H100 80GB HBM3 | H100 SXM | 80 | +| NVIDIA H100 NVL | H100 NVL | 94 | +| NVIDIA H100 PCIe | H100 PCIe | 80 | +| NVIDIA H200 | H200 SXM | 141 | +| NVIDIA H200 NVL | NVIDIA H200 NVL | 143 | +| NVIDIA L4 | L4 | 24 | +| NVIDIA L40 | L40 | 48 | +| NVIDIA L40S | L40S | 48 | +| NVIDIA RTX 2000 Ada Generation | RTX 2000 Ada | 16 | +| NVIDIA RTX 4000 Ada Generation | RTX 4000 Ada | 20 | +| NVIDIA RTX 4000 SFF Ada Generation | RTX 4000 Ada SFF | 20 | +| NVIDIA RTX 5000 Ada Generation | RTX 5000 Ada | 32 | +| NVIDIA RTX 6000 Ada Generation | RTX 6000 Ada | 48 | +| NVIDIA RTX A2000 | RTX A2000 | 6 | +| NVIDIA RTX A4000 | RTX A4000 | 16 | +| NVIDIA RTX A4500 | RTX A4500 | 20 | +| NVIDIA RTX A5000 | RTX A5000 | 24 | +| NVIDIA RTX A6000 | RTX A6000 | 48 | +| NVIDIA RTX PRO 4500 Blackwell | RTX PRO 4500 | 32 | +| NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | RTX PRO 6000 MaxQ | 96 | +| NVIDIA RTX PRO 6000 Blackwell Server Edition | RTX PRO 6000 | 96 | +| NVIDIA RTX PRO 6000 Blackwell Workstation Edition | RTX PRO 6000 WK | 96 | +| Tesla V100-PCIE-16GB | Tesla V100 | 16 | +| Tesla V100-SXM2-16GB | V100 SXM2 | 16 | +| Tesla V100-SXM2-32GB | V100 SXM2 32GB | 32 | ## GPU pools @@ -68,5 +71,4 @@ Use GPU pools when defining requirements for repositories published to the [Runp | `ADA_48_PRO` | L40, L40S, 6000 Ada | 48 GB | | `AMPERE_80` | A100 | 80 GB | | `ADA_80_PRO` | H100 | 80 GB | -| `HOPPER_141` | H200 | 141 GB | - +| `HOPPER_141` | H200 | 141 GB | \ No newline at end of file