Skip to content

Update GPU/CPU types #536

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
muhsinking wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Update GPU/CPU types #536

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 9 additions & 3 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ vale path/to/*.md
Install `blacken-docs`.

```bash
python -m pip install blacken-docs
python3 -m pip install blacken-docs
```

Run the formatter.
Expand All @@ -54,6 +54,12 @@ git ls-files -z -- '*.md' | xargs -0 blacken-docs
## Update CPU and GPUs

```bash
python helpers/gpu-types.py
python helpers/cpu-types.py
# Set up virtual environment
python3 -m venv helpers/venv
source helpers/venv/bin/activate
pip install -r helpers/requirements.txt

# Run scripts
python3 helpers/gpu_types.py
python3 helpers/sls_cpu_types.py
```
26 changes: 23 additions & 3 deletions references/cpu-types.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,11 +1,10 @@
---
title: "Serverless CPU types"
sidebarTitle: "CPU types"
title: Serverless CPU types
---

The following list contains all CPU types available on Runpod.

{/* Table last generated: 2025-08-23 */}
{/* Table last generated: 2026-02-12 */}

| Display Name | Cores | Threads Per Core |
|-------------------------------------------------|---------|--------------------|
Expand All @@ -29,7 +28,9 @@ The following list contains all CPU types available on Runpod.
| 13th Gen Intel(R) Core(TM) i9-13900K | 24 | 1 |
| 13th Gen Intel(R) Core(TM) i9-13900KF | 24 | 1 |
| AMD Eng Sample: 100-000000053-04_32/20_N | 48 | 1 |
| AMD Eng Sample: 100-000000314-04_30/16_N | 64 | 2 |
| AMD Eng Sample: 100-000000897-03 | 32 | 2 |
| AMD Eng Sample: 100-000001245-08 | 128 | 2 |
| AMD EPYC 4564P 16-Core Processor | 16 | 2 |
| AMD EPYC 7251 8-Core Processor | 8 | 2 |
| AMD EPYC 7252 8-Core Processor | 8 | 2 |
Expand Down Expand Up @@ -62,6 +63,7 @@ The following list contains all CPU types available on Runpod.
| AMD EPYC 7551 32-Core Processor | 32 | 2 |
| AMD EPYC 7551P 32-Core Processor | 32 | 2 |
| AMD EPYC 7552 48-Core Processor | 48 | 2 |
| AMD EPYC 7573X 32-Core Processor | 32 | 2 |
| AMD EPYC 75F3 32-Core Processor | 32 | 2 |
| AMD EPYC 7601 32-Core Processor | 32 | 2 |
| AMD EPYC 7642 48-Core Processor | 48 | 2 |
Expand All @@ -83,6 +85,7 @@ The following list contains all CPU types available on Runpod.
| AMD EPYC 7H12 64-Core Processor | 64 | 2 |
| AMD EPYC 7J13 64-Core Processor | 64 | 2 |
| AMD EPYC 7K62 48-Core Processor | 48 | 2 |
| AMD EPYC 7R13 Processor | 48 | 2 |
| AMD EPYC 7R32 48-Core Processor | 48 | 2 |
| AMD EPYC 7T83 64-Core Processor | 127 | 1 |
| AMD EPYC 7V13 64-Core Processor | 24 | 1 |
Expand All @@ -91,6 +94,7 @@ The following list contains all CPU types available on Runpod.
| AMD EPYC 9274F 24-Core Processor | 24 | 2 |
| AMD EPYC 9334 32-Core Processor | 32 | 2 |
| AMD EPYC 9335 32-Core Processor | 32 | 2 |
| AMD EPYC 9354 32-Core Emb Processor | 32 | 2 |
| AMD EPYC 9354 32-Core Processor | 32 | 2 |
| AMD EPYC 9354P | 64 | 1 |
| AMD EPYC 9354P 32-Core Processor | 32 | 2 |
Expand All @@ -99,15 +103,23 @@ The following list contains all CPU types available on Runpod.
| AMD EPYC 9374F 32-Core Processor | 32 | 1 |
| AMD EPYC 9454 48-Core Processor | 48 | 2 |
| AMD EPYC 9454P 48-Core Emb Processor | 48 | 2 |
| AMD EPYC 9455 48-Core Processor | 48 | 2 |
| AMD EPYC 9455P 48-Core Processor | 48 | 2 |
| AMD EPYC 9474F 48-Core Processor | 48 | 2 |
| AMD EPYC 9534 64-Core Processor | 64 | 2 |
| AMD EPYC 9535 64-Core Processor | 64 | 2 |
| AMD EPYC 9554 64-Core Emb Processor | 64 | 1 |
| AMD EPYC 9554 64-Core Processor | 126 | 1 |
| AMD EPYC 9555 64-Core Processor | 56 | 2 |
| AMD EPYC 9575F 64-Core Processor | 64 | 2 |
| AMD EPYC 9654 96-Core Emb Processor | 96 | 1 |
| AMD EPYC 9654 96-Core Processor | 96 | 2 |
| AMD EPYC 9655 96-Core Processor | 56 | 2 |
| AMD EPYC 9655P 96-Core Processor | 96 | 2 |
| AMD EPYC 9754 128-Core Processor | 128 | 2 |
| AMD EPYC 9755 128-Core Processor | 128 | 2 |
| AMD EPYC 9B14 96-Core Processor | 96 | 1 |
| AMD EPYC 9J14 96-Core Processor | 96 | 2 |
| AMD EPYC Processor | 1 | 1 |
| AMD EPYC Processor (with IBPB) | 16 | 1 |
| AMD EPYC-Rome Processor | 16 | 1 |
Expand All @@ -127,6 +139,7 @@ The following list contains all CPU types available on Runpod.
| AMD Ryzen 5 PRO 2600 Six-Core Processor | 6 | 2 |
| AMD Ryzen 7 1700 Eight-Core Processor | 8 | 2 |
| AMD Ryzen 7 1700X Eight-Core Processor | 8 | 2 |
| AMD Ryzen 7 3700X 8-Core Processor | 16 | 1 |
| AMD Ryzen 7 5700G with Radeon Graphics | 8 | 2 |
| AMD Ryzen 7 5700X 8-Core Processor | 8 | 2 |
| AMD Ryzen 7 5800X 8-Core Processor | 8 | 2 |
Expand All @@ -138,6 +151,7 @@ The following list contains all CPU types available on Runpod.
| AMD Ryzen 9 7900 12-Core Processor | 12 | 2 |
| AMD Ryzen 9 7950X 16-Core Processor | 16 | 2 |
| AMD Ryzen 9 7950X3D 16-Core Processor | 16 | 2 |
| AMD Ryzen 9 9900X 12-Core Processor | 12 | 2 |
| AMD Ryzen 9 9950X 16-Core Processor | 16 | 2 |
| AMD Ryzen Threadripper 1900X 8-Core Processor | 8 | 2 |
| AMD Ryzen Threadripper 1920X 12-Core Processor | 12 | 2 |
Expand All @@ -148,6 +162,7 @@ The following list contains all CPU types available on Runpod.
| AMD Ryzen Threadripper 2990WX 32-Core Processor | 32 | 2 |
| AMD Ryzen Threadripper 3960X 24-Core Processor | 24 | 2 |
| AMD Ryzen Threadripper 7960X 24-Cores | 24 | 2 |
| AMD Ryzen Threadripper 9960X 24-Cores | 24 | 2 |
| Ryzen Threadripper PRO 3955WX | 16 | 2 |
| AMD Ryzen Threadripper PRO 3975WX 32-Cores | 32 | 2 |
| AMD Ryzen Threadripper PRO 3995WX 64-Cores | 64 | 2 |
Expand Down Expand Up @@ -197,8 +212,11 @@ The following list contains all CPU types available on Runpod.
| Intel(R) Core(TM) Ultra 5 245K | 1 | 1 |
| Intel(R) Pentium(R) CPU G3260 @ 3.30GHz | 2 | 1 |
| Intel(R) Pentium(R) CPU G4560 @ 3.50GHz | 2 | 2 |
| Intel(R) Xeon(R) 6732P | 32 | 2 |
| Intel(R) Xeon(R) 6747P | 48 | 2 |
| Intel(R) Xeon(R) 6767P | 64 | 2 |
| Intel(R) Xeon(R) 6787P | 86 | 1 |
| Intel(R) Xeon(R) 6952P | 96 | 2 |
| Intel(R) Xeon(R) 6960P | 72 | 2 |
| Intel(R) Xeon(R) Bronze 3204 CPU @ 1.90GHz | 6 | 1 |
| Intel(R) Xeon(R) CPU X5660 @ 2.80GHz | 6 | 2 |
Expand Down Expand Up @@ -261,6 +279,7 @@ The following list contains all CPU types available on Runpod.
| Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz | 24 | 2 |
| Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz | 28 | 2 |
| Intel(R) Xeon(R) Gold 6448Y | 32 | 2 |
| INTEL(R) XEON(R) GOLD 6530 | 32 | 2 |
| INTEL(R) XEON(R) GOLD 6548Y+ | 32 | 2 |
| Intel(R) Xeon(R) Platinum 8160 CPU @ 2.10GHz | 24 | 2 |
| Intel(R) Xeon(R) Platinum 8168 CPU @ 2.70GHz | 24 | 2 |
Expand All @@ -282,6 +301,7 @@ The following list contains all CPU types available on Runpod.
| INTEL(R) XEON(R) PLATINUM 8558 | 48 | 2 |
| INTEL(R) XEON(R) PLATINUM 8568Y+ | 48 | 2 |
| INTEL(R) XEON(R) PLATINUM 8570 | 56 | 2 |
| INTEL(R) XEON(R) PLATINUM 8592V | 64 | 2 |
| Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz | 10 | 2 |
| Intel(R) Xeon(R) Silver 4210 CPU @ 2.20GHz | 10 | 2 |
| Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 24 | 1 |
Expand Down
92 changes: 47 additions & 45 deletions references/gpu-types.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,50 +8,53 @@ For information on pricing, see [GPU pricing](https://www.runpod.io/gpu-instance
## GPU types

This table lists all GPU types available on Runpod:
{/* Table last generated: 2025-08-23 */}
{/* Table last generated: 2026-02-12 */}

| GPU ID | Display Name | Memory (GB) |
|---------------------------------------------------|--------------------------|---------------|
| AMD Instinct MI300X OAM | MI300X | 192 |
| NVIDIA A100 80GB PCIe | A100 PCIe | 80 |
| NVIDIA A100-SXM4-80GB | A100 SXM | 80 |
| NVIDIA A30 | A30 | 24 |
| NVIDIA A40 | A40 | 48 |
| NVIDIA B200 | B200 | 180 |
| NVIDIA GeForce RTX 3070 | RTX 3070 | 8 |
| NVIDIA GeForce RTX 3080 | RTX 3080 | 10 |
| NVIDIA GeForce RTX 3080 Ti | RTX 3080 Ti | 12 |
| NVIDIA GeForce RTX 3090 | RTX 3090 | 24 |
| NVIDIA GeForce RTX 3090 Ti | RTX 3090 Ti | 24 |
| NVIDIA GeForce RTX 4070 Ti | RTX 4070 Ti | 12 |
| NVIDIA GeForce RTX 4080 | RTX 4080 | 16 |
| NVIDIA GeForce RTX 4080 SUPER | RTX 4080 SUPER | 16 |
| NVIDIA GeForce RTX 4090 | RTX 4090 | 24 |
| NVIDIA GeForce RTX 5080 | RTX 5080 | 16 |
| NVIDIA GeForce RTX 5090 | RTX 5090 | 32 |
| NVIDIA H100 80GB HBM3 | H100 SXM | 80 |
| NVIDIA H100 NVL | H100 NVL | 94 |
| NVIDIA H100 PCIe | H100 PCIe | 80 |
| NVIDIA H200 | H200 SXM | 141 |
| NVIDIA L4 | L4 | 24 |
| NVIDIA L40 | L40 | 48 |
| NVIDIA L40S | L40S | 48 |
| NVIDIA RTX 2000 Ada Generation | RTX 2000 Ada | 16 |
| NVIDIA RTX 4000 Ada Generation | RTX 4000 Ada | 20 |
| NVIDIA RTX 4000 SFF Ada Generation | RTX 4000 Ada SFF | 20 |
| NVIDIA RTX 5000 Ada Generation | RTX 5000 Ada | 32 |
| NVIDIA RTX 6000 Ada Generation | RTX 6000 Ada | 48 |
| NVIDIA RTX A2000 | RTX A2000 | 6 |
| NVIDIA RTX A4000 | RTX A4000 | 16 |
| NVIDIA RTX A4500 | RTX A4500 | 20 |
| NVIDIA RTX A5000 | RTX A5000 | 24 |
| NVIDIA RTX A6000 | RTX A6000 | 48 |
| NVIDIA RTX PRO 6000 Blackwell Server Edition | RTX PRO 6000 Server | 96 |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition | RTX PRO 6000 Workstation | 96 |
| Tesla V100-FHHL-16GB | V100 FHHL | 16 |
| Tesla V100-PCIE-16GB | Tesla V100 | 16 |
| Tesla V100-SXM2-16GB | V100 SXM2 | 16 |
| Tesla V100-SXM2-32GB | V100 SXM2 32GB | 32 |
| GPU ID | Display Name | Memory (GB) |
|---------------------------------------------------------|-------------------|---------------|
| AMD Instinct MI300X OAM | MI300X | 192 |
| NVIDIA A100 80GB PCIe | A100 PCIe | 80 |
| NVIDIA A100-SXM4-80GB | A100 SXM | 80 |
| NVIDIA A30 | A30 | 24 |
| NVIDIA A40 | A40 | 48 |
| NVIDIA B200 | B200 | 180 |
| NVIDIA B300 SXM6 AC | B300 | 288 |
| NVIDIA GeForce RTX 3070 | RTX 3070 | 8 |
| NVIDIA GeForce RTX 3080 | RTX 3080 | 10 |
| NVIDIA GeForce RTX 3080 Ti | RTX 3080 Ti | 12 |
| NVIDIA GeForce RTX 3090 | RTX 3090 | 24 |
| NVIDIA GeForce RTX 3090 Ti | RTX 3090 Ti | 24 |
| NVIDIA GeForce RTX 4070 Ti | RTX 4070 Ti | 12 |
| NVIDIA GeForce RTX 4080 | RTX 4080 | 16 |
| NVIDIA GeForce RTX 4080 SUPER | RTX 4080 SUPER | 16 |
| NVIDIA GeForce RTX 4090 | RTX 4090 | 24 |
| NVIDIA GeForce RTX 5080 | RTX 5080 | 16 |
| NVIDIA GeForce RTX 5090 | RTX 5090 | 32 |
| NVIDIA H100 80GB HBM3 | H100 SXM | 80 |
| NVIDIA H100 NVL | H100 NVL | 94 |
| NVIDIA H100 PCIe | H100 PCIe | 80 |
| NVIDIA H200 | H200 SXM | 141 |
| NVIDIA H200 NVL | NVIDIA H200 NVL | 143 |
| NVIDIA L4 | L4 | 24 |
| NVIDIA L40 | L40 | 48 |
| NVIDIA L40S | L40S | 48 |
| NVIDIA RTX 2000 Ada Generation | RTX 2000 Ada | 16 |
| NVIDIA RTX 4000 Ada Generation | RTX 4000 Ada | 20 |
| NVIDIA RTX 4000 SFF Ada Generation | RTX 4000 Ada SFF | 20 |
| NVIDIA RTX 5000 Ada Generation | RTX 5000 Ada | 32 |
| NVIDIA RTX 6000 Ada Generation | RTX 6000 Ada | 48 |
| NVIDIA RTX A2000 | RTX A2000 | 6 |
| NVIDIA RTX A4000 | RTX A4000 | 16 |
| NVIDIA RTX A4500 | RTX A4500 | 20 |
| NVIDIA RTX A5000 | RTX A5000 | 24 |
| NVIDIA RTX A6000 | RTX A6000 | 48 |
| NVIDIA RTX PRO 4500 Blackwell | RTX PRO 4500 | 32 |
| NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | RTX PRO 6000 MaxQ | 96 |
| NVIDIA RTX PRO 6000 Blackwell Server Edition | RTX PRO 6000 | 96 |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition | RTX PRO 6000 WK | 96 |
| Tesla V100-PCIE-16GB | Tesla V100 | 16 |
| Tesla V100-SXM2-16GB | V100 SXM2 | 16 |
| Tesla V100-SXM2-32GB | V100 SXM2 32GB | 32 |

## GPU pools

Expand All @@ -68,5 +71,4 @@ Use GPU pools when defining requirements for repositories published to the [Runp
| `ADA_48_PRO` | L40, L40S, 6000 Ada | 48 GB |
| `AMPERE_80` | A100 | 80 GB |
| `ADA_80_PRO` | H100 | 80 GB |
| `HOPPER_141` | H200 | 141 GB |

| `HOPPER_141` | H200 | 141 GB |