GPU options:

  • 4 NVIDIA L4 GPUs (cheapest) OR
  • 1 NVIDIA H100

​
AWS

Create an EC2 instance with the following specifications: Instance type: g6.12xlarge or higher version of g6 which has

  • GPU: 4 Nvidia L4
  • vCPU: ≥ 8
  • AMI:
    • Search AMI from catalog: Deep Learning OSS Nvidia Driver AMI GPU PyTorch 2.3 (Ubuntu 20.04)
  • Disk size: ≥ 500GB

​
GCP

Create a Google Compute Engine instance with the following specifications:

  • GPU: 4 Nvidia L4 (g2-standard-48)
  • Boot disk:
    • Boot image: Deep Learning VM with CUDA 12.3 M124
    • Disk size: ≥ 500GB
  • vCPU: ≥ 8