How much does an A100 GPU cost per hour?

A100 40GB costs $1.50–$2.50/hr. A100 80GB costs $2.00–$3.50/hr. AWS P4d (8x A100) runs $32.77/hr on-demand; comparable CoreWeave pricing is ~$2.21/hr per GPU.

What models can run on a single A100?

A single A100 80GB can run: 7B parameter models in FP16, 13B with quantization, or 70B models in 8-bit. For 70B FP16, you need 2x A100 80GB minimum.

How many A100s do I need for a training run?

For a 7B parameter model from scratch: 8x A100s for ~1 week. For 70B parameters: 64-128x A100s for several weeks. Use this calculator to estimate cost.

GPU Cloud A100 Hourly Cost Calculator

Calculate NVIDIA A100 GPU cloud rental costs. The A100 80GB is the workhorse of production AI at $1.50–$3.50/hr per GPU on major cloud platforms.

AI & SaaS Tools

SaaS Metrics

AI Compute

AI ROI

LTV:CAC Ratio

ARPU ($/month)

Monthly Churn %

CAC ($)

Gross Margin %

LTV

$3500

LTV:CAC

11.67

Payback

2.9 mo

Health

Healthy ✓

Benchmark: LTV:CAC ≥ 3 is healthy. Payback under 12 months is excellent. Under 1 means you lose money on each customer.

How to Use

Enter the values for the scenario you are assessing. Calculate NVIDIA A100 GPU cloud rental costs. The A100 80GB is the workhorse of production AI at $1.50–$3.50/hr per GPU on major cloud platforms. Use the a100 gpu cost result to inform your calculation.

Related Calculators

H100 GPU Cost

AI & Tech

V100 GPU Cost

AI & Tech

T4 GPU Cost

AI & Tech

GPU Cloud A100 Hourly Cost Calculator

LTV:CAC Ratio

How to Use

Related Calculators

Frequently Asked Questions

How much does an A100 GPU cost per hour?

What models can run on a single A100?

How many A100s do I need for a training run?