Modal

Serverless compute platform billed per GPU-second, with per-token Shared Endpoints for a short model list and Dedicated Endpoints for open models such as gpt-oss-120b.

gpu-cloudserverless

Verified

Dedicated H100 on demand
$3.95 / GPU-hr

Go to Modal Compare with OpenRouter, CoreWeave, DeepInfra Request a quote

Every field, sourced

Marker opens the source
Status Whether the provider's public inference API is live.
Active 1
Hardware Chips that serve requests: GPUs, the vendor's own custom silicon, or both.
GPU 1
Hardware detail Published chip types (e.g. LPU, wafer-scale engine, RDU, NVIDIA H100/B200).
H100 SXM5 $0.001097/s, H200 $0.001261/s, B200 $0.001736/s, A100 80GB $0.000694/s 1
OpenAI API Accepts OpenAI Chat Completions-style requests, per vendor docs.
Not published
Serverless Pay-per-use API billed per token or per second, with no GPU to manage.
Yes 1
Dedicated Single-tenant deployments or reserved capacity.
Yes 4
Fine-tuning Hosted fine-tuning or LoRA adapters offered.
Not published
Models (published) models Model count as published or counted from the official model list on the verified date.
Not published
Flagship models Notable models served, from the official list.
Not published
Serves gpt-oss-120b Offers the reference model gpt-oss-120b pay-per-token.
No 4
gpt-oss-120b in $/1M tok Standard serverless input price for the reference model gpt-oss-120b, per 1M tokens.
Not published
gpt-oss-120b out $/1M tok Standard serverless output price for the reference model gpt-oss-120b, per 1M tokens.
Not published
Llama 3.3 70B in $/1M tok Secondary reference: Llama 3.3 70B Instruct input price per 1M tokens, where still listed.
Not published
Llama 3.3 70B out $/1M tok Secondary reference: Llama 3.3 70B Instruct output price per 1M tokens, where still listed.
Not published
Vendor speed tok/s Vendor-stated output speed on gpt-oss-120b, linked to the vendor’s own page.
Not published
Speed source Who published the speed figure and when.
Not published
Dedicated H100 $/GPU-hr On-demand price of one H100 for dedicated deployments.
$3.95 1
Regions Published serving or data regions.
US, EU, AP plus narrow regions; pinning costs 1.15x–1.75x 1
SOC 2 SOC 2 status as stated by the vendor.
Type 2 2
HIPAA Vendor states HIPAA support or offers a BAA.
Yes 2
ZDR Zero data retention: the vendor states prompts and outputs are not stored, by default or as a setting.
Not published
Free tier Free credits or free rate-limited access, as published.
$30/month free compute on Starter 1

Pricing detail

H100 $0.001097/s (~$3.95/hr). Shared Endpoints bill per token (11 models, not gpt-oss-120b); gpt-oss-120b runs on Dedicated Endpoints billed by compute. HIPAA on Enterprise only.

Sources

  1. Modal Pricing accessed 2026-11-09
  2. Security and privacy accessed 2026-11-09
  3. Region selection accessed 2026-11-09
  4. Modal supported models accessed 2026-11-09

Get dedicated or volume pricing from Modal and similar providers

Tell us what you need once. We send it to matching providers and they reply to you directly.

Quote requests open shortly. To get in first, email hello@aiinferenceproviders.com.