FriendliAI

Serverless per-token Model APIs and dedicated endpoints billed per GPU-second, with deployment of Hugging Face models.

gpu-cloudserverlessdedicated

Verified

Dedicated H100 on demand
$5.00 / GPU-hr

Go to FriendliAI Compare with OpenRouter, CoreWeave, DeepInfra Request a quote

Every field, sourced

Marker opens the source
Status Whether the provider's public inference API is live.
Active 1
Hardware Chips that serve requests: GPUs, the vendor's own custom silicon, or both.
GPU 1
Hardware detail Published chip types (e.g. LPU, wafer-scale engine, RDU, NVIDIA H100/B200).
A100 80GB $4/h, H100 $5/h, H200 $7/h, B200 $9/h, B300 $12/h (dedicated) 1
OpenAI API Accepts OpenAI Chat Completions-style requests, per vendor docs.
Yes 3
Serverless Pay-per-use API billed per token or per second, with no GPU to manage.
Yes 1
Dedicated Single-tenant deployments or reserved capacity.
Yes 1
Fine-tuning Hosted fine-tuning or LoRA adapters offered.
Not published
Models (published) models Model count as published or counted from the official model list on the verified date.
Not published
Flagship models Notable models served, from the official list.
GLM-5.3, GLM-5.3-Flash, GLM-5.2, gemma-4-31B-it 1
Serves gpt-oss-120b Offers the reference model gpt-oss-120b pay-per-token.
No 1
gpt-oss-120b in $/1M tok Standard serverless input price for the reference model gpt-oss-120b, per 1M tokens.
Not published
gpt-oss-120b out $/1M tok Standard serverless output price for the reference model gpt-oss-120b, per 1M tokens.
Not published
Llama 3.3 70B in $/1M tok Secondary reference: Llama 3.3 70B Instruct input price per 1M tokens, where still listed.
Not published
Llama 3.3 70B out $/1M tok Secondary reference: Llama 3.3 70B Instruct output price per 1M tokens, where still listed.
Not published
Vendor speed tok/s Vendor-stated output speed on gpt-oss-120b, linked to the vendor’s own page.
Not published
Speed source Who published the speed figure and when.
Not published
Dedicated H100 $/GPU-hr On-demand price of one H100 for dedicated deployments.
$5.00 1
Regions Published serving or data regions.
Not published
SOC 2 SOC 2 status as stated by the vendor.
Type 2 1
HIPAA Vendor states HIPAA support or offers a BAA.
Not published
ZDR Zero data retention: the vendor states prompts and outputs are not stored, by default or as a setting.
Not published
Free tier Free credits or free rate-limited access, as published.
Not published

Pricing detail

No gpt-oss-120b or Llama 3.3 70B serverless price. GLM-5.3-Flash $0.15 / $0.50 per 1M. Models page claims 639,502 deployable open models (not serverless).

Sources

  1. FriendliAI Pricing accessed 2026-11-09
  2. FriendliAI Models accessed 2026-11-09
  3. OpenAI compatibility accessed 2026-11-09

Get dedicated or volume pricing from FriendliAI and similar providers

Tell us what you need once. We send it to matching providers and they reply to you directly.

Quote requests open shortly. To get in first, email hello@aiinferenceproviders.com.