Groq pricing
GroqCloud is a per-token inference API running on Groq's own LPU chips.
- Output speed vendor-stated
- 500 tok/s
Go to Groq Compare with Amazon Bedrock, Azure AI Foundry, Featherless AI Request a quote
Every field, sourced
Marker opens the source- Status Whether the provider's public inference API is live.
- Active 1
- Hardware Chips that serve requests: GPUs, the vendor's own custom silicon, or both.
- Custom silicon 1
- Hardware detail Published chip types (e.g. LPU, wafer-scale engine, RDU, NVIDIA H100/B200).
- LPU 1
- OpenAI API Accepts OpenAI Chat Completions-style requests, per vendor docs.
- Yes 1
- Serverless Pay-per-use API billed per token or per second, with no GPU to manage.
- Yes 1
- Dedicated Single-tenant deployments or reserved capacity.
- Not published
- Fine-tuning Hosted fine-tuning or LoRA adapters offered.
- Not published
- Models (published) models Model count as published or counted from the official model list on the verified date.
- 14 1
- Flagship models Notable models served, from the official list.
- gpt-oss-120b, gpt-oss-20b, llama-3.3-70b-versatile, llama-3.1-8b-instant, qwen3.8-27b, minimax-m2.7 1
- Serves gpt-oss-120b Offers the reference model gpt-oss-120b pay-per-token.
- Yes 1
- gpt-oss-120b in $/1M tok Standard serverless input price for the reference model gpt-oss-120b, per 1M tokens.
- $0.15 2
- gpt-oss-120b out $/1M tok Standard serverless output price for the reference model gpt-oss-120b, per 1M tokens.
- $0.60 2
- Llama 3.3 70B in $/1M tok Secondary reference: Llama 3.3 70B Instruct input price per 1M tokens, where still listed.
- Not published
- Llama 3.3 70B out $/1M tok Secondary reference: Llama 3.3 70B Instruct output price per 1M tokens, where still listed.
- Not published
- Vendor speed tok/s Vendor-stated output speed on gpt-oss-120b, linked to the vendor’s own page.
- 500 1
- Speed source Who published the speed figure and when.
- Groq models page, retrieved 2026-11-09 (vendor figure) 1
- Dedicated H100 $/GPU-hr On-demand price of one H100 for dedicated deployments.
- Not published
- Regions Published serving or data regions.
- Customer data stored in US (GCP); inference regions not published 1
- SOC 2 SOC 2 status as stated by the vendor.
- Yes 4
- HIPAA Vendor states HIPAA support or offers a BAA.
- Yes 5
- ZDR Zero data retention: the vendor states prompts and outputs are not stored, by default or as a setting.
- Yes 3
- Free tier Free credits or free rate-limited access, as published.
- Free plan with rate limits 1
Pricing detail
gpt-oss-120b $0.15 in / $0.60 out per 1M, 500 tok/s (vendor). Llama 3.3 70B now 'contact sales'. No retention by default, up to 30 days for abuse; ZDR toggle. speech models.
Sources
- GroqCloud Models accessed 2026-11-09
- Groq Pricing accessed 2026-11-09
- GroqCloud Your Data accessed 2026-11-09
- Groq Trust Center accessed 2026-11-09
- Is Groq HIPAA compliant? (Groq Community) accessed 2026-11-09
Get dedicated or volume pricing from Groq and similar providers
Tell us what you need once. We send it to matching providers and they reply to you directly.