Together AI pricing
Serverless per-token inference for open models, plus dedicated GPU endpoints, GPU clusters and fine-tuning.
- Dedicated H100 on demand
- $5.49 / GPU-hr
Go to Together AI Compare with Amazon Bedrock, Azure AI Foundry, Featherless AI Request a quote
Every field, sourced
Marker opens the source- Status Whether the provider's public inference API is live.
- Active 1
- Hardware Chips that serve requests: GPUs, the vendor's own custom silicon, or both.
- GPU 1
- Hardware detail Published chip types (e.g. LPU, wafer-scale engine, RDU, NVIDIA H100/B200).
- NVIDIA H100, H200, B200, B300; GB200/GB300 NVL72 on request 1
- OpenAI API Accepts OpenAI Chat Completions-style requests, per vendor docs.
- Yes 1
- Serverless Pay-per-use API billed per token or per second, with no GPU to manage.
- Yes 1
- Dedicated Single-tenant deployments or reserved capacity.
- Yes 1
- Fine-tuning Hosted fine-tuning or LoRA adapters offered.
- Yes 1
- Models (published) models Model count as published or counted from the official model list on the verified date.
- 22 2
- Flagship models Notable models served, from the official list.
- gpt-oss-120b, DeepSeek V4.1 Flash, GLM-5.3 Flash, Qwen3.5 9B, Muse Spark Open 816B A42B 2
- Serves gpt-oss-120b Offers the reference model gpt-oss-120b pay-per-token.
- Yes 2
- gpt-oss-120b in $/1M tok Standard serverless input price for the reference model gpt-oss-120b, per 1M tokens.
- $0.15 1
- gpt-oss-120b out $/1M tok Standard serverless output price for the reference model gpt-oss-120b, per 1M tokens.
- $0.60 1
- Llama 3.3 70B in $/1M tok Secondary reference: Llama 3.3 70B Instruct input price per 1M tokens, where still listed.
- Not published
- Llama 3.3 70B out $/1M tok Secondary reference: Llama 3.3 70B Instruct output price per 1M tokens, where still listed.
- Not published
- Vendor speed tok/s Vendor-stated output speed on gpt-oss-120b, linked to the vendor’s own page.
- Not published
- Speed source Who published the speed figure and when.
- Not published
- Dedicated H100 $/GPU-hr On-demand price of one H100 for dedicated deployments.
- $5.49 1
- Regions Published serving or data regions.
- Not published
- SOC 2 SOC 2 status as stated by the vendor.
- Type 2 4
- HIPAA Vendor states HIPAA support or offers a BAA.
- Not published
- ZDR Zero data retention: the vendor states prompts and outputs are not stored, by default or as a setting.
- Yes 3
- Free tier Free credits or free rate-limited access, as published.
- Not published
Pricing detail
gpt-oss-120b $0.15 in / $0.60 out per 1M. Dedicated endpoint H100 $5.49/GPU-hr. Llama 3.3 70B no longer on serverless. ZDR is an opt-in admin setting.
Sources
- Together AI Pricing accessed 2026-11-09
- Serverless Models accessed 2026-11-09
- Privacy and security accessed 2026-11-09
- Together AI Enterprise accessed 2026-11-09
Get dedicated or volume pricing from Together AI and similar providers
Tell us what you need once. We send it to matching providers and they reply to you directly.