Anyscale

No public API Not in the main table. Anyscale has no live per-token API to price. The cheapest live gpt-oss-120b APIs are OpenRouter, CoreWeave and DeepInfra.

Managed Ray platform for training and inference on hosted or bring-your-own-cloud GPUs. Current pages offer no public serverless per-token endpoint.

gpu-cloud

Verified

Compare with OpenRouter, CoreWeave, DeepInfra

Every field, sourced

Marker opens the source
Status Whether the provider's public inference API is live.
No public API 1
Hardware Chips that serve requests: GPUs, the vendor's own custom silicon, or both.
GPU 1
Hardware detail Published chip types (e.g. LPU, wafer-scale engine, RDU, NVIDIA H100/B200).
Not published
OpenAI API Accepts OpenAI Chat Completions-style requests, per vendor docs.
Not published
Serverless Pay-per-use API billed per token or per second, with no GPU to manage.
No 1
Dedicated Single-tenant deployments or reserved capacity.
Not published
Fine-tuning Hosted fine-tuning or LoRA adapters offered.
Not published
Models (published) models Model count as published or counted from the official model list on the verified date.
Not published
Flagship models Notable models served, from the official list.
Not published
Serves gpt-oss-120b Offers the reference model gpt-oss-120b pay-per-token.
No 1
gpt-oss-120b in $/1M tok Standard serverless input price for the reference model gpt-oss-120b, per 1M tokens.
Not published
gpt-oss-120b out $/1M tok Standard serverless output price for the reference model gpt-oss-120b, per 1M tokens.
Not published
Llama 3.3 70B in $/1M tok Secondary reference: Llama 3.3 70B Instruct input price per 1M tokens, where still listed.
Not published
Llama 3.3 70B out $/1M tok Secondary reference: Llama 3.3 70B Instruct output price per 1M tokens, where still listed.
Not published
Vendor speed tok/s Vendor-stated output speed on gpt-oss-120b, linked to the vendor’s own page.
Not published
Speed source Who published the speed figure and when.
Not published
Dedicated H100 $/GPU-hr On-demand price of one H100 for dedicated deployments.
Not published
Regions Published serving or data regions.
Not published
SOC 2 SOC 2 status as stated by the vendor.
Not published
HIPAA Vendor states HIPAA support or offers a BAA.
Not published
ZDR Zero data retention: the vendor states prompts and outputs are not stored, by default or as a setting.
Not published
Free tier Free credits or free rate-limited access, as published.
$100 in Anyscale credits 1

Pricing detail

Multi-tenant Endpoints API ended from 1 Aug 2024 per Anyscale docs; H/B-series GPUs 'Contact Us'.

Sources

  1. Anyscale Pricing accessed 2026-11-09
  2. Anyscale Endpoints page accessed 2026-11-09