fruitpunch

Review · AI & data

Groq logoGroq review

GroqCloud inference API for open-weight models such as GPT OSS, with an OpenAI-compatible endpoint.

By the FruitPunch research desk · Updated November 20, 2026

Quality (40%)
8.0
Ease of use (25%)
9.0
Value (35%)
9.2

Groq is the pick when response speed matters more than having the biggest model. Its model docs list GPT OSS 20B at 1,000 tokens per second for $0.075 in and $0.30 out per 1M tokens, and GPT OSS 120B at about 500 tokens per second for $0.15 in and $0.60 out, both with a 131,072-token context window. Integration is quick because Groq documents an OpenAI-compatible base URL, so existing OpenAI SDK code needs only a new key and URL. There is a free plan with lower rate limits, and the Developer plan adds higher limits plus Batch and Flex processing. The trade-off is range: the self-serve production list is short, and models such as Llama 3.3 70B are marked Enterprise with contact-sales pricing. For voice bots, live autocomplete or agents that make many short calls, the speed and price make it a strong second provider next to a frontier lab.

Who it is for

apps that need very fast responses

Price

Free plan; paid from $0.075 per 1M input tokens on GPT OSS 20B.

GPT OSS 20B openai/gpt-oss-20b 1000 $0.075 input $0.30 output
Quoted from the vendor pricing page on November 20, 2026.

Key features

  • GPT OSS 20B listed at 1,000 tokens per second, $0.075 in and $0.30 out per 1M tokens
  • GPT OSS 120B at about 500 tokens per second, $0.15 in and $0.60 out
  • OpenAI-compatible base URL at api.groq.com/openai/v1
  • Free plan, with a Developer plan that adds higher limits, Batch and Flex processing
  • Built-in browser search and code execution on GPT OSS models

Strengths and weaknesses

  • Strength: Fastest listed throughput in this comparison, up to 1,000 tokens per second
  • Strength: Works with the OpenAI SDK by changing the base URL
  • Strength: Free plan to test before paying
  • Weakness: Small production catalog: two GPT OSS text models are self-serve priced
  • Weakness: Llama 3.3 70B and Llama 3.1 8B are listed as Enterprise, contact sales
  • Weakness: 131,072-token context window on the production text models

Key facts

  • Free plan: Yes, with lower rate limits than the Developer plan
  • Cheapest text model: GPT OSS 20B, $0.075 in and $0.30 out per 1M tokens
  • Listed speed: Up to 1,000 tokens per second
  • API format: OpenAI-compatible

Where it ranks

Groq is No. 4 in our Best LLM API Providers verdict.

Alternatives we scored

Visit groq.com · Questions or corrections: editorial@fruitpunch.ai