Review · AI & data
Groq review
GroqCloud inference API for open-weight models such as GPT OSS, with an OpenAI-compatible endpoint.
By the FruitPunch research desk · Updated November 20, 2026
- Quality (40%)
- 8.0
- Ease of use (25%)
- 9.0
- Value (35%)
- 9.2
Groq is the pick when response speed matters more than having the biggest model. Its model docs list GPT OSS 20B at 1,000 tokens per second for $0.075 in and $0.30 out per 1M tokens, and GPT OSS 120B at about 500 tokens per second for $0.15 in and $0.60 out, both with a 131,072-token context window. Integration is quick because Groq documents an OpenAI-compatible base URL, so existing OpenAI SDK code needs only a new key and URL. There is a free plan with lower rate limits, and the Developer plan adds higher limits plus Batch and Flex processing. The trade-off is range: the self-serve production list is short, and models such as Llama 3.3 70B are marked Enterprise with contact-sales pricing. For voice bots, live autocomplete or agents that make many short calls, the speed and price make it a strong second provider next to a frontier lab.
Who it is for
apps that need very fast responses
Price
Free plan; paid from $0.075 per 1M input tokens on GPT OSS 20B.
GPT OSS 20B openai/gpt-oss-20b 1000 $0.075 input $0.30 output
Quoted from the vendor pricing page on November 20, 2026.
Key features
- GPT OSS 20B listed at 1,000 tokens per second, $0.075 in and $0.30 out per 1M tokens
- GPT OSS 120B at about 500 tokens per second, $0.15 in and $0.60 out
- OpenAI-compatible base URL at api.groq.com/openai/v1
- Free plan, with a Developer plan that adds higher limits, Batch and Flex processing
- Built-in browser search and code execution on GPT OSS models
Strengths and weaknesses
- Strength: Fastest listed throughput in this comparison, up to 1,000 tokens per second
- Strength: Works with the OpenAI SDK by changing the base URL
- Strength: Free plan to test before paying
- Weakness: Small production catalog: two GPT OSS text models are self-serve priced
- Weakness: Llama 3.3 70B and Llama 3.1 8B are listed as Enterprise, contact sales
- Weakness: 131,072-token context window on the production text models
Key facts
- Free plan: Yes, with lower rate limits than the Developer plan
- Cheapest text model: GPT OSS 20B, $0.075 in and $0.30 out per 1M tokens
- Listed speed: Up to 1,000 tokens per second
- API format: OpenAI-compatible
Where it ranks
Groq is No. 4 in our Best LLM API Providers verdict.
Alternatives we scored
Visit groq.com · Questions or corrections: editorial@fruitpunch.ai