Deprecated — shuts down Aug 16, 2026.
Still purchasable until then, but the provider has
announced end-of-life. Don't start new work on it. Migration target: GPT-OSS 20B.
Availability: Groq shutdown 2026-08-16.
Today's price · per 1M tokens
Input
$0.050
per 1M tokens
Output
$0.080
per 1M tokens
Blended
$0.065
avg of input & output $/1M
Source: official Groq pricing · read Jul 4, 2026
MODELPRICEWATCH.COM · 2026-08-01
Overview
Llama 3.1 8B on Groq's LPU. ~840 tokens/sec — extremely fast. $0.05/$0.08 per 1M tokens.
Run it yourself
Deploy this open model on rented GPUs
Open weights mean you can self-host instead of paying per-token API prices. These platforms let you serve it on demand — often cheaper at scale.
RunPod →
Rent GPUs by the second and serve any open-weight model yourself.
Novita AI →
Serverless open-model inference billed per token — no GPU ops.
Vast.ai →
GPU marketplace — rent spot/on-demand GPUs cheaply and serve any open-weight model.
Partner links — we may earn a commission if you sign up, at no cost to you. We only list platforms we'd recommend regardless.
Capabilities
struck through = not supportedInput 1/5
Text ✓
Image
Audio
Video
PDF
Output 1/5
Text ✓
Image
Audio
Video
Embedding
Features 3/9
Prompt caching
Reasoning
Coding
Fast inference ✓
Long context ✓
Open weights ✓
Multimodal
Web search
Realtime
Benchmark performance
accuracy % · higher is betterAvg benchmark score34%
Perf per $/Mtok523.1
GPQA Diamond
30%
SWE-Bench Verified
12%
Humanity's Last Exam
5%
ARC-AGI 2
6%
AIME 2025
20%
MMMLU
65%
BFCL
48%
HumanEval
72%
MATH 500
48%
How it stacks up
- Ranks #68 of 68 benchmarked models by average score
- Ranks #127 of 133 comparably-measured models by percentile score, across 9 independent measurements
- Ranks #26 of 133 comparably-tested models by normalized performance per dollar
- Strongest at HumanEval — 72%, #39 of 45
1800 tokens/sec output
Source: Groq model card · updated Jun 1, 2026 · See full rankings →
Specifications
- Provider
- Groq
- Context window
- 128K tokens
- Modality
- text
- Parameters
- 8B
- Open source
- Yes — open weights available
- Released
- Jul 23, 2024
- Status
- Deprecated ends Aug 16, 2026
- Last updated
- Jul 4, 2026
- Tags
Availability verified: Jul 25, 2026 — per Groq's own deprecation notice