Pricing · per 1M tokens
Input
$0.050
per million tokens
Output
$0.080
per million tokens
| Blended avg cost* | $0.065/Mtok |
|---|
Overview
Llama 3.1 8B on Groq's LPU. ~840 tokens/sec — extremely fast. $0.05/$0.08 per 1M tokens.
Run it yourself
Deploy this open model on rented GPUs
Open weights mean you can self-host instead of paying per-token API prices. These platforms let you serve it on demand — often cheaper at scale.
RunPod →
Rent GPUs by the second and serve any open-weight model yourself.
Novita AI →
Serverless open-model inference billed per token — no GPU ops.
Vast.ai →
GPU marketplace — rent spot/on-demand GPUs cheaply and serve any open-weight model.
Partner links — we may earn a commission if you sign up, at no cost to you. We only list platforms we'd recommend regardless.
Capabilities
Input 1/5
Text ✓
Image
Audio
Video
PDF
Output 1/5
Text ✓
Image
Audio
Video
Embedding
Features 3/9
Prompt caching
Reasoning
Coding
Fast inference ✓
Long context ✓
Open weights ✓
Multimodal
Web search
Realtime
Benchmark performance
34%
avg benchmark score
64.8
perf / $/Mtok
GPQA Diamond
30%
AIME 2025
20%
SWE-Bench
12%
Humanity's Last Exam
5%
ARC-AGI 2
6%
MMMLU
65%
HumanEval
72%
MATH 500
48%
BFCL
48%
How it stacks up
- Ranks #35 of 35 benchmarked models by average score
- Ranks #26 of 35 comparably-tested models by normalized performance per dollar
- Strongest at BFCL — 48%, #53 of 55
Inference speed:
1800 tokens/sec
Source: Groq model card · Updated Jun 1, 2026 · See full rankings →
Specifications
| Provider | Groq |
|---|---|
| Context window | 128K tokens |
| Modality | text |
| Parameters | 8B |
| Open source | Yes — open weights available |
| Released | Jul 23, 2024 |
| Status | Current |
| Last updated | Jul 4, 2026 |
| Tags | fast open-weights speed |
Cost calculator
At a glance
Embed this price
A live, auto-updating badge for your README or docs:
Price history
Last updated: Jul 10, 2026 · price links to the official provider pricing page (source above)
3 price changes recorded since Jul 29, 2024