Llama 3.1 8B Instruct
ConditionalMeta · Llama · Released 2024-07
8BText
The default pick for a local 8B chat model: strong instruction following for its size, easy to quantize and run on a single consumer GPU.
Strengths
- +Runs comfortably on 8-16GB consumer GPUs
- +Broad tool and fine-tune ecosystem
- +Solid multilingual coverage for its size
Limitations
- -Custom license restricts use above 700M MAU without a separate agreement
- -Weaker long-context reasoning than larger siblings
License
Llama 3.1 Community License
free with acceptable-use or scale conditions - read it
Hardware
runs on a good consumer GPU (or Apple Silicon) with quantization
Links
Stats
meta-llama/Llama-3.1-8B-Instruct— downloads·— likes
via Hugging Face