Phi-3.5 Mini Instruct
PermissiveMicrosoft · Phi · Released 2024-08
3.8BText
A tiny MIT-licensed model built for on-device and edge use, with a 128K context window that is unusually large for its size class.
Strengths
- +MIT license, unrestricted use
- +128K context window
- +Runs on CPUs and low-VRAM edge hardware
Limitations
- -Limited reasoning depth compared to 7B+ models
- -Prone to more frequent factual errors on niche knowledge
License
MIT
use commercially with attribution niceties
Hardware
runs on a good consumer GPU (or Apple Silicon) with quantization
Links
Stats
microsoft/Phi-3.5-mini-instruct— downloads·— likes
via Hugging Face