Local LLM model page
Llama 3.2 (1B)
Meta's ultra-compact edge model. Runs on anything with 4GB RAM. Great for quick tasks and edge devices.
Parameters
1B
Minimum RAM
4 GB
Model size
0.6 GB
Quantization
Q5_K_M
Can Llama 3.2 (1B) run locally?
Llama 3.2 (1B) is best suited for entry-level laptops and desktops. LocalClaw recommends Q5_K_M as the default quantization, with at least 4 GB RAM.
Search term for LM Studio or compatible runtimes: llama-3.2-1b-instruct
Hugging Face repository: lmstudio-community/Llama-3.2-1B-Instruct-GGUF
chatlightspeedgeneral
Strengths
- Ultra-compact — runs on literally anything
- 128K context
- Good for edge devices
- 8 languages
Limitations
- Very limited capability
- Struggles with complex tasks
- No serious coding
Best use cases
- Edge AI
- Mobile deployment
- Simple classification
- Text extraction
- Quick summarization
Benchmarks
Speed: 10/10
Quality: 3/10
Coding: 3/10
Reasoning: 3/10
Technical details
Developer: Meta AI
License: Llama 3.2 Community License
Context window: 131,072 tokens
Architecture: Transformer decoder-only
Released: 2024-09