| Family | Version | Parameters | Variant | GGUF via HF | Source | |
|---|---|---|---|---|---|---|
| SmolLM | 2.0 | 0.135B | Instruct | f16 (271MB) | q8 (145MB) | Source |
| SmolLM | 2.0 | 0.36B | Instruct | f16 (726MB) | q8 (386MB) | Source |
| SmolLM | 2.0 | 1.7B | Instruct | f16 (3.42GB) | q8 (1.82GB) | Source |
| Mistral Small | 3.0 | 24B | Instruct | f16 (47.2GB) | q8 (25.1GB) | Source |
| Mistral Small | 3.1 | 24B | Instruct | f16 (47.2GB) | q8 (25.1GB) | Source |