Back to Quant Hub

Falcon 3 10B Instruct

10B

TII UAE

Technology Innovation Institute's latest Falcon. Good multilingual and code mix.

⬇ 4.3K HF downloads♥ 3 likesbartowski/Falcon3-10B-Instruct-GGUF· stats from 6/24/2026
Consumer GPUMac / Apple Silicon

33K

Max Context

2

Quant Variants

GGUF Q4_K_M

Best Quality

96.9%

Accuracy Retained

Calculate VRAMHugging FaceCompare

Quantization Variants

Per-quant VRAM, quality loss, and inference speed on RTX 4090

FormatLevelBPWVRAMPPL LossSpeedActions
GGUFQ4_K_M4.857.0 GB3.1%118 tok/s
CalcHF
GPTQINT446.2 GB4.8%155 tok/s
CalcHF