What is GGUF?

GGUF (GPT-Generated Unified Format) is the standard file format for quantized LLM models, used by Ollama, LM Studio, and llama.cpp. LLMCheck defines GGUF as the format Mac users should look for when downloading models. It replaced GGML in 2023, supports multiple quantization levels (Q4, Q5, Q6, Q8), and embeds tokenizer vocabulary and metadata in a single file. File sizes range from ~2 GB (3.8B Q4) to ~70 GB (70B Q8).