CMDAI LOAD MODELS - GGUF Models Browser

GGUF Models GGUF Only

GGUF models loaded — ready to download

🏆 TOP 20 GGUF Model Ranking

📊 Models by Category

📥 Downloaded Models

Settings

📁 Download Location

Folder for saving GGUF models

No folder selected — click "Browse"

⚠️ Requires Chrome/Edge browser with File System Access API

ℹ️ About the GGUF Format

GGUF (GPT-Generated Unified Format) is a format optimized for running LLM models on consumer hardware through quantization.

Quantization Types:

Q4_K_M

Best balance
~60% of original size

Q5_K_M

Higher quality
~70% of original size

Q8_0

Highest precision
~80% of original size

RAM Requirements:

• 1–3B model: ~2–4 GB RAM
• 7B model (Q4): ~5–8 GB RAM
• 14B model (Q4): ~9–12 GB RAM
• 32B model (Q4): ~20–24 GB RAM
• 70B+ model (Q4): ~40+ GB RAM

GGUF Models GGUF Only

🏆 TOP 20 GGUF Model Ranking

📊 Ranking Methodology