Toots' MLX Quants Various MLX quants for testing on Mac systems. mrtoots/unsloth-GLM-4.7-mlx-4Bit Text Generation • 353B • Updated Dec 23, 2025 • 92 • 1 mrtoots/unsloth-Qwen3-Coder-Next-mlx-8bit Text Generation • 80B • Updated Feb 3 • 375 • 1 mrtoots/unsloth-Qwen3-Coder-30B-A3B-Instruct-mlx-8Bit Text Generation • 31B • Updated Aug 30, 2025 • 216 mrtoots/unsloth-GLM-4.7-mlx-3Bit Text Generation • 353B • Updated Dec 23, 2025 • 206 • 1
mrtoots/unsloth-Qwen3-Coder-30B-A3B-Instruct-mlx-8Bit Text Generation • 31B • Updated Aug 30, 2025 • 216
Neat Models 3rd party quants or other LLM finds inferencerlabs/Mistral-Small-4-119B-2603-MLX-Q9 Text Generation • 38B • Updated Mar 19 • 179 • 2 mlx-community/DeepSeek-V4-Flash-4bit Text Generation • 284B • Updated Apr 25 • 23.9k • 27 mlx-community/deepseek-ai-DeepSeek-V4-Flash-4bit Text Generation • 284B • Updated Apr 24 • 1.22k • 5 zai-org/GLM-5.2 Text Generation • 753B • Updated Jul 2 • 2.23M • • 4.83k
Toots' MLX Quants Various MLX quants for testing on Mac systems. mrtoots/unsloth-GLM-4.7-mlx-4Bit Text Generation • 353B • Updated Dec 23, 2025 • 92 • 1 mrtoots/unsloth-Qwen3-Coder-Next-mlx-8bit Text Generation • 80B • Updated Feb 3 • 375 • 1 mrtoots/unsloth-Qwen3-Coder-30B-A3B-Instruct-mlx-8Bit Text Generation • 31B • Updated Aug 30, 2025 • 216 mrtoots/unsloth-GLM-4.7-mlx-3Bit Text Generation • 353B • Updated Dec 23, 2025 • 206 • 1
mrtoots/unsloth-Qwen3-Coder-30B-A3B-Instruct-mlx-8Bit Text Generation • 31B • Updated Aug 30, 2025 • 216
Neat Models 3rd party quants or other LLM finds inferencerlabs/Mistral-Small-4-119B-2603-MLX-Q9 Text Generation • 38B • Updated Mar 19 • 179 • 2 mlx-community/DeepSeek-V4-Flash-4bit Text Generation • 284B • Updated Apr 25 • 23.9k • 27 mlx-community/deepseek-ai-DeepSeek-V4-Flash-4bit Text Generation • 284B • Updated Apr 24 • 1.22k • 5 zai-org/GLM-5.2 Text Generation • 753B • Updated Jul 2 • 2.23M • • 4.83k
mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-2Bit Text Generation • 671B • Updated Sep 23, 2025 • 83 • 1