Models

mlx-community/SERA-32B-6bit

Text Generation • Updated 5 days ago • 35 • 2

MaziyarPanahi/rank_zephyr_7b_v1_full-GGUF

Text Ranking • 7B • Updated Apr 2, 2025 • 113 • 6

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 137k • 33

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 163k • 25

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 18, 2024 • 137k • 10

ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw

Image-Text-to-Text • Updated Feb 10, 2025 • 3 • 3

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 181k • 18

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 139k • 15

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • 27B • Updated Mar 16, 2025 • 136k • 8

dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw

Updated Apr 28, 2025 • 14 • 14

MaziyarPanahi/Qwen3-1.7B-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 210k • 6

MaziyarPanahi/Qwen3-8B-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 209k • 8

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • 4B • Updated Apr 28, 2025 • 216k • 7

Qwen/Qwen3-0.6B-MLX-6bit

Text Generation • 0.1B • Updated Jul 7, 2025 • 54 • 4

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 139k • 7

mlx-community/MiniMax-M2-6bit

Text Generation • Updated Oct 28, 2025 • 63 • 2

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 67.4k • 2

mlx-community/VibeVoice-Realtime-0.5B-6bit

Text-to-Speech • 0.3B • Updated Dec 15, 2025 • 38 • 1

mlx-community/GLM-4.7-6bit

Text Generation • 353B • Updated Dec 22, 2025 • 10.8k • 1

mlx-community/HY-MT1.5-7B-6bit

Text Generation • 8B • Updated 29 days ago • 61 • 1

mlx-community/GLM-4.7-Flash-6bit

Text Generation • 30B • Updated 7 days ago • 10k • 5

mlx-community/Josiefied-LFM2.5-1.2B-Instruct-abliterated-6bit

Text Generation • 0.3B • Updated 6 days ago • 24 • 1

mlx-community/Jan-v3-4B-base-instruct-6bit

Text Generation • 0.9B • Updated 4 days ago • 37 • 1

mlx-community/LongCat-Flash-Lite-6bit

Text Generation • 69B • Updated 3 days ago • 17 • 1

CountCandy/Void-Citrus-L3.3-70B-6.0-EXL3

Text Generation • 27B • Updated about 2 hours ago • 1

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 1

MaziyarPanahi/phi-2-GGUF

Text Generation • 3B • Updated Jan 26, 2024 • 479 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 81 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 57 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Jan 30, 2024 • 58 • 5