Models

baichuan-inc/Baichuan-M3-235B-GPTQ-INT4

Text Generation • 235B • Updated 5 days ago • 510 • 8

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • 8B • Updated Nov 18, 2024 • 965k • 11

anon8231489123/vicuna-13b-GPTQ-4bit-128g

Text Generation • Updated Apr 7, 2023 • 1.2k • 664

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 542 • 594

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 42 • 150

TheBloke/llama2_70b_chat_uncensored-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 267 • 58

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 427 • 216

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • 47B • Updated Dec 14, 2023 • 474k • 141

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • 14B • Updated Jun 9, 2024 • 905 • 50

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • 8B • Updated Sep 21, 2024 • 12.4k • 31

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated Oct 18, 2024 • 4.98k • 18

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Oct 9, 2024 • 1.29k • 14

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • 73B • Updated Oct 9, 2024 • 21.9k • 28

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • 33B • Updated Nov 18, 2024 • 8.13k • 24

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21, 2025 • 301k • 44

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • 721B • Updated Aug 30, 2025 • 6 • 2

btbtyler09/Kimi-Dev-72B-GPTQ-8bit

Text Generation • 73B • Updated Jun 18, 2025 • 5 • 1

LGAI-EXAONE/EXAONE-4.0-1.2B-GPTQ-Int8

Text Generation • 1B • Updated Aug 1, 2025 • 120 • 9

btbtyler09/Qwen3-Coder-30B-A3B-Instruct-gptq-8bit

Text Generation • 9B • Updated Aug 2, 2025 • 33 • 2

btbtyler09/Qwen3-Coder-30B-A3B-Instruct-gptq-4bit

Text Generation • 31B • Updated Aug 2, 2025 • 1.8k • 1

mispeech/midashenglm-7b-1021-w4a16-gptq

Audio-Text-to-Text • 3B • Updated Oct 31, 2025 • 47 • 1

M5Stack/Qwen3-1.7B-GPTQ-Int8-axmodel

Updated Oct 28, 2025 • 1

kaitchup/Olmo-3-32B-Think-gptq-w4a16-g128

5B • Updated Dec 16, 2025 • 1

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 271B • Updated Dec 18, 2025 • 144 • 3

kaitchup/Olmo-3.1-32B-Think-gptq-w4a16-g128

5B • Updated Dec 16, 2025 • 4 • 1

btbtyler09/Devstral-Small-2-24B-Instruct-INT4-INT8-Mixed-GPTQ

Image-to-Text • 7B • Updated 24 days ago • 2k • 1

SamMikaelson/deepseek-ocr-gptq-4bit

Updated 10 days ago • 272 • 1

TheBloke/Venus-103b-v1.1-GPTQ

Updated Dec 10, 2023 • 1

Rschmaelzle/gpt_quotes

Text Generation • Updated Nov 26, 2022 • 6

sr5434/gptQuotes

Text Generation • 0.3B • Updated Jul 20, 2023 • 4