-
-
-
-
-
-
Inference Providers
Active filters:
gptq
Euraika/EuroLLM-22B-Instruct-GPTQ
Text Generation
•
23B
•
Updated
•
718
•
2
StefanKrsteski/Phi-3-mini-4k-instruct-GPTQ-8bit
Text Generation
•
4B
•
Updated
•
27
•
2
Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8
Text Generation
•
2B
•
Updated
•
421
•
6
AgeOfAlgorithms/Llasa-1b-GPTQ-4bit
Text Generation
•
1B
•
Updated
•
1
•
1
Qwen/Qwen2.5-Omni-7B-GPTQ-Int4
Any-to-Any
•
11B
•
Updated
•
36.8k
•
13
SEOKDONG/gpt-oss-safeguard-20b-kor-enterprise-gptq-4bit
Text Generation
•
21B
•
Updated
•
34
•
1
0xSero/GLM-4.7-REAP-50-W4A16
Text Generation
•
2B
•
Updated
•
4.92k
•
67
Jon-Nielsen/GLM-4.7-REAP-30-W4A16
Text Generation
•
2B
•
Updated
•
221
•
2
baichuan-inc/Baichuan-M3-235B-GPTQ-INT4
Text Generation
•
235B
•
Updated
•
741
•
9
plezan/MiniMax-M2.1-REAP-50-W4A16
Text Generation
•
17B
•
Updated
•
1.48k
•
5
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
11
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
19
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
6
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
5
•
121
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
1
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
2
•
2
Text Generation
•
Updated
•
3
•
45
Text Generation
•
7B
•
Updated
•
31
•
31
Text Generation
•
Updated
•
1.37k
•
21
Text Generation
•
Updated
•
1.37k
•
41
Text Generation
•
13B
•
Updated
•
9
•
38
TheBloke/galpaca-30B-GPTQ
Text Generation
•
Updated
•
5
•
48
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
3
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
1
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
•
7B
•
Updated
•
14
•
15
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
2
•
1
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
1
•
3
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
•
33B
•
Updated
•
9
•
20
TheBloke/gpt4-alpaca-lora-13B-GPTQ
Text Generation
•
13B
•
Updated
•
145
•
20
TheBloke/alpaca-lora-65B-GPTQ
Text Generation
•
65B
•
Updated
•
11
•
29