Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

14,714

Full-text search

Active filters: 4-bit

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 6 days ago • 7.56k • 11

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 17 days ago • 324k • 65

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 1 day ago • 233 • 7

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated about 9 hours ago • 431 • 7

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated about 9 hours ago • 186 • 6

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated about 9 hours ago • 204 • 6

pzc163/MiniCPMv2_6-prompt-generator

Updated 26 days ago • 1.56k • 29

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 3 days ago • 8.16k • 20

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated 5 days ago • 18 • 5

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated 1 day ago • 103 • 5

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jul 22 • 26.3k • 70

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 17 days ago • 13.7k • 21

openbmb/MiniCPM-V-2_6-int4

Visual Question Answering • Updated Aug 8 • 14.9k • 54

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 49.9k • 47

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 5.02k • 19

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 2.67k • 162

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 29 days ago • 11.3k • 31

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated 29 days ago • 5.26k • 22

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 324k • 52

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 13 • 95.8k • 17

speakleash/Bielik-11B-v2.2-Instruct-GPTQ

Text Generation • Updated 22 days ago • 586 • 3

speakleash/Bielik-11B-v2.2-Instruct-AWQ

Text Generation • Updated 22 days ago • 132 • 3

stelterlab/Yi-Coder-9B-Chat-AWQ

Text Generation • Updated 11 days ago • 123 • 2

DataPilot/gemma2-Intelligent-Investor-5b-v2.5

Text2Text Generation • Updated 3 days ago • 17 • 2

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated about 9 hours ago • 98 • 2

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated about 9 hours ago • 288 • 2

LoneStriker/Mistral-Small-Instruct-2409-4.0bpw-h6-exl2

Updated 2 days ago • 44 • 2

MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF

Text Generation • Updated 2 days ago • 111 • 2

MaziyarPanahi/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated about 17 hours ago • 227 • 2

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated about 18 hours ago • 11 • 2