Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

4-bit precision

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

9,227

Full-text search

Active filters: bitsandbytes

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 22 days ago • 288k • 67

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated about 1 hour ago • 12.8k • 55

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Aug 13 • 632 • 240

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 1.65k • 31

DewEfresh/pixtral-12b-8bit

Updated 6 days ago • 468 • 3

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 416 • 3

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated 14 days ago • 12k • 31

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 491 • 18

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jul 22 • 19.1k • 70

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 22 days ago • 13.5k • 18

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated 14 days ago • 4.62k • 2

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 587 • 2

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 132 • 2

unsloth/Qwen2.5-14B-bnb-4bit

Text Generation • Updated 1 day ago • 43 • 2

unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 12 • 2

faisalahmedsifat/bloom-3b-convo-bangla-english-instruction-existing

Text Generation • Updated Nov 15, 2023 • 8 • 1

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated 22 days ago • 545 • 3

roshanrai1304/llama_2_finetune_on_real_estate_data

Text Generation • Updated Feb 1 • 9 • 1

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated 22 days ago • 6.77k • 15

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated 22 days ago • 3.28k • 18

mlabonne/Jambatypus-v0.1

Text Generation • Updated Apr 4 • 15 • 37

dattaraj/Gemma-2b-it-mental-health

Text Generation • Updated Apr 22 • 12 • 1

kishorea/Llama3_medqa

Text Generation • Updated Apr 29 • 2.26k • 1

unsloth/Qwen2-1.5B-bnb-4bit

Text Generation • Updated 22 days ago • 6.66k • 5

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated 22 days ago • 2.61k • 10

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Jul 1 • 545 • 17

Shaleen123/gemma2-9b-medical

Text Generation • Updated Jul 4 • 15 • 2

PrunaAI/ResplendentAI-Aura_Uncensored_l3_8B-bnb-8bit-smashed

Text Generation • Updated Jul 18 • 11 • 1

PrunaAI/ResplendentAI-Aura_Uncensored_l3_8B-bnb-4bit-smashed

Text Generation • Updated Jul 18 • 6 • 1

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7 • 33.3k • 28