Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
quantized
text-generation-inference
4-bit precision
AutoTrain Compatible
Inference Endpoints
8-bit precision
Merge
Eval Results
Mixture of Experts
custom_code
Carbon Emissions
text-embeddings-inference
Apply filters
Models
1,515
Full-text search
Edit filters
Sort: Trending
Active filters:
quantized
Clear all
MaziyarPanahi/solar-pro-preview-instruct-GGUF
Text Generation
•
Updated
12 days ago
•
7.85k
•
15
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
•
Updated
Feb 19
•
836
•
43
byroneverson/gemma-2-27b-it-abliterated-gguf
Text Generation
•
Updated
15 days ago
•
2.48k
•
12
MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF
Text Generation
•
Updated
7 days ago
•
174
•
2
qualcomm/Stable-Diffusion
Unconditional Image Generation
•
Updated
Apr 30
•
19
qualcomm/ControlNet
Unconditional Image Generation
•
Updated
14 days ago
•
6
argmaxinc/whisperkit-coreml
Updated
8 days ago
•
31.5k
•
71
FantasiaFoundry/GGUF-Quantization-Script
Text Generation
•
Updated
Aug 9
•
57
Lewdiculous/Model-Requests
Updated
15 days ago
•
37
MaziyarPanahi/WizardLM-2-8x22B-GGUF
Text Generation
•
Updated
Apr 16
•
1.28k
•
115
Mozilla/mxbai-embed-large-v1-llamafile
Feature Extraction
•
Updated
Jul 2
•
285
•
8
qualcomm/Llama-v3-8B-Chat
Text Generation
•
Updated
14 days ago
•
6
MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF
Text Generation
•
Updated
Jul 29
•
118k
•
10
MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF
Text Generation
•
Updated
6 days ago
•
160
•
1
MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF
Text Generation
•
Updated
6 days ago
•
178
•
1
MaziyarPanahi/Qwen2.5-3B-Instruct-GGUF
Text Generation
•
Updated
6 days ago
•
159
•
1
MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF
Text Generation
•
Updated
6 days ago
•
180
•
1
MaziyarPanahi/Qwen2.5-14B-Instruct-GGUF
Text Generation
•
Updated
6 days ago
•
261
•
1
MaziyarPanahi/Qwen2.5-32B-Instruct-GGUF
Text Generation
•
Updated
6 days ago
•
61
•
1
ravenscroftj/CodeGen-350M-multi-ggml-quant
Text Generation
•
Updated
Apr 24, 2023
•
2
ravenscroftj/CodeGen-2B-multi-ggml-quant
Text Generation
•
Updated
Aug 5, 2023
•
2
ravenscroftj/CodeGen-6B-multi-ggml-quant
Text Generation
•
Updated
Apr 24, 2023
•
9
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
•
Updated
Apr 29, 2023
•
6
•
4
ethzanalytics/dolly-v2-7b-sharded-8bit
Text Generation
•
Updated
Jun 28, 2023
•
10
•
1
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
•
Updated
May 5, 2023
•
8
ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit
Text Generation
•
Updated
May 4, 2023
•
6
•
2
rozek/OpenLLaMA_7B_300BT_q4
Text Generation
•
Updated
May 5, 2023
•
1
ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g
Text Generation
•
Updated
May 7, 2023
•
9
rirv938/GPTQ-LLaMa-65B-4bit-triton
Text Generation
•
Updated
May 25, 2023
•
6
kyo-takano/open-calm-7b-8bit
Text Generation
•
Updated
May 28, 2023
•
8
•
10
Previous
1
2
3
...
51
Next