Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
calme-2.1-phi3-4b-GGUF
like
1
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
phi
phi-3
text-generation-inference
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
58b9ef3
calme-2.1-phi3-4b-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
9246f03fdb239e2291efdbc95a231ce4c84c2f2be7178ea3e809afb537075548
58b9ef3
verified
4 months ago
.gitattributes
2.27 kB
9246f03fdb239e2291efdbc95a231ce4c84c2f2be7178ea3e809afb537075548
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q2_K.gguf
1.42 GB
LFS
05196996c1ba0ec2dfc7e19e70f6cee1efc5efd4f414e049f311b42b7a8abb7a
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q3_K_L.gguf
2.09 GB
LFS
9d18ccb53c01a30b285d06b1b1642b9ebcdd4f4e44bcf033635ea04e42e2e087
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q3_K_M.gguf
1.96 GB
LFS
4d92354cd457d93a73ae5e514d2219e3d77d2dd935dcf41814b2c1384002ab62
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q4_K_M.gguf
2.39 GB
LFS
e17f8fc019f4af8b71126af4dc7b1078a1a1ae5ccb24de925eb25b0fd9d654e9
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q4_K_S.gguf
2.19 GB
LFS
e1deb8d59e34859e34418bb58dd284043b676f7d5326c431a703611d6612f4b8
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q5_K_M.gguf
2.82 GB
LFS
f80afa9df5a65518acb96e498a8367dda048cae99367489b5c396e61a026b2d3
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q5_K_S.gguf
2.64 GB
LFS
0182b0a5cbf62c01773fd11dbf6cccbc6004bea863bc72f76c318a4b1fab72da
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q6_K.gguf
3.14 GB
LFS
f4fe13c9ee24b09b1543a2c41bae432779ba0a112fcb52fb1d51f09f9241c505
4 months ago
Phi-3-mini-4k-instruct-v0.1.Q8_0.gguf
4.06 GB
LFS
39de9b0f410cf630aaf80d8b70b3886a44834c3a242e0eda8e1bdcc16fd4bf46
4 months ago
Phi-3-mini-4k-instruct-v0.1.fp16.gguf
7.64 GB
LFS
9246f03fdb239e2291efdbc95a231ce4c84c2f2be7178ea3e809afb537075548
4 months ago
