jxtngx
/

v6-Finch-7B-HF-Q4_0-GGUF

Model card Files Files and versions Community

Edit model card

jxtngx/v6-Finch-7B-HF-Q4_0-GGUF

This model was converted to GGUF format from RWKV/v6-Finch-7B-HF using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

Downloads last month: 10

GGUF

Model size

7.64B params

Architecture

rwkv6

4-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for jxtngx/v6-Finch-7B-HF-Q4_0-GGUF

Base model

RWKV/v6-Finch-7B-HF

Quantized

(6)

this model

Collection including jxtngx/v6-Finch-7B-HF-Q4_0-GGUF

GGUF small language models

LMs of 8B parameters or less. Quantized in 8bit and 4bit representations, and converted to GGUF. • 34 items • Updated 2 days ago