CatPPT 7B - GGUF

Quantized GGUF version of the model CatPPT (instruct), using Llama.Cpp Convert.py

GGUF

Model size

7.24B params

Architecture

llama

8-bit

Inference API

Inference API (serverless) has been turned off for this model.

Model tree for JustData/CatPPT-7B-GGUF

Base model

Quantized

this model