While trying to pull the model I get the following error: Azurro/Mistral-7B-Instruct-v0.1-qlora-polish does not appear to have a file named config.json. Does it make sense to add it?

Azurro org

That's not a model; it's an adapter, and its configuration is provided. You can load it like this:

model = AutoModelForCausalLM.from_pretrained(MODEL_PATH)
model = PeftModel.from_pretrained(model, ADAPTER_PATH)
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment