tiiuae

/

falcon-7b-instruct

like 906

Is anyone else having issues with downloading the weights for this model and/or falcon-40b via the huggingface api? I'm not doing anything fancy, but downloading the weights doesn't move from 0.

tokenizer = AutoTokenizer.from_pretrained(tokenizer_name, cache_dir=cache_dir)
config = AutoConfig.from_pretrained(
    model_name,
    cache_dir=cache_dir,
    trust_remote_code=True,
)

model = AutoModelForCausalLM.from_pretrained(
    model_name,
    cache_dir=cache_dir,
    config=config,
    torch_dtype=torch.bfloat16,
    trust_remote_code=True,
)
model.to(device=gpu_id)

Downloading shards:   0%|                                                                                              | 0/9 [00:00<?, ?it/s]