ISTA-DASLab
/

Llama-2-70b-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-2-70b-AQLM-2Bit-1x16-hf / generation_config.json

Commit History

new dispatch again + correct dtype

4ae602a

BlackSamorez commited on Feb 27

Upload LlamaForCausalLM

d390f09
verified

BlackSamorez commited on Feb 25

new dispatch + safetensors

f835d3a

BlackSamorez commited on Feb 23

everything

e8e3f81

Andrei Panferov commited on Jan 29