Re-quantize and re-upload model
#1
by
mtasic85
- opened
@Lyte llama.cpp fixed issue with BOS/EOS tokens, and all models need to be re-quantized and re-uploaded.
Please check https://github.com/ggerganov/llama.cpp/issues/9315
@mtasic85 I re-quantized the models and re-uploaded them and luckily i made it using the latest llama.cpp which changed some stuff just 2 hours ago, so these should be the latest GGUFs for RWKV lol what a coincidence.