ME 1

New activity in anthracite-org/magnum-v2-123b 14 days ago

Context length?

#8 opened 14 days ago by

New activity in bartowski/magnum-v2-123b-GGUF 16 days ago

Getting jibberisk output on Q6

#2 opened 16 days ago by

New activity in bartowski/Reflection-Llama-3.1-70B-GGUF 18 days ago

Low quants don't seem to work (no <reflection> tags)

6

#3 opened 19 days ago by

MrHillsss

New activity in turboderp/Mistral-Large-Instruct-2407-123B-exl2 20 days ago

5.0bpw quants

#1 opened 2 months ago by

bullerwins

New activity in anthracite-org/magnum-v2-12b 21 days ago

I love this model but why does it keeps calling me Anon?

#7 opened 21 days ago by

AliceThirty

New activity in anthracite-org/magnum-v2-123b-gguf 27 days ago

How much VRAM do you need (you = Anthracite)

#3 opened 29 days ago by

New activity in bartowski/Llama-3.1-70B-Instruct-lorablated-GGUF 27 days ago

GGUF

#3 opened 27 days ago by

New activity in mradermacher/magnum-v2-123b-GGUF about 1 month ago

136GB VRAM enough to run Q8?

10

#1 opened about 1 month ago by

New activity in anthracite-org/magnum-v2-123b-exl2 about 1 month ago

Files empty?

#2 opened about 1 month ago by

New activity in mradermacher/magnum-72b-v1-i1-GGUF about 1 month ago

Intelligence difference between Q6_K and i1-Q6_K?

#1 opened about 1 month ago by

New activity in MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ about 2 months ago

Template?

#2 opened about 2 months ago by

New activity in bartowski/Llama-3.1-70B-Instruct-lorablated-GGUF about 2 months ago

Instruction template?

#2 opened about 2 months ago by

New activity in mradermacher/Llama-3.1-70B-Instruct-lorablated-GGUF about 2 months ago

Duplicate leading "<|begin_of_text|>" in prompt error (Oobabooga)

#2 opened about 2 months ago by

New activity in turboderp/Mixtral-8x22B-Instruct-v0.1-exl2 about 2 months ago

Does not run in Oobabooga?

#5 opened about 2 months ago by

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 about 2 months ago

120GB of VRAM enough to run this model?

8

#237 opened about 2 months ago by

New activity in mradermacher/Palmyra-Med-70B-GGUF about 2 months ago

Detected duplicate leading "<|begin_of_text|>" in prompt

#2 opened about 2 months ago by

New activity in failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5 about 2 months ago

Tried Llama 3.1 70B?

#5 opened about 2 months ago by

noisefloordev

New activity in mradermacher/model_requests about 2 months ago

Llama 3.1 70B Abliterated

#194 opened about 2 months ago by

New activity in bartowski/Meta-Llama-3.1-70B-Instruct-GGUF about 2 months ago

Abliterated quant?

4

#7 opened about 2 months ago by

New activity in mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib about 2 months ago

Oobabooga?

#1 opened about 2 months ago by

New activity in lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF 2 months ago

Q6 doesn't work.

#2 opened 2 months ago by

New activity in mistralai/Mistral-Large-Instruct-2407 2 months ago

GGUF quants pl0x

#5 opened 2 months ago by

New activity in HuggingFaceTB/SmolLM-360M 2 months ago

How to run this on iPhone 14 Pro Max?

#2 opened 2 months ago by

New activity in facebook/chameleon-30b 3 months ago

Error: "Transformers does not recognize this architecture."

#1 opened 3 months ago by

New activity in bartowski/llama-3-70B-Instruct-abliterated-GGUF 3 months ago

OOM when trying to load the Q8 in Oobabooga (I have 98GB VRAM)

#1 opened 3 months ago by

New activity in failspy/llama-3-70B-Instruct-abliterated 3 months ago

What hardware you use

#8 opened 5 months ago by

Jonvas

New activity in pabloce/Tess-v2.5-Qwen2-72B-gguf 3 months ago

Error when trying to run in OobaBooga

5

#1 opened 3 months ago by

New activity in microsoft/Phi-3-medium-128k-instruct-onnx-cuda 4 months ago

No files when downloading?

#1 opened 4 months ago by

New activity in bartowski/Phi-3-medium-4k-instruct-exl2 4 months ago

Not downloading

#1 opened 4 months ago by

New activity in abacusai/Smaug-Llama-3-70B-Instruct 4 months ago

Will this run on a 4090 and 64GB of DDR5?

#6 opened 4 months ago by

New activity in NousResearch/Hermes-2-Theta-Llama-3-8B 4 months ago

Can you guys make a merge that writes naturally as a human being?

#2 opened 4 months ago by

New activity in bartowski/Meta-Llama-3-70B-Instruct-GGUF 5 months ago

How to join the Q6 files?

11

#2 opened 5 months ago by