https://huggingface.co/WarlordHermes/Magidonia-24B-v4.3-creative-ORPO-v3
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Magidonia-24B-v4.3-creative-ORPO-v3-GGUF for quants to appear.
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Magidonia-24B-v4.3-creative-ORPO-v3-GGUF for quants to appear.
It looks like you forgot to quantize this model. By the way, support for the new model was added in llama.cpp b7563.
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Magidonia-24B-v4.3-creative-ORPO-v3-GGUF for quants to appear.It looks like you forgot to quantize this model. By the way, support for the new model was added in llama.cpp b7563.
I think the quantization had an error.
But i did quantize it myself, if you are interested:
https://huggingface.co/WarlordHermes/Magidonia-24B-v4.3-creative-ORPO-v3-GGUF
Would love feedback.
Ouer quantisation back then failed due to FileNotFoundError: File not found: Magidonia-24B-v4.3-creative-ORPO-v3/tokenizer.model
I gave it another try just in case but I still don't see any tokenizer.model under https://huggingface.co/WarlordHermes/Magidonia-24B-v4.3-creative-ORPO-v3/tree/main but lets see how it turns out this time.