Where can I download the weights for Pygmalion 7B & 13B 4bit GGML?
According to the docs I have to download two files and merge them. I don't know if this takes too much time or requires a good GPU. Where can I find the already merged weights?
According to the docs I have to download two files and merge them. I don't know if this takes too much time or requires a good GPU. Where can I find the already merged weights?
henk717, For 13B there are a lot of different formats, pick the one you want with the small download icon : https://huggingface.co/TehVenom/Pygmalion-13b-GGML/tree/main
OptimusPrime, (edited ) ...
henk717, Different person quantizing them, shouldn't make a big difference. Pick whatever one is newer if you do run into issues.
db0, Unfortunately I am not that familiar with the kobold side. Hopefully someone can come over to assist
Add comment