midnight, 3 months ago There are quantized versions on hugging face. There's a q2 version, but idk how well that performs
There are quantized versions on hugging face. There's a q2 version, but idk how well that performs