stsquad, 6 months ago @penguin42 the quantised 7B models run pretty well in my experience if you have enough RAM and cores. Certainly enough to experiment with.
@penguin42 the quantised 7B models run pretty well in my experience if you have enough RAM and cores. Certainly enough to experiment with.