TedUnderwood, 4 months ago @seinecle I don’t actually have first hand experience on this yet though I want to soon. My understanding is that memory (VRAM or Apples unified memory) matters a lot. Also people sacrifice some quality by quantizing models to make them smaller.
@seinecle I don’t actually have first hand experience on this yet though I want to soon.
My understanding is that memory (VRAM or Apples unified memory) matters a lot. Also people sacrifice some quality by quantizing models to make them smaller.