devinprater, 5 months ago @MutedTrampet Yeah, I ran Ollama, with a few models, and it's like 3 tokens per second lol. But once they start using more than just NVIDIA GPU's, I think it'll get faster for people like me that have AMD GPU's.
@MutedTrampet Yeah, I ran Ollama, with a few models, and it's like 3 tokens per second lol. But once they start using more than just NVIDIA GPU's, I think it'll get faster for people like me that have AMD GPU's.