seinecle, 
LLM specialists: besides a powerful computer with a GPU, what kind of tricks can I use to make a locally hosted model spit out a response faster? Thx!
seinecle, LLM specialists: besides a powerful computer with a GPU, what kind of tricks can I use to make a locally hosted model spit out a response faster? Thx!