raf, 25 days ago

@kjr

Do you have a desired output format?

kjr, 25 days ago

I realize now that maybe that is a question for @raf

kachumbali, 26 days ago

@kjr tried Mistral7B instruct yet?

kjr, 26 days ago

@kachumbali
Yes, it works fine, but only for English.

kachumbali, 26 days ago

@kjr I’ll try to give it my first local RAG spin

kjr, 26 days ago

@kachumbali If you want to try for English the results are quite good.
What is your use case?

kachumbali, 26 days ago

@kjr I’m really not good at this. got Ollama running, tested it with local llms with a specific dataset, prompts, etc, cross evaluated responses, and would love to now improve that with a RAG setup and get better responses

kjr, 26 days ago

@kachumbali I can recommend Mistral 7B, it has a very good performance.