Has anyone here worked much with generators in #emacs ?
I am looking for a good solution for streaming outputs in my ollama-elisp-sdk project. I think there's a good angle using generators to make a workflow fairly similar to e.g. the OpenAI API. Not sure yet though.
@holgerschurig Thanks! I'm not really going for a repl; there are a few different implementations out there already. I'm more just trying to write an elisp layer over the whole ollama API, so you can more easily use ollama via elisp.
I think the main issue I'm running into is how callbacks work in the url library. I don't yet see how to use url for streaming (and I don't technically have to, I could use curl) because the callback still isn't triggered until the full (streaming) response is complete.
Add comment