happyborg, Try a local #LLM using #Mozilla's #Llamafile:
Get the 4.3GB file:
curl -LO https://huggingface.co/jartine/llava-v1.5-7B-GGUF/resolve/main/llava-v1.5-7b-q4-server.llamafileMake executable
Run it
Visit http://127.0.0.1:8080/
You're welcome!
This is a text and image capable LLM, so ~ #ChatGPT 4
h/t @simon
More in Simon's blog: https://simonwillison.net/2023/Nov/29/llamafile/