I pulled together notes on all of the LLM plugins that have worked for me for Llama 3 - both for hosting locally (I've run 8B and 70B on my 64GB M2) and access via APIs (Groq is SO FAST for that)
Options for accessing Llama 3 from the terminal using LLM
https://simonwillison.net/2024/Apr/22/llama-3/
Animated demo. The sonnet appears in less than a second: Here is a sonnet about a brave owl: In moonlit skies, a silhouette is seen, A wingspan wide, a watchful, piercing gaze. The owl, a sentinel of secrets keen, Patrols the night, with valor in her ways. Her feathers soft, a camouflage gray, She glides unseen, a phantom of the night. Her eyes, like lanterns, shining bright and far, Illuminate the darkness, banishing all fright. Her talons sharp, a grasping, deadly sway, She swoops upon her prey, with silent might. Yet in her heart, a wisdom, old and gray, A fierce devotion to the darkness of the night. And thus, the owl, a symbol of courage true, Inspires us all, with brave and noble pursuit. I hope you enjoy this sonnet!