FYI - #llama is NOT#opensource. The license is categorically not open source. Among other things, the llama 2 and 3 licenses explicitly violate Field of Endeavor.
I see all sorts of blogs and marketing materials claiming things are "open source" because they used llama somewhere. Please do not take these claims at face value.
"There has been a shift in the #AI space: some models, like #ChatGPT & #Gemini, have evolved into entire web platforms spanning multiple use cases & access points. Other large language models like #LLaMa or #OLMo, though technically speaking they share a basic architecture, don’t actually fill the same role. They are intended to live in the background as a service or component, not in the foreground as a name brand." https://techcrunch.com/2024/04/19/too-many-models/
With all the valid concern around #llm and #genai power and water usage, I thought I'd start a blog series on tiny LLMs. Let's see what they can do on real tasks on very power efficient hardware.
The impact from smaller opensource LLMs like Llama3-8B and Phi-3 could be large. They are not necessarily the best and smartest models but can be easily integrated in software on every device and platform. Also they can be finetuned, improved with RAG to function better for specific tasks and in specific contexts. Exciting times ahead. #opensource#LLM#AI#Llama#Phi
⚠️ @forrestbrazeal on the inside threat to OSS
🍴Vicki Boykis says Redis is forked
👻 @johnonolan says Ghost is federating
🦙 Meta Engineering announces Llama 3
❓ @eieio's questions to ask when you don't want to work
🎙 hosted by @jerod
Meta released today Llama 3, the next generation of the Llama model. LLama 3 is a state-of-the-art open-source large language model. Here are some of the key features of the model: 🧵👇🏼
(2/3) ✅ The new model comes with integration into the core cloud providers such as AWS, GCP, Azure, Databricks, Hugging Face, etc.
✅ The model supports a variety of hardware architectures, such as AMD, AWS, Dell, Intel, NVIDIA, and Qualcomm.
✅ Supporting safety and cyber tools
✅ The model comes in two versions - 7B and 80B
A major release to Ollama - version 0.1.32 is out. The new version includes:
✅ Improvement of the GPU utilization and memory management to increase performance and reduce error rate
✅ Increase performance on Mac by scheduling large models between GPU and CPU
✅ Introduce native AI support in Supabase edge functions