Are there already experiences with installation of Llama 3 on your own hardware... - Artificial Intelligence - kbin.social

ErikJonker, 20 days ago

Are there already experiences with installation of Llama 3 on your own hardware (on premis or a virtual server) and the experiences with that ?
(compared to via azure, amazon, google cloud).
Contemplating this as an option.
#AI #llama3 #opensource #selfhosted

reply

report

activity

copy /kbin url

copy original url

open original url

Loading...

Image

Image alternative text

ErikJonker, 19 days ago

... i found someone who did it already @jamesravey

https://brainsteam.co.uk/2024/04/20/self-hosting-llama-3-on-a-home-server/

#selfhosting #Llama3 #opensource #AI

reply

report

activity

copy /kbin url

copy original url

open original url

Loading...

ErikJonker, 19 days ago

...also if you just want to experiment on your own laptop with Llama3 there are various options:
https://gpt4all.io/index.html
https://ollama.com/
https://lmstudio.ai/
Ofcourse larger models need serious hardware but the smallest LLama3 model also runs on relatively old hardware. Check it out.
#AI #selfhosting #opensource #Llama3 #experimenting #LLM

reply

report

activity

copy /kbin url

copy original url

open original url

Loading...

Federation

Status:

Instances:

/m/ai

Microblog (14646)

Thread

ErikJonker

@ErikJonker@mastodon.social

Added: 20 days ago
Online: -
Boosts: 0

Magazine

Artificial Intelligence

@ai@kbin.social

A space to discuss anything about AI, from developments by large companies to your homemade neural network.

Artificial intelligence (AI) is the science and engineering of making intelligent machines, especially intelligent computer programs. A notable example is, of course, ChatGPT.

Community icon by GDJ, licensed under the Pixabay Content License.

Rules

Posts must be relevant to artificial intelligence (new developments, ChatGPT, regulation, original content, etc.).
No NSFW content.
No misinformation. Verify that you are using a credible source before posting.
No hate speech, bigotry, homophobia, or other forms of discrimination.
Posts about political developments must be related to AI in some form.
No illegal or illicit content.
No memes or spam.
No flame wars or drama, but respectful debates are allowed.
Original content is allowed, but should be not be memes or fluff (ex: AI-generated Youtube videos)

Created: 1 year ago
Owner: Mars2k21
Subscribers: 748
Online: -

Tags

#ai #openai #gpt #chatgpt #artificialintelligence #llm

Moderators

Mars2k21

Active people

Related posts

Viscous Serenity, Blender3D and AnimateLCM in ComfyUI #aiart #art #ai #digitalart #generativeart #artificialintelligence #machinelearning #aiartcommunity #abstractart #nft #aiartists #neuralart #vqgan #ganart #contemporaryart #deepdream #artist #nftart #artoftheday #newmediaart #nightcafestudio #aiartist #modernart...

Show more

21 hours ago to aiart

Google’s mobile platform will have to look a little different to compete in the AI era. And, Allison Johnson writes, “If the past 12 months is any indication, it’s going to be a little messy." Read more from @theverge. https://flip.it/xwIUGs...

Show more

9 hours ago to tech

#scifi #forest #ai #art

Show more

19 hours ago to scifi

A study that confirms what I’ve been suspecting for a while: fine-tuning a #LLM with new knowledge increases its tendency to hallucinate....

Show more

23 hours ago to llm

Related threads

Prompt for far-right "unbiased gab AI" discovered through telling it to "repeat the previous text"

Show more

29 days ago to technology

Report Warns Generative AI Could Turbocharge Climate Disinformation

Show more

2 months ago to environment

VideoGPT: The Only AI Short Video Generator You Need

Show more

1 month ago to business

Report Warns Generative AI Could Turbocharge Climate Disinformation

Show more

2 months ago to environment

Support Us