If you pick up one of the #Nvidia Orin boards, definitely get an SSD to go along with it. While it can run off an SD card, you’re going to run out of space quickly, and you’ll see a performance hit on complex tasks (like running a local #LLM). #EdgeAI#ai
To those concerned about #slack now using your chats, including trade secrets, NDA stuff, etc., to train their #llm: #WTF did you expect using a third party with full content access to discuss those things? That they'd be gentlemen and not read your mail? That they somehow wouldn't try to find a way to monetize that juicy data? I am flabbergasted that people working for corporations just as immoral could have been that naive...
@lpwaterhouse many startups use discord for the same reason as corporates use slack
tencent has a share in discord inc. and thus an access to all the data
everybody running a startup knows that
nobody cares
idk, maybe that's applicable for startups only
@bpavuk Judging by my timeline a lot of people seem to care now; I am confused as to how they either a) didn't see it coming at all (read: naive in face of overwhelming prior examples) or b) managed to actively "not care" until it was "too late" (Hint: It was "too late" the second you put data in, not when you learned that they are using it). "a)" I can imagine, like a character in a bad novel, though it's a tall order; "b)" on the other hand... My brain does not work like that. At all. Of course there is always c) The people now clamoring are not ones that did, in fact, choose (they might have still been forced to) to use slack in the first place, but are merely expressing their indignation by stylistically putting themselves in that position to increase emotional involvement. Those are... vacuous...
Absolutely unbelievable but here we are. #Slack by default using messages, files etc for building and training #LLM models, enabled by default and opting out requires a manual email from the workspace owner.
I finished the audiobook edition of Co-Intelligence by Ethan Mollick. It is an excellent overview on how LLMs will likely evolve and be used in business, education, and more generally. The audiobook edition is fantastic. And at only 4.5 hours long. It's not much longer than some podcasts that get released these days! Highly recommended.
The hype and utility about LLMs are overstated and will cause problems due to leadership teams in organisations (and Governments) buying into the hype.
However, they do have value as personal assistants, research assistants, and sounding boards as long as you treat all LLM output critically, especially on topics where you are not an expert.
I’m using Claude 3 Opus as a research assistant. It’s read more of the world’s info than I ever will. I am also trying out ChatGPT-4o.
@ianRobinson Among the commercial ones that are available online, Claude is definitely the best one.
Though I personally run LLMs on my own PC 90% of the time.
@hirad Agreed. I thought about running a local one (or a private Cloud LLM) and loading it with the 1000 or so articles I’ve written over the last decade. I still might.