I’ve installed Ollama on my Gaming Rig (RTX4090 with 128GB ram), M3 MacBook Pro, and M2 MacBook Air. I’m running Open WebUI on my server which can connect to multiple Ollama instances. Open WebUI has it’s own Ollama compatible API which I use for projects. I’ll only boot up my gaming rig if I need to use larger models, otherwise the M3 MacBook Pro can handle most tasks.
That’s 128GB RAM, the GPU has 24GB VRAM. Ollama has gotten pretty smart with resource allocation. Smaller models can fit soley on my VRAM but I can still run larger models on RAM.
I’m running a search instance on a VPS so my home IP isn’t linked to my searches. The main disadvantage is that my VPS is in Toronto and I live 2hrs away so geo searches don’t work very well. For instance, if I Google “restaurants” I get results for local restaurants whereas if I Gregle (I named my search engine Gregle) I get results for results near my VPS.
DM me if you want a link to my instance to check it out. It’s open but I don’t publicize it because bad actors could ruin my IP addresses reputation with spam queries via the API.
This is tough, the goal should be to reduce child abuse. It’s unknown if AI generated CP will increase or reduce child abuse. It will likely encourage some individuals to abuse actual children while for others it may satisfy their urges so they don’t abuse children. Like everything else AI, we won’t know the real impact for many years.
The neck beards that judge someone’s distro choice without knowing their use cases don’t represent the Linux community. Just use the best tool for the job
I use Ubuntu on most of my servers and dual boot my gaming rig with Ubuntu Desktop mainly to host LLMs. I’ve been a Linux user for 25 years, I remember playing around with Red Hat pre 2000. Right now though, I want a solid distro that supports lots of hardware (my network consists of x86, ARM, Oracle Cloud, SBCs, etc), has a large community for support, and isn’t likely to get abandoned. Ubuntu solves that
My daily driver used to be a MacBook Air running Linux. Apple hardware is amazing, I don’t give a shit about the logo on my laptop. I only switched to MacOS for a daily driver when I started working for a company that gave me a MacBook pro so I sold my Air which was just gathering dust.
I’m guessing it’s from dry air god me but even with humidifier I always have to blow my nose a bunch of times in the morning. Sometimes my lungs feel tight for a while after waking up. This happen to anybody else? Why does it happen for you?
I’m an immigrant from Australia and I remember having to change my word choices even though Canada and Australia are nearly culturally identical. It must be a lot more work coming from less culturally similar places.
Train #641 is being introduced starting May 27th, 2024, which departs Ottawa at 4:15, Kingston at 6:15, arriving in Toronto at 8:48am, which would be useful for anyone trying to get into a Toronto downtown office at 9am.
Renting a 3 bedroom house in Toronto is more expensive than a similar house in Belleville + $1500 in monthly VIA Rail tickets. Plus lots of jobs are partly remote which makes the equation even more appealing.
I work remote, live in Belleville, and visit our Toronto offices every couple of months. My experience with VIA Rail has been positive though I appreciate that I have a lot of flexibility. I can work while on the train so the commute isn’t wasted time for me. Working while commuting is not something I could do if I drove or took a bus. The train can be late so I wouldn’t organize an in-person-meeting within an hour of the scheduled arrival.
I agree that the ticketing system should be improved to encourage commuting, it would be a headache to buy tickets individually weeks in advance if I were using the service more frequently.
Fill the drive 100% using data duplicator then delete everything on the drive. Repeat a few times to ensure you scrub all blocks. There is no need to physically destroy the drive.
edit: fair criticism of this approach in cases when the data is unencryptd and the hard drives has bad blocks. I just wanted to give a counter to the destroying hardware approach which isn’t necessary warranted
That’s fair, I can appreciate an attack vector in cases where there are bad blocks and the drive was unencrypted. Luckily bad blocks are less common with modern SSDs and assuming the disk was encrypted, a few bad blocks are unlikely to expose any contents. So knowing the number of bad blocks and what data was stored would inform if a fill and empty approach would be suitable to sanitize the drive.
Algorithmic advertising big tech companies (Meta, Google, Amazon, etc) generate profit at the expense of society. They blindly follow short term algorithms with no regard for their impact on society. We obviously should tax them but we should also make sure our laws enable us to prosecute people who profit by destroying society. Hold them accountable
Any of you have a self-hosted AI "hub"? (e.g. for LLM, stable-diffusion, ...)
I’ve been looking into self-hosting LLMs or stable diffusion models using something like LocalAI and / or Ollama and LibreChat....
Using Google whilst Duck Duck Go is down. How long has Google been this bad?
So ddg is down, so I visit Google. It’s been some years....
FBI Arrests Man For Generating AI Child Sexual Abuse Imagery (www.404media.co)
Slack has been scanning your messages to train its AI models (www.engadget.com)
Using Ubuntu may give off hipster vibes to the average PC user, but within the Linux community its has the opposite effect.
hot take?...
Telegram founder and CEO alledges signal has backdoors, they don't provide reproduceible builds, etc.
Here’s what he said in a post on his telegram channel:...
Who else wakes up and has to blow their nose or clear their airways every morning and why?
I’m guessing it’s from dry air god me but even with humidifier I always have to blow my nose a bunch of times in the morning. Sometimes my lungs feel tight for a while after waking up. This happen to anybody else? Why does it happen for you?
Has anyone here ever tried Linux From Scratch?
cross-posted from: lemmy.ml/post/15150206...
You randomly get a hold of your colleague's phone. It's unlocked. You don't mind being fired. What sounds do you set as his notification and ring tones?
I was thinking of something like the Duff Man theme and slapping sounds and moans, but I feel that Lemmy knows better....
International student’s video on getting free food in Canada unleashes anger and abuse: ‘Please die’ (nationalpost.com)
Mehul Prajapati, an international student in Canada, made a video about using a food bank at school. The vitriol he received was intense
Early bird train between Ottawa and Toronto returns with Kingston stop: Via Rail | Globalnews.ca (globalnews.ca)
Train #641 is being introduced starting May 27th, 2024, which departs Ottawa at 4:15, Kingston at 6:15, arriving in Toronto at 8:48am, which would be useful for anyone trying to get into a Toronto downtown office at 9am.
Pope will attend G7 meeting to discuss AI (www.euronews.com)
How do I wipe a modern SSD to prevent data recovery?
I understand traditional methods don’t work with modern SSD, anyone knows any good way to do it?
Canada to start taxing tech giants in 2024 despite U.S. complaints (www.bnnbloomberg.ca)
What is an interesting fact that you recently discovered?
"Eyes hurt" Google trend in Canada 📈 (trends.google.ca)
Leading the world in technology and ecological transit.. on 3.5" (abc7news.com)