OpticalMoose

OpticalMoose, 1 day ago

Awesome. I’d heard that Pat was one of Redd’s old friends from the “Chitlin’ Circuit” era of comedy, but I’ve never actually seen him do standup.

OpticalMoose, 1 day ago

Probably better to ask on !localllama. Ollama should be able to give you a decent LLM, and RAG (Retrieval Augmented Generation) will let it reference your dataset.

The only issue is that you asked for a smart model, which usually means a larger one, plus the RAG portion consumes even more memory, which may be more than a typical laptop can handle. Smaller models have a higher tendency to hallucinate - produce incorrect answers.

Short answer - yes, you can do it. It’s just a matter of how much RAM you have available and how long you’re willing to wait for an answer.

OpticalMoose, 4 days ago

One thing I love about usenet is that it’s great if you’re just looking for one episode, song, etc and don’t want to download a whole collection.

OpticalMoose, 5 days ago

Why replace torrents? Why not use both? It’s a bonus if your usenet provider includes a VPN.

OpticalMoose, 9 days ago (edited 4 days ago)

I think it’s because architecture-wise, these are more in line with the 8000 series. The 7500F is a full featured Ryzen 7000, but with broken graphics. These are basically 8000 series APUs, so they have the lower PCIe version, lower cache and fewer PCIe lanes, and broken graphics.

I suspect the price will come down soon because no one should be buying these at this price. The 8400F is only $10 less than a full 8500G.
Edit: I just saw that the 8400F is a six-core, so maybe that helps justify the price.

OpticalMoose, 9 days ago

This is why I want Intel Arc to succeed, because maybe it’ll make AMD take Radeon more seriously. It’s been a steady decline since the ATI days (2006)

https://discuss.tchncs.de/pictrs/image/0a54a224-3cd1-40ba-96c4-3147de40cac6.pngSource

I love my Ryzen though.

OpticalMoose, 10 days ago

I think it’s a decent metric. The important thing to know is that no single guide is going to work for everyone, everyone has to adjust it to their situation.

Me, for example, I have a 401K balance of zero. Every time I leave a job, I roll that over into my IRA, then into my Roth. I just like having control over my accounts; 401Ks have too many restrictions. But to each his own.

OpticalMoose, 7 days ago

Awesome. I never heard of Kino Lorber before they announced Monk on Blu-Ray, but now I’m a fan.

OpticalMoose, 8 days ago

Yep, I had been hoping for the same thing.

Also, to @projectmoon, you might want to wait and see what gets announced at Computex next month. Hopefully they announce some new stuff and the current gen prices drop.

OpticalMoose, 8 days ago

Ollama doesn’t currently support mixing CUDA & ROCm. github.com/ollama/ollama/issues/3723#issuecomment…

One thing to keep in mind about adding RAM your speed could drop depending on how many slots you populate. For me, I have a 5700G and with 2x16Gb, it runs at 3200Mhz, but with 4x16Gb(same exact product), it only runs at 1800Mhz. In my case, RAM speed has a huge effect on tokens/sec, if I have a model that has to use some RAM.

You can check AMD’s spec page for your processor, but they don’t really document a lot of this stuff.

OpticalMoose, 17 days ago

Did they give up on trying to put X3D into laptops?

OpticalMoose, 13 days ago

I think 5 is what I’m looking for. Sometimes Civ (in general) gets out of hand with the micromanagement. I want something that’s kind of casual.

OpticalMoose, 13 days ago

I’ve been looking to try Civ 5 or 6, but haven’t decided which one yet.

OpticalMoose, 21 days ago

That would be nice. And maybe a bridge for sharing memory between cards, since Nvidia got rid of theirs.

I’d love a 24Gb card, less than 270mm, without the cursed power connector.

OpticalMoose, 21 days ago

Is this the generation where they’re only making mid-range and lower cards?

OpticalMoose, 19 days ago

It’s wired. Sorry, I should have mentioned that.

OpticalMoose, 29 days ago

In Linux, I used Input Remapper github.com/sezanzeb/input-remapper to configure my Microsoft mouse buttons. I never tried it with a virtual machine, so I’m not sure about that.

And yes, forward and back were really annoying settings for it.