eleitl

@eleitl@lemmy.ml

This profile is from a federated server and may be incomplete. Browse more on the original instance.

eleitl,

Notice you have to cool both in the power plant and the DC. And these DCs run up to a GW or more.

eleitl,

IBM does 60 deg C watercooling which can be not a lot of thermal delta in nonarctic environments. It’s a lot of km of infrastructure to vent directly if you want to dissipate a nuclear reactor’s worth of power in a single site.

iPad Pro with M4 chip boasts impressive performance jump compared to just-released M3 MacBook Air (9to5mac.com)

On raw performance might, the M4 really does live up to Apple’s promises, should deliver. Single core is up about 20% compared to all M3 chips and more than 40% compared to M2. The generational computational leap from the previous M2 iPad Pro is at least a 42% jump on single-core and multi-core.

eleitl,

You seem to not be using open source software packaged for multiple architectures or which can be built for your binary target. Most people will be just using a browser and an office suite.

eleitl,

No, that captures just the neuroanatomy. Not the properties like density of ion channels, type, value of the synapse and all the things we don’t know yet.

eleitl,

You seem to trust Nvidia. I don’t.

eleitl,

Me, too.

eleitl,

They write

“Of course, AMD is trying to get into the the AI training and inferencing game itself with the Instinct MI300 chip. And that, perhaps, is the main if modest cause for hope. If AMD can gain some traction in that huge market, it will not only be making lots of money, it will be in a position to do a similar thing to Nvidia and push some of that technology across into its gaming GPUs.”

which strikes me as incorrect. AMD MI is pretty widespread in HPC. With margins lower in the consumer market it makes sense to focus on HPC.

eleitl,

There are diminishing returns in semiconductor photolitho. Moore scaling is long over, absolute real estate see WSI with Cerebras, DC costs and power envelope are all sending a clear message. Quantization is there, so you can go from digital multipliers to analog and go spiking networks, but transformers and Co have little power there.

Also, the kind of economy that can carry Gen AI as business model is not a given, long term.

eleitl,

Yes orders of magnitude, but not too many of them. The real estate of a 300 mm wafer is limited, the structure shrink is saturating and you can’t get too many layers. You still need a packet switched network on the wafer even if the rest is mostly analog. Perhaps spintronics can limit the power requirements too.

eleitl,

A free running cellular automaton (CA) approach in hardware would work, but each cell would be a much souped up SRAM cell, the interactions would be all local and 2D. Considering Cerebras is 40 G SRAM on the 300 mm WSI and is about at the cooling limit I’m afraid you do not have 5 orders of magnitude. Perhaps reversible spintronics can help with the power draw, but you still have to splat a higher dimensional network so not just local interactions into a 2D array.

eleitl,

h01-release.storage.googleapis.com/data.html

Make sure you have spare 1400 terabytes.

eleitl,

Sadly, you can’t download the hardware to run models that size.

Need recommandations for a home server

Hey, I’m always searching a home server (already post here lemmy.ml/post/15083947), I was thinking about a Lenovo P500, but maybe the PSU is a bit too special… My budget around $140, will buy used parts and one of the most important thing is the power efficiency (don’t care about the peak wattage but want to stay around...

eleitl,

Factor in power bills and heat and noise into your calculations.

eleitl,

I would look into thin clients and Lenovo etc. tiny PC for office on eBay. I run old low power low noise rackmount Supermicros which are nice but hard to find at low prices.

eleitl,

You could highlight the phrase, and he’ll still fail to get it.

eleitl,

Global Financial Crisis 2 is definitely a fast component in the overall collapse process. Unaccounted consumer debt is a useful facet of a diagnostic. We don’t know where exactly the spark will originate that will blow up GFC2. It could as well start there, though it’s not very probable.

eleitl,

I think we are already at the catabolic collapse stage where the elites are cannibalizing the periphery before the heartland. On the other hand the US has been also being stripped bare in patches for a while. So it is a simultaneous progressive process.

eleitl,

Nicely put. I fully agree with this description.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • JUstTest
  • kavyap
  • DreamBathrooms
  • cubers
  • cisconetworking
  • osvaldo12
  • magazineikmin
  • Youngstown
  • thenastyranch
  • rosin
  • slotface
  • Durango
  • mdbf
  • khanakhh
  • megavids
  • tacticalgear
  • InstantRegret
  • normalnudes
  • modclub
  • ngwrru68w68
  • everett
  • GTA5RPClips
  • ethstaker
  • anitta
  • Leos
  • tester
  • provamag3
  • lostlight
  • All magazines