@astrid@exa ah i see! i need to re-calibrate my sense of scale, 'cos i still think of 4GB as a lot of memory. it's not the first time i've heard of computers with >100GB memory but it's still so far from anything i've worked with.
@typeswitch@exa its really common to have servers running >100gb these days. in fact i bought used 2 servers that came with that much preinstalled for only $200 each
@astrid@exa wow, ok. i just searched around and found someone selling a used server with 128gb for around 450 euros. i should see what i can get my hands on. thanks for opening my eyes to this possibility : )
@typeswitch yeah, IMO kinda usual style of processing stuff in the applied data sciences. Just load a matrix. I see this in bioinformatics mostly, but no illusions about other areas being much better....
Generally the accepted way of doing stuff is not to optimize until they hit some hard allocation limit, and then they optimize the data against the maximum possible allocation size because they're typically not the kind of programmer who'd know how memory allocation works.
Add comment