why do you need 128G Ram by the way?
Two main use cases: One is to run large language models (very slowly) on data that I can’t share, at least not without a huge amount of paperwork, even to a secure online API. These are mostly non-interactive proof-of-concept rating tasks where I don’t care if it takes a whole weekend. The second case is really huge CSV files. The more RAM I have, the less time I have to spend coming up with strategies to process these files piecewise, which is sometimes not trivial given dependencies between rows of data.
2 Likes
Sounds like you need to set up a proper database, bud. 
1 Like
Personally I’m only on 96GB but FWIW my absurd-ram use case is one of the programs that I wrote generates tens of gigabytes of traces per run. Having a pile of ram means I can have those traces go to a local memory-only Jaeger instance instead of wearing down my SSD by writing terabytes of traces per day.
1 Like
I feel you. I worked not so long ago on a python project basically parsinga few hundreds thousand spreadsheets and then putting that info into a database. The process was using around 45GB of RAM. Some optimization could probably bring it down but I spent a lot less time coding and the job was finished relatively quickly. Everything is a cost/performance relationship.
2 Likes
my vm usage only lets me justify up to a bit under 64g. i went to 96g because i could, and no other reason.
i was already spending a bunch of money on the machine, the price differential for the 2x48 kit over 2x32 was a minor note in comparison.
2 Likes
Is a reason needed? Is “because I can” not enough of a reason? 
I run virtual machines and don’t want to have to worry about running out of ram. But aside from that I just like to max things out.
2 Likes