

Do you really need 64gb though? Do you want a PCIe in a low wattage, low air circulation mini PC? Are you running a docker swarm of VMs within the same system? Why?
What’s your use case for this?
You won’t get Local LLMs if the PSU is minuscule. Best get a big old workstation with good cooling. Fried motherboards overloading them with local LLMs. That stuff is mean on hardware.
Yeah, that’s the neat part about servers, they don’t necessarily need to be snappy. Most of what it does is background work and it doesn’t have anything else to do. DDR3 and DDR4 get the job done just as well, and save you a buck.
My NAS has 16gb of ddr3 ecc, it has 10tb of ZFS pools and it runs an embedded OS. No problems with that. Not going to use it to host Gitlab lol, but it gets the job done for what it has to do.