Pulling 16 DIMMs Out of a $250K DRAM GPU Server [5WMpmSrwHuj]
DRAM prices are brutal, so we're testing KV cache offload on a Dell PowerEdge XE7740 with four RTX Pro 6000 Server Edition cards. The plan: move KV cache onto eight Solidigm D7-PS1030 high endurance SSDs in RAID 10, then remove 16 DIMMs (all B-slot sticks) to keep every channel populated at full speed with half the RAM. We measure the performance delta against a full-DRAM baseline. #KVcache #PowerEdge #GPUservers