Actually... I think I found it. Digging a little deeper in the manual it says "Double-sided (16x)
RAM modules are not supported due to chipset limitations."
That explains why only two modules (32x total) will work at only one time, and adding any more the the already 32x crashes the system.
Wish I'd read that earlier...