I'm curious about how they provide this much memory, will this memory all be on one machine, or does Xen provide a way to somehow give a VM access to memory on multiple physical machines.
Yeah, the whole 34/68GB is all on a single beefy server. There are systems that let you access remote node's memory in a NUMA type system over fast interconnects, but they're _very_ expensive and have horrible latency.
