The way to Wayland: Preparing for life After X

You're definitely doing something wrong. I've run my whole desktop over ssh over a 100Mbit LAN in the past, and while it's not instantaneous it's very fast. The only thing that shows slowdowns is stuff like video playback which is limited by raw bandwidth.

X is really rather good over LANs. It's latency that kills it.