I tried using Xfce and use it for remote desktop at work because Debian doesn't have a workable LLVM setup yet.
It's a nightmare to configure compared to Gnome 3. There are a hundred little files and changes you need to make all over the system to get anything done. On multiple occasions I find myself mentally reverse engineering various XFCE features to try to figure out how to get things working properly.
It's not terrible, but it's certainly not simple or easy to setup. I put a huge personal investment in time back in the day to get a custom Linux desktop setup how I like that, but I abandoned that approach long ago when Gnome finally got usable around 2.8 series. I suppose if I stuck with editing rc files and such XFCE would be easy, but right now it seems like a huge step backwards.