I'm not experiencing that, but I vaguely recall running into the problem before on gnome-terminal, indicating that it may be something with VTE or the shell. Sorry that I can't remember what the fix was for me.
As a work around, at least, just remember that nothing in the world forces you to use XFCE's terminal when inside XFCE. If GNOME is still installed on your system, try gnome-terminal. Or one of the many other terminal emulators available.
(As an aside, it's always kinda irritated me that the Linux desktops not only have their own idea of a desktop but also keep infinitely rewriting all of the other apps that work just fine; why does every single desktop need its own web browser, terminal emulator, mail program, etc.? Trying to make a single meta-project that handles both the UI for managing my applications/data and the applications themselves just muddies the water and splits resources with little benefit... all the desktop-specific browsers suck compared to Firefox/Chrome anyway :p )