This is, indeed, a prime example of cluelessness. Even worse, they don't even realize it!
First of all, you are supposed to be releasing good source code as well as binaries, and if cross compilation is so broken, you are supposed to fix it.
Second, even if you are totally lazy and don't want to fix it, YOU CAN WORK AROUND IT.
Again, simply build packages in a full ARM system (either native or running on x86 with qemu-arm), and then replace gcc, as and ld either with a distcc (or other remote) client, or if running in qemu, with native cross-compilers.
Of course, this should only be done if a package fails to build with normal cross compilation.
The idea of running a compile farm on an embedded architecture like ARM is just insane and idiotic.
I mean, if the next architecture you want to support only comes inside a dishwasher, do you purchase a cluster of dishwashers to build the distribution?