In the end aren't you still going to use rpm to put your fatelf binaries on the filesystem in the right place? Could the rpm format be extended to include more than one arch? You'd put two binaries into the same rpm and only install the right one.
The thing about it is that if you don't add a feature, you can change your mind later and add it. But if you do add a feature, you can't remove it. Looking through this list, in retrospect most of the decisions were the correct ones.
The sad bit is if you end up pissing off a developer. Especially it's sad that Con was upset.