Well put. When I first started using Linux I tried several binary distros but I kept finding myself attempting to compile mplayer from source and installing gcc prereleases. After a few Linux From Scratch installs I realized I would never be able to maintain an entire distro on my own and still have time for extracurricular activities like sleeping. So I switched to Gentoo, where I can focus my attention on what interests me and leave the rest to be managed by someone else who knows a lot more about those areas.
Gentoo is a distro for the obsessive compulsive. Most people don't get it, and they never will, and that's fine.