>Well, that's one way of saying it. Another way is to say that if you do care about users then GPLv3 is not for you. If you do care only about software freedom (and it does not matter for you if users will ever see or care about your software) then yes, GPLv3 is your best bet.
Come now, "user's freedom" is precisely what the GPL was written to ensure. Users, by definition, are those that use the code. Those who don't use the code, aren't users, and are irrelevant in this equation.
Now, encouraging folks to use that code is another matter entirely, but that is precisely their choice to make.