If you thought that was a good summary, we're totally failing to communicate.
The enemies of the Free Software movement are those who actually deny users' the freedoms they deserve. Linus doesn't do that. He just helps and supports others do that. He's not an oppressor, just an accomplice.
Where he is, between a naïve accomplice who honestly believes to be doing no harm and someone who actively benefits from others' misery, is not for me to tell or assess, but if he hadn't taken this stance, maybe, just maybe, vendors would have kept on contributing source code for the firmware they wanted to add to Linux, just like they did back in 1995, and we'd all be much better off.
And, even if vendors didn't, I wouldn't like to be someone who succeeded at the expense of others' freedoms, and I wish Linus wouldn't either.