That's true. I have never heard of anyone claiming that providing a proprietary manual along with code licensed under the GPL violated the GPL. So what you say makes sense.
On the other hand, I have heard people claim that distributing (modified) code licensed under the GPL with comments stripped out is a violation. So we are in murky waters.