"You may as well decree that all texts are the same. Law and science, prose and verses, patents and computer programs - they all use the same 26 letters and occasional punctuation and few foreign words. There are no difference between them (except in degree)!
You're hiding. You're driving your opponent's argument into a reductio ad absurdum while hoping no one notices that for your own argument the road to absurdum is the briefest of brief, straight shots.
For the one-click patent, no part and no combination of parts exists at a level which is not purely abstract. It's not about single clicks. It's not about clicks at all. It's about a unitary intention emanating from the user.
It doesn't require mice. It doesn't require a specific input device at all. It's about any human computer interface device which transmits a humans intention to the computer whatsoever.
It's about the abstract resulting end state of a set of abstract entities irrespective of the individual steps through which that ends state was achieved or what the embodiment of the abstract entities are.