Yes, I believe you are right. I was actually thinking of the broader definition of Von Neumann vs. Turing Machine rather than the more specific case of Von Neumann vs. Harvard. In other words, a system with a CPU, registers, and random-access memory.
Somewhere in this video he claims that there are only two foundational languages, C and Lisp, and I think that nails it pretty well. I'm sure there are people who would take umbrage with that claim.