The biggest distraction danger right now is not IVI systems, but people using phones while driving. I'd much rather have people using an interface designed to be used while driving than using their phones.
And you can make the same argument against radio/stereo systems that have been in cars for decades. Distraction is a real danger, but the only way to prevent it is to educate people about how dangerous it is. Taking out IVI systems will not help one whit.