Those boot loaders are supposed to perform a check for physical presence. If there's someone right in front of the physical hardware he could already smash it to pieces or install some hardware bug, so why not let him boot an arbitrary kernel?
The kernel can't reasonably perform such checks before letting an user space driver access the graphics hardware (and with it, the entire system).