Once you have an effective AQM (e.g. CoDel), the buffer length no longer makes much of a difference, to first order. Second order, it gets more subtle.
You certainly don't want to artificially under buffer; that can have serious performance consequences.