In this context real-time means e.g. applying sound effects to music while it is played on an instrument in a band. You don't want to add a delay effect to everything, the sound has to mix correctly with the other instruments and what you hear directly from the same instrument. Everything above 30ms or so for the complete signal way is noticable. As I understand it, latency is the main drawback of digital effects compared to analog effects.