In what utopian world is a government not violent? That is after all, a very defining characteristic of a government, it is violent. Take that characteristic away and, it will cease to be a government, it will be nothing more than a committee, a steering group, a club.
Perhaps you have this perception because people are so unbelievably overwhelmed by the force of government, that they usually do what ever it takes to comply with it, to avoid the utterly complete and overwhelming threat of violence the government holds over their heads daily? In other words, a well controlled mafia neighborhood where no one dares to confront them, may seem less violent on the surface, than one where a new gang is attempting to takeover power by scaring people into submission. But I would hardly claim that perception to be an accurate assessment of the relative violence of the mafia.
Living with successful extortion (living in compliance to a real threat of violence to avoid it) is still living with violence.