Government is not merely systematic violence, it starts as an idea.
The idea is that there needs to be a central power that orders people to interact in a certain way.
The end of government does not come in facing off against the individuals inhabiting it, but cultivating a new idea of liberty to supplant the old.
Instead of government, a free market in protection would solve the many injustices created by having a monopoly managing security.