Is The Misc necessary for a civilized society?

If we remove The Misc as our anchor in society which tells us what is right and what is wrong, if morality hasn't been given to us from above but rather we've arrived at it from below through reps and negs, wouldn't that mean that eventually every form of degeneracy will be acceptable? What's keeping us fixed at a certain understanding of morality without The Misc?