I think it all comes down to an old joke from George Carlin, I believe:
“The definition of a pervert is anybody who is 5% kinkier than you are.”
It fits with his joke about “Did you ever notice that when you are driving down the freeway, anybody who is driving 10 MPH slower than you is an idiot, and anybody going 10 MPH faster than you are is a maniac?”