Am I a pervert?

Somebody close to me described me as a pervert yesterday. I asked why. He said something about me constantly wanting to see guys naked and preferably performing in front of me. I asked what was perverted about that. After all didn't he like the same thing? The answer was yes of course but that he kept his desires to himself and his 5000 myspace friends. Twat.