In my own experience, this has been accurate. The only exception was when I went to live for a brief period in a Muslim majority country. I was super into working out and martial arts which made me fit in well and I fit the criteria of a desirable person, while at the same time im also not very good with the opposite sex so they all viewed me as like "the good westerner" compared to the sex obsessed freaks they imagine all non-muslims to be