Well, erotica DOES make me angry, and I can't figure out any other reason why it would. And regular pornography does not.
So my deductions are that it's because with erotica you get to know the characters better, and they're actually more human. But I'm so extremely jealous that I'm frustrated...