I often grab at my ears and twist them when I worry or stress. Could anything happen?

[Tippy]

When doing this I pull the helix of the ears towards the lobules when I'm freaked out or stressed. Is something going to eventually happen?