Does sleeping on your face affect the way it looks?

[giveadvicegetadvice]

I sleep on my face every night and one side is fatter/bigger than the other.
I was wondering if they correlate in anyway, or if it has any effect.