Don't feel bad. That is similar to us (only I was the one with double the family who lived locally).
Its not going to look bad, think of it like this "the more the merrier" :) And really no one is going to notice, if you want it to look more even during the ceremony you could just not have...