Asperger's seems very mild compared to some forms of autism. Better to say you have Asperger's.
Personally, I find that about half the population has some form of social difficulty. In that sense, Asperger's is fairly normal, I think, and so I would tend to avoid too much apologizing. Social...