Tell them that you didn't have a family in the same sense that they do. You moved around a lot of had many different families and didn't find your *real* family until you were older. So, sometimes it's a process for everyone, an adjustment. But that it's getting better.
Then talk to your kids...