I would not have invited her in - a simple ''Its 10pm at night, Carter is in bed, and thats where I am now going'' would have been sufficient.
I would have called her in the morning setting rules such as, no visits after 7pm (especially unannounced), always clear visits with me a day in advance...