...are you in a "good" relationship with "his" family...? (His mother, His Father, brothers, sisters etc...?) If you are... go to them for informational help and show them the situation you're in with "his" children..."their" Grandchildren... !) Be "tactful" but firm...