Some of the things that I most loved to do with my grandmothers: Listen to family stories, look at family pictures, take care of the garden and cook.
I don't know if this is available where you live, but museums are wonderful places to visit with kids of any age.
Best of luck to you, dear...