Oh yes, fruit puree is great but maybe room temp might be better. But if the weather is extremely hot like where I live I'm sure your baby would enjoy tiny spoonfuls of cold puree.
If you think it's too cold then warm it slightly, to room temp. I did hear that you can't give babies stuff that is too cold because it'll hurt their tummies. room temp-warm is good.