You can use it as an iPod! Certainly!
If you have an AT&T account and you put your active sim card (with service to it) in an iPhone, yes AT&T will apply a data charge. If you have an inactive sim, or no sim, you can use it without charge. So if it says "no service,". Or "no sim" in the top left, then you are all set! Enjoy!