Ok, if it was set, it would give you two options:
Change Password
Remove Password
At least that's what it does on mine, and it would make sense.
So yeah, it sounds like that's not your problem... The only other thing I would suggest, is using a different card reader and seeing if it makes any...