Carry laws vary from state to state and specifics are determined by each state.
As regards your right to carry a weapon when you are off-duty, I can guarantee you that you it will not do you any good when you appear before the judge and say "Well, someone on Yahoo Answers told me that I could."...