I'd say that patient history covers all the relevant facts that pertain to a patients history, including upbringing, any social issues or psychological/psychiatric history. Physical history sounds as if it would refer to any history of physical illness, i.e. infections, new growths, metabolic disorders and the like.
I wouldn't use terms like handicapped and disabled because they carry a stigma and some people may consider them insulting. Even impaired might carry a negative message but less so than the other two word.