That's my understanding as well.
HOWEVER, when a doctor refers you, say, to a specialist for treatment, I believe there can be communication without specific permission. (This might be covered in the form one signs when one starts out with a doctor.)
In my case, and with my mother, I know...