That's possible, and I know that if you're not used to pushing back against authority figures (which doctors are typically viewed as for obvious reasons), it's easy to just take what they say as an absolute rather than advisement.

Even so, I don't agree with it as a recommendation, let alone an outright refusal.