Question about passphrases

I have good experience with bitcoin, but there's one question I still have:

To passphrase, or not to passphrase? While it adds some security to the device, I worry that it might make things challenging to recover if I need to do a wallet restoration.

Also, I'm married and want my wife to be able to use/recover the device should I be incapacitated. I currently think of passphrases as a possible complication for only marginal security increases.

What do you think?