Yellow paper for security auditing?

I´d like to get into web3, possibly security auditing. I don´t expect to go into client development, which seems to be the branch most often refered to, when discussing the yellow paper.

I´m not very knowledge about what exactly makes a great security auditor, but I could imagine, that the greater your understand, the greater your ability to find/recognize flaws.

Would it be a waste of my time to focus on digesting the math for the yellow paper before diving in to Solidity?