Dont get me wrong, but don't we want the price to go down?

I proudly hold a hefty bag of ETH and obviously want the price to go up. But as far as utility, isn't the price going up a bad thing? People complain about gas prices all the time, but isn't that because 0.02 ETH is like $50 or something? if 1 ETH was $100 the fee would still be the same (as far as I understand it, same transaction = same fee) but only be $2

My numbers aren't exact, and I know I don't have everything correct, but I couldn't really find a good answer to this question so I would love to hear the technical communities opinion!