It’s a defense mechanism. When you think about the amount of things they would have to learn and change their mind on, and then weigh those against “do whats easy”, it’s not surprising people change their minds less as they age.

Fudge specifically says how terrible it would be to upset the order and calm that has been built in Voldemorts absence. Keeping his safe place is his priority.