It is pretty much unacceptable to have a domain bouncing emails, so I’d be out of the provider before the MX TTL even expires.
For outgoing emails, reputation is a huge issue, but at the same time it’s also fairly trivial to set up a (different) 3rd-party (gmail, outlook, sendgrid, whatever) with previous reputation so you can get back communicating.
Yeah, no that's not how it works with email. You have to build reputation for weeks or receivers throttle you.