Where I live, party leaders can be replaced quickly. Often, the party apparatus/MPs/members (depending on the party’s internal rules) change the PM, & no one can stop them.
It can work
My US homeland has a different constitutional & political system. Replacing Biden now isn’t a plausible option.