to lose one's influence (on)