Going after the blocks

How does he know to wait till I'm done with the tower before knocking it down? Endless hours of fun :-)