It puts the castle in a really difficult position. I bet they don't want them there as much as we don't want them looking after him.

[ For various reasons. But deciding to move him would be so much worse... ]

If some people outside got wind of this, they'd be in huge trouble. [ And they, as the sage and sage's wizards, would probably have to intervene. ]