He was forced to abandon his children to ensure his history doesn't effect them. He had to leave since uncertain that his children can survive with him getting into the line of fire.