Meghan and his children may eventually join him on the rest of the trip outside London, the source said.