You can't, have to end combat. It could be fixed by making the characters check for the leader's position on worldmap after leaving, if he's on the same spot, then you join the party. If you need a fast solution to that problem, get 2 radios and send signals.