Most of the caravan organizers left the caravan once they got close to the border.
Only a few were needed to get to where they are now.
These are the ones that started the caravan, once they hand it off to others farther down the road, they gotta get home.
They were no longer needed when it started breaking up