So you hold that the baddies are from the past/future. I don't doubt that they muck about with time, but I prefer to view them as part of the 1/3 of angels who rebelled and were cast out of heaven. Now they send "hit teams" to various planets by whatever means they can find.