There is no Divine Creator on one side, and People on the other. You can't be seperated from God. There is no separation, only the illusion of it. Its that deterministic worldview that keeps the majority asleep.
Understanding that you must let things go will set your karma free. You are the only one who can impose karma or anything else upon yourself. No one punishes, and no one is judging you, only you. There is no harder judge than yourself.