In New York, there are only 3 ways to get off of the ballot once you are the "designated candidate" - legal term:
1) die
2) move to another state
3) run for a judge position
It is likely that Chris Collins will come to grips with his situation and consider these options