Why would ICE storm the castles? Putting the castles on alert would either cause illegal residents to dig in or would force migration out of the city strongholds.

Watch where the illegals migrate to. When the plan to raid cities are publicly put on hold, people relax a bit and raids can commence on outlying boltholes.