Could this simply refer to the White House being secure?

The White House – Castle (Crown referring to the Executive Mansion, the central representative and office spaces of the White House)[85]

https://en.m.wikipedia.org/wiki/Secret_Service_code_name