If you wanted to store say weapons away from the eyes of international inspectors… a territory would be the place, because if anyone went in there, you could accuse them of invading, and act accordingly.
It benefits the US to leave them a territory.