Of course you can cancel it. Or you can cancel just the debt owned by foreigners. It may not be wise in terms of future dealings, but on the other hand, look what happened in South America in the 80s. Cancel the debt, and everyone comes running to loan them more since they have a clean balance sheet.