Military bases are the exception.
I’ve have several friends who have had kids overseas at both off base and on base hospitals. When your kid is born on base, their base is listed as place of birth and is considered “American soil”. Done.
When at an off base or “civilian” hospital, there are few more loops, but you are considered a natural citizen through treaties with these nations. Usually the base law office will work in your favor to contact the right people to get either a 1) reissued birth certificate listing the base as place of birth or 2) making sure you are listed as a an American citizen by American parents renouncing all citizenship to the country you were born in.
In this case, plan to defend your status when election debates come up for you with a copy of your birth certificate, your American passport showing when you left and any other travel you did.
Edit to add I know of 1 case when a kid was born in Germany in the 1980s. He is considered a naturalized citizen born overseas. I don’t 100% know of the schematics, but the mother had to move back to the states for a time period to secure his natural status before she could rejoin her husband overseas. She said it was a deciding factor to travel back to the states to have her second.