Q, if the Fed is only to be restructured, what is to stop it from being usurped by evil after all of us are gone?

Wouldn't it be best to abolish it entirely, let the people decide what is used as money, i.e. gold, or bitcoin, and amend the constitution to ban any and all federal power over the nation's money supply?