Here is where things become hazy. The Contract Clause in the Constitution allows people to make contracts with government. A contract or agreement changes the rights of both government and the person contracting. Government can only go by what is written in the contract (like the Social Security agreement in the Form SS-4). Nobody reads all the thing that attach to their signing up with Social Security. But the government does, and the government can only go by what is written, not by what people think they mean when the sign up. So, it is people unintentionally signing away some of their rights... or maybe all of them, when they sign government paperwork. When a person realizes, later, that he has lost some rights, the courts may side with him, or they may side against him.