The mischief began 40 years ago in the case Griswold v. Connecticut, when the Court struck down a prohibition on contraceptives on the basis of a "right to marital privacy." The bit about "marital" was quickly dropped, and the new discovery became a general right to privacy.
In Griswold, the Court suggested the right might be found in the First, Third, Fourth, Fifth and/or Ninth Amendments. In other words, it must be there somewhere, anywhere. But since the right to privacy is nowhere mentioned, the Court had to contend that it resides in "penumbras formed by emanations." In layman's terms, that means in partial shadows formed by emissions, which it doesn't take a constitutional scholar to conclude sounds pretty vaporous.
If Connecticut's contraceptive law was outdated and purposeless, the answer was simple: for voters to overturn it. Both the dissenters in the case, Justices Hugo Black and Potter Stewart noted that they opposed the Connecticut policy, but that didn't make it unconstitutional.