To yourself? Mostly. Manufacture and possession of restricted substances is illegal, but administration of them to yourself is not illegal. In other words, being high in your own home isn't illegal.

But if you administer them to someone else it could be considered commerce which is under the purview of the government. Even growing corn on your own land to feed to your own pigs is considered commerce according to SCOTUS