Almost everything else in this game has a trade off
But why have long term negative effect? The negative effect is that they need to be farmed. Who cares that they are drugs and drugs are bad mkkay and so on. They are just gear in the end. Wearing a combat armor doesn't give any negative effects either.
I'm completely open to suggestions, I just don't like the idea of only benefits, and no drawbacks whatsoever.