The drug wars are far from harmless.
Cannabis would have to be proven, in a far more convincing way, to cause (not just be correlated to) very serious problems in a very large percentage of users to come close to justifying the damage caused by the current laws.
It seems to me that the assumption that it is less harmful than what we have now is warranted.