The explosives -- considered powerful enough to demolish buildings or detonate nuclear warheads -- were under IAEA control until the U.S.-led invasion of Iraq in March 2003. IAEA workers left the country before the fighting began.
---
So apparently the IAEA had them up until they had to leave because of the invasion in March 2003.
Seems there should have been some sort of handoff there.