Because of the inconsistency, it took me a while to figure out it was shrimp causing the problem. I try them every few months and it's a coin toss as to whether or not I'll break out. I keep Benadryl on hand for it.
My dad had a similar problem a while back. It eventually stopped happening, so I'm hoping it'll go away for me as well.