$comic[$comictype;][$pubdate;]['title'] = "Never Give Them Your Real Name." etc.
Note that I don't pretend that this is the real way to use a variable as a key -- I haven't reached that lesson yet. That's just me trying to describe it.
That is actually the right way, minus the extra ";" characters you have in there.
The only thing I really have to add has nothing to do with arrays. In PHP you should get in the habit of using ' rather then " unless you need double quotes. It takes a small but not totally ignorable amount of extra procssing power to handle double quotes, becaue there are more things PHP has to scan for in the string.
Jay
I could also say something about PHP arrays actually being maps, since arrays by definition have only a numeric index. But that is a point so pedantic that even among programming geeks few care.