Well, literally it seems to say "yeah, I know that I tend to overdramatise things and sometimes make offensive comments, but don't hate me for it, I don't really mean it. Or maybe just a little". The Joan of Arc figure corresponds to his public image - a sexually ambiguous celibate (and, um, catholic). The walkman/hearing aid seems to refer to her communicating with angels, and it also serves to further blur the distinction between him and her by relating the medieval character to modern technology. And he says that unlike her, he doesn't want to get burned at stake for the things he says, but he knows that it's gonna happen anyway, because, well, he feels too different. And, um, I don't really find any deeper meaning to this song. But I mean, I guess we all feel this way sometimes. Well, I do.