"Crazy Batou is not really essential, but he is marked so by the game. There is no reason not to kill him, and good reason to do so, as he is wearing a valuable artifact on his head."
http://www.uesp.net/wiki/Morrowind:Essential_NPCs