I'm having the same problem, even if I try to pull the leet, 2-3 guards follow him. I've died just about twice now, and even being a rogue you cant stealth around all the necromancers (trust me, I tried) lvl 19 aggro's too much. Only solution is to get a group.