You got that right, I'm level 16 warrior and even when I kill all the others to face that level 11 guy alone he's won every time.  Guess you just gotta get better weapons/armour and come back.