The circle is straight East of where it says CoT on your map. Just go into Lost Rigger Cove and find your way to that spot, its inland by the side of the mountain.  I killed him with no prob (53 balance druid), but like everyone else said, you dont have to, just have to unpack everything first and then summon him and quest is done.
However, the silvery claws and heart thing are still in my bag, are they still needed? or should I just trash them?