I found it annoying as well.  It makes it look like the entrance is on the side you come from, so you try climbing and finding the right path while having to fight endless annoying creatures, but you do get some decent quests once you finally find the place.