If you drop (ab*) the quest, the questitem will still be in your bags.

If you are level 70, it is safe to delete the item. True Story.