The Swamp Cave is not needed for the main quest. However, apart from some annoying monsters, it is an easy dungeon with no false leads. Care should be taken to reach the bottom, since a mage had died there with lots of good stuff, including a Storm Cloak.
