Just before you get to the Fortress part of the game, press pause. Unpause the game right after that, but instead of having to fight the Fortress, you'll be able to just move right past.