This is the map of Tortuga.
Her ladyship's mansion was on the hilltop just behind the church above the two ships in the harbor just to the right of the center. The Bremen "docked" near the white houses on the left near the open stretch of beach.
(This image is of Bergen, Norway, drawn by Hieromymus Scholeus about 1580. I got it from the wikipedia entry for Bergen. It was used without permission and modified.)