In the fall of 1848, Captain Justice Bailey discovered the harbor that was to bear his name as he searched for a safe mooring during a violent storm on Lake Michigan. The storm was so severe that he risked entering an uncharted harbor; luckily, he found it to be of sufficient depth. He remained overnight and decided to explore the next day. He found an abundance of limestone and timber, and he took back samples to his employer, Milwaukee businessman Alanson Sweet. Mr. Sweet envisioned great business opportunities for the new area.