The U.S. Naval Academy boasts the oldest Navy Museum in the country.