Patterson Island is a island located in Grant County, Wisconsin. It appears on the Boscobel USGS 7.5-minute topographic quadrangle. The elevation at this location is approximately 652.30 feet (198.82 m) above sea level. The nearest populated place is Westport, approximately 2.7 miles to the NNE.