Windmill Cove is a bay located in Worcester County, Maryland. It appears on the Public Landing USGS 7.5-minute topographic quadrangle. The elevation at this location is approximately 0.00 feet (0.00 m) above sea level. The nearest populated place is Harmon Landing, approximately 0.3 miles to the WSW.