Castaway Point is a cape located in Brevard County, Florida. It appears on the Melbourne East USGS 7.5-minute topographic quadrangle. The elevation at this location is approximately -0.75 feet (-0.23 m) above sea level. The nearest populated place is Palm Bay, approximately 0.7 miles to the SW.