Patterson Gap is a gap located in Rabun County, Georgia. It appears on the Dillard USGS 7.5-minute topographic quadrangle. The elevation at this location is approximately 3,309.05 feet (1,008.60 m) above sea level. The nearest populated place is Kilby Mill, approximately 1.6 miles to the SSW.