The Granville Cemetery Association was organized in February 1881. Incorporators included Civil War veteran Adin H. Potter, formerly of Granville, New York, who deeded the land. He was one of the few Union soldiers to escape from Andersonville (Georgia) Prison during the war.
The earliest marked grave dates from 1880. Many interments were infants and children, including Edith, daughter of Adin and Diana Potter, who died February 18, 1881. Francis H. Baker is the only known Civil War veteran buried here.