Spencer is a town in Van Buren County, Tennessee, United States. The population was 1,683 as of the 2010 census. It is the county seat of Van Buren County. It is home to Fall Creek Falls State Park. Spencer is named after Thomas Sharp Spencer, a long hunter who passed through the Van Buren County area in the mid-18th century. The town was establishe…Spencer is a town in Van Buren County, Tennessee, United States. The population was 1,683 as of the 2010 census. It is the county seat of Van Buren County. It is home to Fall Creek Falls State Park. Spencer is named after Thomas Sharp Spencer, a long hunter who passed through the Van Buren County area in the mid-18th century. The town was established in 1850 and incorporated in 1909.