Potter is a village in Calumet County in the U.S. state of Wisconsin. The population was 244 at the 2020 census. Potter was established near a Native American village along the Manitowoc River. It was originally named Muskratville because of the large number of muskrats that lived in the river and were trapped for their fur. American Civil War Captain O…Potter is a village in Calumet County in the U.S. state of Wisconsin. The population was 244 at the 2020 census. Potter was established near a Native American village along the Manitowoc River. It was originally named Muskratville because of the large number of muskrats that lived in the river and were trapped for their fur. American Civil War Captain Orin R. Potter settled in Potter in 1859 and established a feed mill. That same year he renamed the village Potter Mills, which was later shortened to Potter.