Spencer is the son of James and Margaret Dutton, two homesteaders making a living in Montana after they left a life of poverty behind in Tennessee to look for a better future. Spencer and his siblings are at the basis of a long family line. For generations his family fought to expand and protect the land they made on their own.