This could be he later in life:

1880 United States Federal Census about William T. Downs
Name: William T. Downs
Age: 56
Birth Year: abt 1824
Birthplace: Mississippi
Home in 1880: Beat 2, Wilkinson, Mississippi
Race: White
Gender: Male
Relation to Head of House: Self (Head)
Marital Status: Widower
Father's Birthplace: Kentucky
Mother's Birthplace: Mississippi
Occupation: Planter
Household Members:
Name Age
William T. Downs 56
Ellen A. Downs 18
P. J. Downs 16
Ancestry.com