From the Lee Family History there is no connection between the Lee Family and the Stafford Family. The common misunderstanding of a relationship stems from the Lee Family ancestrial home of "Stafford Hall". This house was built by Thomas Lee, acting royal Governor of Virginia 1750 and was named Stafford Hall after his Grandfathers Richard Henry Lee's (1613-1664) estate at Stafford-Langton England.

Richard Henry Lee was the Secretary of King Charles I Privy Council and may have suffered loss of this estate during the English Civil War.