Many have estimated the total number of the Confederate army at about 1,000,000.
If that's true, then the total number of servants should be in the 40,000-50,000 range.