You're asking for my personal opinion, so that's all this is. I don't believe men like your ancestors cared one way or another what happened to former slaves after the war as long as they stayed out of their lives. They had destroyed Southern poliical power by ending slavery, and that was that as far as they were concerned. To be fair, I don't believe most American veterans from WWII cared what happened to Japan after the war, either.