A good point to consider would be why would he desert, not once, but twice.
It appears according to Bryan's post that Ballard's heart was not in the war and he was not alone.
It would appear in my thoughts that he had no choice except to join the 4th but running
off was not a smart move especially from the Yankees. They frowned on that.
You truly need to check the oral history of your family and see what they say.
In regard to my Guthrie who deserted and then joined the Union Cav., I have to say
his descendants were not happy to learn that fact and that was the last I ever heard from them.
Truth is truth and this was a long time back so I would encourage you not to be judgemental
of Ballard and there is no way you could ever walk in his shoes or understand.
Good luck.