This "lost gold" story, by the way, is told in almost every town across central and southern Georgia. Many folks around Albany are convinced it is buried on a plantation there.
I don't think there is much to the story, although Union cavalry did spent quite a bit of time looking for Confederate gold in Georgia and North Florida at the time Jefferson Davis was trying to escape through the state.