I wonder if Father Herman is a misprint. This found in Sadlier's Catholic Directory for 1884 (e-book on line):

"Tuscumbia, Colbert Co., Our Lady of the Sacred Heart, Rev. Benedictine Fathers. Rev. Athanasius Hintenach, O.S.B., superior, and Rev. Henry, O.S.B."

"Col." Kelly was a corporal in Co. F, 16th Alabama Inf. So I checked the roster of officers for the 16th Alabama Inf. Chaplains named are A.L. Hamilton and
F.A. Kimball. There is no record of a man with the last name Herman or Henry in the regiment, so their connection may not have had anything to do with the war. Or, Herman or Henry might be a first name.