Believe he earlier served with the 1st Louisiana Cavalry Battalion, State Guard which was organized March, 1863.

……..

E. J. Hall, Captain and A. Q. M., 1st Regiment Louisiana Cavalry, (1st Lieutenant and AQM, 1st Battalion Vol. Cavalry, signed a forage requisition for Public Animals, two horses and 15 mules for September 15-30, 1863, at Little River[?sp?])**, captured near Natchez December 10, 1863, forwarded from Vicksburg, Miss. to Cairo, Ill, December 18, arrived Camp Morton, Indianapolis, Ind., not dated, transferred to Camp Chase, Ohio, January 27, 1864, forwarded to Ft. Delaware, Del. March 25, 1864, forwarded to Hilton Head, S. C. August 20, received at Fort Pulaski, Ga., not dated, sent to Hilton Head for exchanged October 28, exchanged November 3 on the Savannah River, opposite Oakley, Ga.

…

** [looks like Hall], Elisha J., A. Q. M., 1st Battalion Louisiana State Guard Cavalry, promoted Captain November 11, 1863, no other records.
[Information from F & S Unit Information section, Surname papered over, but appears to be Hall]

[1st LA Cavalry Battalion, State Guard, Organized: Shreveport, LA on March 1, 1863, mustered into state service at Shreveport on June 12, 1863, transferred to Confederate service on March 10, 1864]

M320: Compiled Service Records of Confederate Soldiers Who Served in Organizations from the State of Louisiana