He may have been on the muster roll under the name Solomon:
Solomon, Joseph----- private April 29, 1861. Wounded at Chancellorsville, Va. May 3, 1863. On detached service
in Augusta, Ga., unfit for field duty, December 16, 1864. No later record. Returned to Germany after war.
This company, known as the "Toombs Volunteers, " was enrolled at Calhoun, Gordon County, Ga. and left that
place April 29, 1861; arrived at Augusta, Ga. April 30, 1861. Mustered into C. S. A. May 1, 1861. Left for
Portsmouth, Va. May 5, 1861, and arrived there May 7, 1861.
http://files.usgwarchives.net/ga/gordon/military/civilwar/rosters/4thcof.txt