Joseph A Houston, born Mar 4, 1841; died Nov 2, 1914; Benton County MS.
http://www.findagrave.com/cgi-bin/fg.cgi?page=gr&GSln=Houston&GSfn=J&GSby=1860&GSbyrel=before&GSdyrel=all&GSst=27&GScntry=4&GSob=n&GRid=41080980&df=all&
Age matches the service record. No indication in the service file that this man was ever on roll as a musician.
What is the source of your information? Does not match any U S census record or his military record or his cemetery inscription.