I'm wrong about matching E A Carter with A A Carter/

The record for A A Castro of this regiment probably matches that of A A Carter.

However E A (Ellis) Carter is a different man. He died in Montgomery AL in the 1880s and is buried in Oakwood Cemetery. His widow Savannah later filed for a pension application in his name. Your A A Carter moved to Texas and died there in 1905.