By January 1865, the 4th Illinois Cavalry was disbanded and absorbed into the 12th Illinois Cavalry, which had arrived in Memphis. I'm guessing "Magnolia Grove" refers to the plantation just south of Memphis that now serves as a bed&breakfast?

Sounds like you need to look in the regiments stationed near Memphis in January 1865 for your guy.