One card says he was received at Ship Island April 15, 1865.
Another card lists him as:
Roll of Prisoners of War transferred from Ship Island, Miss to Vicksburg, Miss, May 1, 1865
(Not dated)

I'm sure you noticed that he was also captured at Vicksburg on July 4, 1863 and paroled.
The roll for May-June 1864 states he was Absent without leave from Aug 23, Dec 10, 1863. I think this covered the time they were in exchange camp waiting for their paroles. Some of the local boys got home-sick and skipped out.
Then he was back in Parole camp in the roll for March & April 1864.

I found this bit of info under Miscellaneous file. It may NOT be your soldier.
Card for J. A. Wynn, Pvt of Co. F, 1st Detachment Paroled Prisoners, Demopolis, Ala. for Aprl 30, 1864, stating: Absent without leave since Feb 11, 1864.