Helen,
I you read the Vicksburg parole carefully, after pledging "not to take up arms" etc., the last line states "until duly exchanged by the proper authorities." At the time, there was an exchange agreement between Union and Confederate forces that allowed properly exchanged prisoners (whether actually in a prison or on parole) to rejoin their unit and "take up arms" again.