Couldn't find much either, you may already have this :

James W. Riley

Residence Prince William County VA;
Enlisted on 10/11/1862 at Winchester, VA as a Private.

On 10/11/1862 he mustered into "A" Co. VA 39th Battn Cavalry
(date and method of discharge not given)

He was listed as:
* POW 11/8/1862 (place not stated)
* Confined 11/15/1862 Old Capitol Prison, Washington, DC
* Exchanged 11/18/1862 (place not stated)
* On rolls 8/31/1863 (place not stated) (Present)
* On rolls 12/31/1864 (place not stated) (Present)
* Paroled 5/2/1865 Winchester, VA

He was described at enlistment as:
5' 10.0", fair complexion, hazel eyes, brown hair

Other Information:
born in 1832

Buried: Confederate Cemetery, Manassas, VA

(Postwar, Resident of New Baltimore, Fauquier County, VA)
- The Virginia Regimental Histories Series
.....................................................................................................................................................................................................
39th Battalion, Virginia Cavalry

OVERVIEW: 39th Cavalry Battalion [also called Richardson's Battalion of Scouts, Guides, and Couriers] was organized with two companies, later increased to four. It was attached to General Headquarters, Army of Northern Virginia, and served as General R.E. Lee's personal cavalry command. The unit participated in every engagement at which General Lee was present from Fredericksburg to Appomattox. On April 9, 1865, it contained 1 officer and 80 men. Major John H. Richardson was in command.