From my research for my article, "West Points of the Confederacy": Rappahannock Military Academy was near Port Royal in Caroline County. Captian Thomas R. Thornton of the Caroline Artillery, a VMI grad, taught there and became its head. General Mahone also taught there.
Rappahannok is the only military academy in VA wih those initials.