An item to remember is that Norfolk was Federal occupied turf in Aug 1863. Many native folks fled the area when the Federal forces came in. As George indicates his residence at the time in 1863 was given as Richmond Va. Not unusual. Also that he was a conscript, meaning he was drafted into service. He would normally have been briefly sent to Camp Lee in Richmond which was the training and conscription camp. (Not to be confused with Fort Lee the modern Army facility) From there he would have been assigned to a specific unit and off he was sent. The 39th was probably stationed at Culpeper CH at that given time. He would have reported for duty with the unit hense his enlistment record when he reported for duty typically would reflect the location. That in itself isnt always an indicator that he might have been residing in that area. Since it was known he or his family was in Norfolk at the begining of the war, and your ancestor was resident there when he died, I would still focus on that regional area for possible further clues.
Frederick