Neil,
I did find a "Rabun" family in Carroll Co. GA, but nobody named "Walker" in any of the households.
Also checked under Rayburn & Raburn, but no leads on anyone.
Did Walker Rabun have a wife? When & where did he die?
I wish I could solve your mystery.
Greg