This was a census of living Federal, Union, soldiers. Many Confederate soldiers were incorrectly enumerated. Most were found out and their names lined through and the notation Conf, etc. printed.

We would need to see the actual enumeration sheet to ascertain the individual. I do not find him in the 1890 census, however, most of the Ellis County records were lost in a fire.

Here is the only Rayburn I could find in the 1890 Ellis County census records

RAYBURN, George W., 28, head hh, farmer, b. Ark.
Rosa, 22, wife, b. Miss.
Benjamin, 5, son, b. Tex.
Eva, 3, dau.b. Tex.
Milton, 2, son, b. Tex.