Interesting, I'll delve into it. It could very well fit though Clifton D and James P. are clearly and unambiguosly listed on the Howard Co. Census in 1860 with parents James and mother Lucinda. They are not on the 1850 list. If it turns out to be correct then I think Milton may be the only child to have progeny, though Frances A. disappears after being on the 1870 census in Howard Co. MO, perhaps she moved west too?
Are we having fun yet? If only 1830/40 census listed names... I'll have to recount bodies on the 1830 page against birthdays but I didn't catch it before.