This has nothing to do with the flag, but I was browsing through a New Orleans visitor's register in 1884 and it had the name E. F. Violett with his city listed as Paris, MD. Just a small lead, but maybe this will give you another area to research possible records left behind by the family.