We found a book from my grandmother’s (Martha Barrett Huestis) side of the family called “A Family Chronicle: Barrett” that confirms this story. Granny (not sure why I’m calling her that but it’s funny in this context) -Sarah Cornelia Barrett (nee Walton) definitely scared off the Yankees at dinner.
If anyone would like to know more about the book that we found or the recount of this event, reach out to Tom.c.stetson@gmail.com
Pictures from the book:
https://share.icloud.com/photos/06cXLDiQcE-TnqUbWDONgNklw
https://share.icloud.com/photos/04exQ1pVogQDU-uh-94jFIZBA