It's my understanding that over 300 men of color served the Union out of that county. And that the monument is dedicated to them.
I know that this will be unpopular but I don't see an issue.