I can't put my finger on it right now, but in a Lincoln speech he said something on the order I have no legal right to interfere with the institution of slavery. If you would like me to look up this speech I will do so.
GP