Hazrat Qazi Shurayh (may Allah have mercy on him) was asked: "What if the slave-girl has a husband?" He replied: "This is like keeping two swords in one sheath (i.e., it is impermissible)."