Hazrat Jabir states that when the fragrance from yellow-colored clothing has faded, there is no harm for a pilgrim (Muhrim) in using it.

Hazrat Abu Zubair says that I was with Hazrat Ibn Umar (may Allah be pleased with them). A man came to him who was in the state of Ihram and he was wearing two yellow garments. He asked, "Is there any harm in wearing these clothes?" He (Ibn Umar) said, "Do they have fragrance in them?" He replied, "No." He (Ibn Umar) said, "Then there is no harm in it."

Hazrat Abdur Rahman bin Ishaq says that my father narrated to me that he saw Hazrat Nafi’ bin Jubair at the place of ‘Arj wearing yellow-colored clothing while he was in the state of Ihram. My uncle Ishaq said to him: What is this? He replied: Its color does not come out (it is a permanent color, it does not fade with washing).

Hazrat Ata says that there is no harm in it.