Not for the one who touches it with the intention of obeying Allah and seeking His closeness, because the Noble Prophet (peace be upon him) has stated that a person will receive only that which he intended.

It is narrated from Sayyiduna Abdullah bin Amr (may Allah be pleased with them both) that the Messenger of Allah (peace and blessings be upon him) said: "The Black Stone will come on the Day of Resurrection bigger than the mountain of Abu Qubais, it will have a tongue and two lips. Whoever touched it with the intention of obtaining its testimony, it will testify about that person. It is the right hand of Allah with which He shakes hands with His creation."