Sayyiduna Jubair bin Mut'im (may Allah be pleased with him) says that you (despite being a Qurayshi) have gone outside the boundaries of the Haram. Whereas the Quraysh did not go outside the boundaries of the Haram, they used to say that we are the people of Allah, we will not go beyond the boundaries of the Haram. But these words were not stated that you stayed at the same place in Arafat where you used to stay before. The narration of Janab Rabi'ah bin Abbad is also related to this chapter.