Sayyiduna Ibn Umar (may Allah be pleased with them both) used to offer voluntary prayers on his mount, regardless of which direction it was facing, and he used to say that he had seen the Prophet (peace and blessings of Allah be upon him) doing the same.